My preferred browser is Firefox, however @crenfrow after months of fight with poor performance I had to switch to chrome … until firefox is fixed (by Penpot or mozilla).
I use the ungoogled chromium, GitHub - ungoogled-software/ungoogled-chromium: Google Chromium, sans integration with Google and the mac binaries, GitHub - ungoogled-software/ungoogled-chromium-macos: macOS packaging for ungoogled-chromium
Once I did this usability shoot up by 75% (I didn’t measure this, just a estimation). It’s not like using a native app and I can’t remember how figma was in the setup, but it’s so much better now.
Perhaps this will help you. Also Since I only use chrome for penpot, I only have that tab open nothing else. In firefox I had a lot of tabs open for other task which I think contributed to the slow downs as well. Good luck.