It has become better in the last year or so. I used to have the same setup but currently Meet on FF works without issues for me.
Edit to add that the suggestion of using Orion for everyday browsing and FF or Chrome/EDge for Google Meet is totally reasonable, but somehow I find quite a lot of friction doing that.