On the iPhone I turn on voice isolation and 99% of the problem goes away. Have you tried that?
I use the voice isolation one and people I've talked to say that it's drastically improved the call quality, particularly while I'm walking next to a busy street.
edit: you can see the setting without actually starting a call, just go into the facetime app and hit "New FaceTime". It will show you a blurred front view camera and let you pick a contact to call, but at that moment you can drag the control center down and they'll be there.
This tile shows up when any calling app is active. So it works for FaceTime or even third party apps like Google Meet. Good luck!