Run Docker on Mac. Wait for something to finish. Keep waiting.
Run Docker on Linux. No wait.
Decision made.
I run Docker Desktop on OSX on an M1 Pro and haven't had any issues. Yes, you do need arm64 builds of things; the x86_64 emulation is indeed apocalyptically, unbearably slow. But otherwise, the shift to doing local development in docker-compose has been transparent and seamless.