But, Rosetta is incredible.
My solution for now: build only on Intel based Macs and use the binaries everywhere, with Rosetta when needed.
I've had lots of errors running all kinds of builds with "error, arm64 code..." it's not a solved problem by a long shot.
Until the prevalence of M1/M2 is overwhelming, I'm just going to stick with Intel builds.