It is weird, because here: https://gohugo.io/getting-started/installing
...they refer you to the GH's releases page, where you can find binaries ready to use (I don't use Mac, but I see 64 bit and ARM64).
You don't need a Go dev env to use Hugo. I use it in Linux and I don't have a Go compiler installed.