nix-darwin is a thing, and like all nix tools. It tackles this exact problem
I’ll probably use something dumber for the next machine, and keep nix for servers and local vms.
Where were your pain points?
P.S. I don’t use home manager though as I also need to bootstrap systems without nix.