UTM should be running arm64 Linux guests using virtualization and NOT emulation. I have been running arm64 Linux guests on M1/M2 Macs and it is not at all slow.

Does your Linux guest have the "Use Hypervisor" setting turned on?