Or alternatively, block port 22 entirely on your firewall and use something like Tailscale to access the machine.
Of course, now your attack surface includes Tailscale, which has had it's own vulns in the past, but I think blocking all public traffic ends up being much stronger than any weaknesses Tailscale may introduce.