Change the SSH port...
Also, changing the port does basically nothing these days, with stuff like Shodan around constantly port-scanning.
It's really just a matter of time. There are many things you can do to protect yourself and changing the port is one of them, but if you rely on it you're going to have a bad time.