Or perhaps firewall your server properly so only people who are meant to connect to port 22 can connect to it?