Seems kinda painful. Just turn off passwords and let them try all they want. I find rsync particularly painful with a non-standard port.
Or you could use the standard port, turn off passwords, and wait for the sun to burn out before someone brute forces their way in.
How do you ssh-copy-id without some allowance for passworded logins? Especially if you're doing it from such distant machines that you can't scp over a .ssh/config file.
Sure, I could have puppet push a ~/.ssh/config file everywhere, just seems more effort than it's worth. After all if a hacker wants to know if you are running ssh, it's not hard to scan all ports for ssh.
Why inconvenience yourself more than the attacker?
meh. Just means typing in the port in putty. Pick an easy port - 60k. I can live with that.
Seems like a big inconvenience for minimal extra security. Not like scanning for all open ports that have an ssh listening is hard.