Use ~/.ssh/config to add per host or wildcard values for port :)
The config-aware shell completion is especially cool.
I hadn't even noticed, because I tend to automatically reach for rsync instead, even for single files.
Edit: and until the ticket you just linked, I assumed scp and cp were intended to be close equivalents, given the whole ending in ‘cp’ thing.