Very inefficient for commands such as find.

Assuming one is using a Linux client (or possibly one of the BSD flavours), then yes. For other systems reverse tunnels may be the only viable solution - apart from the logout+scp.

I haven't tried it, but this may work with rsync as well.

I use sshfs with Back In Time to manage my backups. Works like a charm!