Two more places to extract hostnames for ssh auto completion are .ssh/known_hosts and the .ssh/config.

Or give zsh a try, simply autoload compinit and it will do ssh/sftp auto completions along with a boatload more out of the box.