I'm pretty sure SSH wouldn't mind the config being a symlink to a file in your safely-held-elsewhere repository. Maybe I'm wrong. (m)DNS is what I'd really go for if I'm really just looking for easy access to names.
I wouldn't worry, but I also have the habit of adding things to the index explicitly. If I did worry: gitignore.