Stick all the stuff you manually care about into `~/home/` (or some other directory of your choice, e.g. `~/a/` for easy typing). Leave `~/` for the various programs to dump config files in.