On the one hand this is annoying, on the other it’s great that you can just backup your home dir and have all your files and settings in one go.

Also this annoyance is easy to solve, just make one dir in home (my is called after my name) and put all your own files in there.