$HOME is where my terminal and file manager start. It's not reasonable to give up on this prime directory real estate.
If it will be enough, I don't know. It might be enough for some, but it is still something which can be done without getting the maintainers of openssh to agree with the idea of a clean ~.