To end up in the directory where you are, you just have to exit using esc or alt-q, assuming you have set up your shell config.
I'll add ~ as a shortcut for the home directory, thanks for the good idea! (It conflicts with type-to-search for folders starting with '~', but I think that's much less common than cding to home.)