How often do you have SSH access to a box but don't have SFTP access?
Most IDEs support editing files on a remote machine through SFTP.
Most IDEs support editing files on a remote machine through SFTP.
So, if "digging around" means looking at folders' structure, you can do it through SFTP without copying everything (unlike scp or rsync).
And if digging around means running commands, nothing prevents you from having a session for running commands open in parallel.
In any case, it's literally been years since I've had to.