It's been a long time since I've had to SSH into a box to fix an issue in production. But it is comforting to know that I _could_.
VI (not even VIM) on minimal Debian installs does not have syntax highlighting.
VI (not even VIM) on minimal Debian installs does not have syntax highlighting.
Most IDEs support editing files on a remote machine through SFTP.
So, if "digging around" means looking at folders' structure, you can do it through SFTP without copying everything (unlike scp or rsync).
And if digging around means running commands, nothing prevents you from having a session for running commands open in parallel.
In any case, it's literally been years since I've had to.