Cool! I've used a similar workflow with teams that SSH into boxes with GPUs, VSCode makes it completely seamless - surprised i don't hear about it more
Would not using one of the selfhosted CDE solution make it even easier?
Kind of, I used to run code server but you miss out on plug-ins and other custom settings. Connecting via SSH is seamless. You can copy from local -> remote, keep your plug-ins and access from any machine with VS Code.
What if it was as seamless but also managed everything for you. Can send you a link to try it out if you like?