You probably just want to use the Remote SSH extension in VS Code. That should work a lot better than X11 forwarding, and it should be a lot easier than rewriting the whole GUI to use the terminal.