There are already VS Code extensions (Cline, Roo Code and Kilo Code) that do the same + are much better IMO.

Disclaimer: I'm one of the maintainers of Kilo.