Could just use Code - OSS that removes telemetry.
Can you use all the regular vs code extensions with "Code" that you can use with "VS Code"?
For the record, I'm also annoyed at the naming of Visual Studio Code. Not to be confused with Visual Studio which is a completely different IDE.