I guess that OP is talking about having the IDE/compiler/etc binary on their computer and not having to rely on any external service to work.
Well then self-hosted Gitlab is the perfect option.
GitLab team member here - using VS Code on a desktop client works well with the GitLab Workflow extension [0] for Git SCM operations, as well as CI/CD pipeline status from pushed commits & merge requests. Additionally, remote repository views come in handy. [1]
Yeah, practically, it's the same. They don't even own git tbh, and won't even make noise on git core mailing list. I can even go extreme, practically, whether they even can.