According to this (1), they are using the 4o model. And looks like you'll be able to pick your model(2) in the starting with version 1.94 released this September.
1.https://code.visualstudio.com/updates/v1_92#_github-copilot
2.https://code.visualstudio.com/updates/v1_94#_switch-language...