It is not possible to install proprietary Microsoft extensions using the official VSCodium builds without additional, non-default configuration.
I thought originally it may have been an OSS extension, but it actually seems to have been a proprietary project licensed under the Microsoft Software License, similar to Copilot and such.