Would love to see this implemented with @huggingface/kernels for shader compilation for Webgpu.
I think it will be the basis for a rewrite of transformers.js v5, but no need for you to wait as you would likely want direct access. It is also way better than loading WASM, and faster to boot!