This project is doing LLMs of all things with WebGPU too!

https://mlc.ai/web-llm/