Three-LLM: Three.js-based WebGPU LLM inference engine

three-llm.ben3d.ca

12 pointsbhouston5 comments

What makes a 3d graphics rendering engine a good fit for llm inference?

ThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development:

https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan...

That makes very little sense when you can just use WebGPU and have fine-grained control...

for something like LLM inference, having this kind of abstraction seems like quite a hindrance

Okay. I will give a raw WebGPU implementation a try and see if it is smaller and more efficient.

can someone please go ham on a newer three.js, preferably with a lot of A-frame built in, for the modern era, that is also webgpu native? pretty please?

Reply on news.ycombinator.com