Hacker News Reader

What makes a 3d graphics rendering engine a good fit for llm inference?

ThreeJs has an abstraction that allows you to write your shaders using JavaScript, it is called ThreeJS Shading Language. This implementation makes of that to simplify development:

https://github.com/mrdoob/three.js/wiki/Three.js-Shading-Lan...

That makes very little sense when you can just use WebGPU and have fine-grained control...

for something like LLM inference, having this kind of abstraction seems like quite a hindrance

Okay. I will give a raw WebGPU implementation a try and see if it is smaller and more efficient.

Reply on news.ycombinator.com