Hacker News Reader

I think that Cerebras and Groq would be fun to experiment with using normal LLMs for generating interfaces on the fly, since they are so fast.

what's the cost difference between groq/cerebras vs using something else for inferencing open source models? I'm guessing the speed comes at a cost?

I don't know off the top of my head, only played with it a little not seriously.

fair enough

0.6/1$ per M tokens in groq/cerebras vs 0.3$ per M tokens in deepinfra (for llama 3.3 70b)

But note the free tiers for groq and cerebras are very generous.