Options for accessing Llama 3 from the terminal using LLM

simonwillison.net

3 pointssimonw2 comments

I tend to think openrouter is the most interesting and best choice for the majority of builders.

It's incredibly easy to test and even offers convenient abstracted provider load balancing to reduce high latency events.

Have you seen the load balancing feature work? It's neat on paper, I'd be interested to hear from people who it's kicked in for.