Is there a centralized list somewhere that tests "use this for x purpose, use that for y?"
Is there a centralized list somewhere that tests "use this for x purpose, use that for y?"
Something more domain/use-specific would be great to have
It’s an Elo scoring system, like chess. By definition the difference between two entries represents how often it beats the other entry.
Btw the similarity of the numbers 59 and 62 here is coincidence, other differences won't be nearly the same as the probability.
It’s just distributed ADHD at this point. LLMs are new and cool and each new release will be significantly better than the last, but as with any emerging tech, we’re on an exponential curve so there’s no sense in falling in love with specifics or products until things stabilize.
I just want a FOSS 'ADHD' model that I can ask questions to and it gives me mostly accurate answers as well as help me debug shit lol.
Yeah, "don't use these models for production, use OpenAI for production, ignore Claude/Gemini/etc.".
Any one of these companies can at any time change their API, pricing, access rules, or even swap the model out for a dumber, cheaper one at the same price. You'll have no recourse if you don't have several backends available, or control your own.
At a minimum, you should have available several hot-swappable backends/APIs if you want to remain viable in an indeterminate future.
Why should I respect copyright on a model when the model training didn’t respect copyright? To be clear, I’m a copyright abolitionist so I’m down with not accepting copyright. I want someone to force OpenAI to be actually open.
Most of the reason I'm asking is to use them for personal usage. Not a huge fan of closed models in general.