Hacker News Reader

Comment by quickthrower2 | Hacker News Reader

The old open source, but we'll host it for you? I think Bezos is going to be in fits of evil laughter about that model in 5 years, as all the open source compute moves to the clouds, with dollars flowing his way.

But one thing Mistral could do is have a free foundational model, and have non-free (as in beer, as in speech) "pro" models. I think they will have to.

View on HN

Release small, open, foundational models.

Deploy larger, fine tuned variants and charge for them.

There’s a reason we don’t have the data set or original training scripts for mistral

it’s a “mistry” ;)

There are huge economy of scale benefits from providing hosted models.

I've been trying out all sorts of open models, and some of them are really impressive - but for my deployed web apps I'm currently sticking with OpenAI, because the performance and price I get from their API is generally much better than I can get for open models.

If Mistral offered a hosted version which didn't have any spin-up time and was price competitive with OpenAI I would be much more likely to build against their models.

This only is defensible for closed models though.

Here's to hoping such models run on dedicated chips locally, on Phones and PCs etc...

They already do, we just released a model equivalent to most 40-60b base models that runs on a MacBook Air no problem.

It's like 1.6gb, ones coming are better and smaller https://x.com/EMostaque/status/1732912442282312099?s=20

I think the large language model paradigm is pretty much done as we move to satisficing tbh

Reply on news.ycombinator.com