Hacker News Reader

Comment by rahidz | Hacker News Reader

I hope Eleuther will continue to focus on the development of truly open-source models, which seems to be where the big gap is. The quality gap between Neo-20X and even the original GPT3 is still rather large, and making headway there would be amazing.

View on HN

there will always be gap, since corps can grab open model, and add resources to improvements on top of it.

This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models

Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models.

Add the size barrier (an order of magnitude > SD for text models) and it’s pretty questionable the open source text models ecosystem is going to go anywhere.

Hardly anyone has done anything interesting with any of the existing ones and they’ve been out for longer than SD has.

Text models just aren’t that interesting to people.

I’m more interested in text models. So much potential there. I was fascinated by the person who hooked up a Siri shortcut to one of the openai models, asking it to return a json response. I think with a little imagination the potential applications are just as compelling as image models like SD.

Just one example, using these in games to generate unique conversations, actions, and events.

9 days later and its now possible to run a 65B parameter LLM on a 64GB macbook pro, significantly outperforming GPT-3, OpenAssistant has announced that they got more than 100,000 samples of RLHF to replicate the 'Chat' component, Kobold Horde now supports Llama-33B for anyone to try in a playground with no censorship, and at least 4 other independent projects are spun up to develop at-home LLM tooling.

People want good text models at home.

> Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models.

Spot on. Everyone is talking about hos "fast moving" and "innovative" SD community is. Is it? I don't see many models that generate something that is NOT pretty anime girls. There are some... but if you exclude all "female focused" models, SD community doesn't seem particularly active.

The problem with LLMs is the big ones don't run on consumer hardware. If 12GB or 24GB ram would run them you would see just as much interest.

The open source models will keep up as hardware allows IMO.

I think this space is in initial choke chaos.

Eventually commercial entities will build pipelines which will absorb open models and build on top of them using proprietary tech, data and expensive compute.

Reply on news.ycombinator.com