Hacker News Reader

Comment by bpiche | Hacker News Reader

This implementation popped up on hacker news not too long ago. I got it working on Colab first, and then my own GPU at home. But just barely. Need more memory :)

https://github.com/lucidrains/imagen-pytorch

View on HN

The value is in the data and the trained weights, the implementation is not where the bottleneck is in term of reproducing those models.

Still great work from the author though, but we most definitely cannot say that imagen is released.

Are there any large publicly available models, ready to fine tune and deploy, that were trained on massive data sets?

I really want to build services with these.

VQGAN-CLIP

Wait, so I can try this on Colab right now?

No, something that's been causing a lotta confusion in AI art is people stand up quick implementations generally matching the general description in the paper, but, they're not really investing in training them. Then people see "imagen-pytorch" on GitHub and get confused, either think it's Imagen itself or a suitable replica of it.

There's like 3 projects named DallE, and then the 2 real DallEs...frustrating.

It is a suitable replica of it. Just isn't trained.

But the training is the thing that would make it suitable.

I mean, you try training this thing without a warehouse full of GPUs… to me, the algorithm is just as interesting as the model. Perhaps more so.

"This thing" has already been trained. Nobody is saying the algorithm is not interesting. Just that "this thing" has not been released.

Yes, nobody said one way or another. I chose to shine a light on the algorithm. What’s your point?

Rather rude to ask it that way. My point is there for you to read, or miss. Up to you.

"I gave you an open implementation of NAND and NOR gates. That's the core of this groundbreaking CPU. Just finish the job!"

People are really thirsty to play with this tech, you can't blame them. Just search for dataset creators on Hugging Face. I'd link directly to several of them running but it would just overwhelm the creators. If you want to be in early you'll find them. The beautiful thing is open source is going to make this stuff available for everyone and in very short timeframe. It's crazy how fast it moves.

>The beautiful thing

I'm very much looking forward to be able to play with this tech asap. I'm still excited about AIDungeon.

However, OpenAI and creators of the other big name models are restricting the access for good reasons and I'm unsure whether it will be a beautiful thing once it's available for everyone…

Eh, it exists and it's an inevitability that it will eventually be used in terrible ways. OpenAI and Google people just want the CV booster for having created it but want to pretend it's not their fault when it's used to do a racismsexism.

I agree. Tay is still fresh in a lot of folks’ minds.

Reply on news.ycombinator.com