Hacker News Reader

Comment by bottlepalm | Hacker News Reader

Smart for Dalle, Midjourney, and Stable Diffusion to capitalize on this quickly. It looks like the technology is being commoditized at rapid speed. I wonder what’s next.

View on HN

People are getting into "prompt-craft". People have also started pasting different AI tools together like putting these images into CogVideo[0] to generate actual videos (takes ages and usually the length of a gif currently). Others have realized you can run these images through GANs to make faces look extremely convincing

I think "what's next" is fitting these tools together in a larger system

[0] https://replicate.com/nightmareai/cogvideo

Ok I’m just going to list ideas, feel free to add more

* Text to 3d model

* Text to video clip

* Illustrations for newspapers

* Generating pictures for food menus

* Generating a music video from a song

* Generating pictures or even an entire movie for a book

* Interior design ideas

* Product design ideas

I have noticed that leveraging these tools isn’t easy. It requires a fair bit of creativity to come up with the prompts to create an image to really wow somebody.

Someone on the midjourney discord is making a comic with images generated by the bot. Another person is making a Magic The Gathering card pack with generated art (it looks good too!). People are already using it for stock photos

One murky area we're still far away from but I'm curious to follow the developments on: AI-generated movies. Once generated clips gets good, what if some movie buff can just generate a movie, scene-by-scene, just using these tools? What about "casting" certain celebrities? The comic I mentioned uses Zendaya (probably because she plays a character in the Dune movies) as a character

Lot of potential for movies- using AI to up res, AI to turn a 2d movie 3d, more advanced would be new or edited scenes. Or how about translating a live action movie to a cartoon and vice versa. Or a different style or tone. Run The Lord of the Rings through a cyberpunk filter.

I'm eager for someone to start recreating the missing episodes of Doctor Who. The audio still exists and there are publicity shots from many of the missing episodes

I wonder how good AI will be at recreating the look of the props made out of broom sticks, gaffer tape and paper mache.

How do they get consistent looks? I mean if you are using it for a comic book your characters should look the same throughout the story. From my experience, the results between prompts are completely different even with minor variations.

If the seed remains the same, the difference between similar prompts is actually continuous.

Here's a slew of images (1 through 5) I generated all from the same seed and same prompt sans a word or two: https://www.instagram.com/p/Chg60Fou6xB/

Thanks. Those are amazing by the way

Thank you mate. Spent a lot of time, even though the AI did all the _real_ work :-)

> Generating pictures for food menus

This is what I've been doing for any recipes[0] that don't have pictures with pretty good result.

[0] www.reciped.io ex: https://www.reciped.io/recipes/mushroom-and-onion-pizza/

Is there a good central source that lists out all of the currently available tools?

The AI is moving up the "content ladder" generating text -> now images -> next videos

Smart for Google to invest in this because their business relies on third party content to exist (blogs, webpages, youtube videos)

If they can vertically integrate their business to create the content AND own the discovery algorithms then they officially win the internet

Generating videos and 3D models is _much_ more difficult than images. You can’t just train off videos from the internet in the same way, because they don’t have sufficient text labels to understand them like CLIP does.

I wonder if subtitles could be used, so rather than describing the video, you just write a script and it generates video for you. I'm certainly no expert, but it does seem like there's a lot more data there.

Oh but they have sound which can be annotated much faster/more efficiently. You also potentially have screenplay but the amount of training data is probably too less and sparse.

FWIW, I don’t think the AI systems will generate a whole video by itself - it’ll be some form of image to image generation where an artist will render a rough sketch of the scene and the AI will fill in the details, frame by frame.

I mean at this point it’s really not a question of if, but when - right?

Stability.ai and probably others too already working on video and audio models too and also I think I heard a service to train / finetune the model with your own dataset.

Reply on news.ycombinator.com