Hacker News Reader

Comment by thyrox | Hacker News Reader

Wow this is super impressive but does somebody know a way to generate consistent characters with stable diffusion?

What I mean is if my first prompt is a girl talking to cat and second prompt is girl playing with that cat, I want the girl and cat to be the same in both pictures.

Is that possible? If so any links or tutorials will be super helpful to learn.

View on HN

IIRC Dashtoon studio allows you to create comics with consistent characters using stable diffusion: https://dashtoon.com/create

You can do this on Dashtoon Studio. They let you upload just one image and train a consistent character Lora. It's a software for AI comic creation. Found this video on their youtube https://www.youtube.com/watch?v=EEQwEvKQGvE Lora is by far the most versatile because you can get your character consistently in any pose and in any camera angle. IP adapter replicate too many traits from the input image, and you can't choose what not replicate like the pose. So getting a character from a portrait input to do anything else can become. For Reactor you need a generated image into which you can swap in a face. Works very well for realistic images, for stylized images the style is not maintained. Also hairstyle won't get copied. So Dashtoon is the most reliable thing and easy thing I've found so far because collecting 20 images of a new character is hard and the properties of the images in a Lora training set are really important like how many close ups, how many expressions etc.

Check out https://scenario.gg - they let you train your own LoRAs on custom images of a character (you need around 20 or so images from different angles for good consistency). A bit simpler, and actually still pretty decent is IP-Adapter, which they also support. Having the cat be consistent is going to be challenging without a custom LoRA I reckon. See this for guidance: https://help.scenario.com/training-a-character-lora

It's usually enough to just use names "Maria Smith" will almost always look like "Maria Smith" in good SD models.

Mickey looks pretty consistent: https://fastsdxl.ai/share/4us7hrp3jm20

Check out IP-Adapter, FaceID, and Reactor.

Use a celebrity name. Or "Mix of Celebrity A and Celebrity B"

Reply on news.ycombinator.com