Could be a nice wall paper generator every 29 min. Input a big list of random prompts and let it rotate
A 4090 can generate over 100 images a second with turbo+lcm and a few techniques, you can make 2 days worth of images in 1 seconds. You could make a years worth in roughly 3 minutes and put them on the sd card
I found this claiming an A100 can generate 1 image/s.
https://oneflow2020.medium.com/text-to-image-in-less-than-1-...
The article you linked is over a year old. Needless to say there have been a LOT of optimizations in the last year.
Back then it was common to use 50+ steps for many of the common samplers. Current methods use a few steps like 1. This OnnxStream are using SDXL-turbo, and you can combine LCM and a few other methods to go very fast.
The reason it's so much faster now is the OnnxStream is only using a single step.
This repo claims 149 images/s on a 4090 https://github.com/aifartist/ArtSpew
However even if you only get 1 image/s with whatever GPU you have I stand by my original statement that unless you want to do it for the cool factor (which is very valid), pre-calculating them makes more sense.
I actually get around 100 imgs/s on my 3080Ti. Three things to note: 1) you gotta run the max perf code to get the high throughput, 2) the images in this setting are absolute garbage, 3) you don't save the images so you're going to have to edit the code to extract them.
Definitely agree that this project is much more about the cool factor. I suggested a GAN in other comment for similar reasoning (because it's a pi...) but if you want quality images well I'm not sure why anyone would expect to get those out of a pi. High quality images take time and skill. But it's also HN, I'm all for doing things for the cool factor (as long as we don't sell them as things they aren't. ML is cool enough that it doesn't need all the hype and garbage)
The "look how fast we can go" method (turbo model with 1 step and without CFG) is blindingly fast, but the quality is...nothing close to what was being done in normal 50+ steps with normal setitngs gens.
Realistically, even with Turbo+LCM, you're still going to 4+ steps (often 8+), with CFG, for reasonable one-generation quality anywhere close to the images people generated at 50+ steps without Turbo/LCM.
Which is still a big improvement in speed.
For sure the only reason I considered comparing it that way was because the linked repo appears to also be going for a similar approach with 1 step/image on the pi.
From my own experience I've had a hard ever getting a decent image below 6~8steps, but this repo seems more focused on getting it to run in a reasonable amount of time at all, which understandably requires the minimal "maybe passable" settings.
[0] https://github.com/aifartist/ArtSpew/
[1] but the project is still cool, just context...
If you want to say the zero2-w is what's making it then sure.
> Besides, a 4090 costs more than a car.
They only cost ~0.70USD for 1 hr. In fact you could put this on an A100 for 1$/hr. Renting would make the most sense for this type of thing.
If there's a human in the loop, 100 images/s is likey too much volume, especially if prompt engineering is needed.
At the same time, 2 images/hr is way too slow.
> 100 images/s is likey too much volume
You can always generate less
I feel like you can't even find driveable cars that will last 100 miles at that price point anymore.
/hʌɪˈpəːbəli/
noun
exaggerated statements or claims not meant to be taken literally.
You don't have to use a 4090, you'll still get double digit performance with a 3060 or whatnot.
> for people who can only otherwise afford Raspberry Pis ;)
You can rent a 4090 for 0.7USD/1hr, or get an A100 for 1.1USD/hr. And if your project is a display + raspberry pi then those costs will dwarf the rental cost.
It failed to load. They reported that it was detected as against their terms of service.