Hey brian, I remember you from
https://news.ycombinator.com/item?id=37705445 and recently open sourced one part of that app here
https://github.com/jaideep2/apinaio
Its a set of docker images to simplify GenAI workflows, since its hard to setup workflow correctly, especially for stable diffusion models. Only works on CUDA hardware for now, but contributions welcome :)