Using initial images with VQGAN and Clip

Thanks so much for this! This was an exact problem my team had at a recent hackathon, and we decided to use diffusion instead. We theorised that the initial image parameter might help, but we didn't have time to test it. Documenting this was really helpful. If you have any other articles or advice on using VQGAN (or other generative models) with CLIP (or other language embeddings) I'd love to see them.

Using objects on white background as init image is also quite helpful to isolate the subject you want to generate.

That's what I did here with sea slugs and sex toys mix: https://www.instagram.com/p/CWqvXHXj4sM/

That’s a great looking blog - what’s it built with?

Now do conditioning GLIDE with initial images. :P