Has anyone tried this with non-celebrity faces? I tried faces from thispersondoesnotexist.com onto various face on poses which would be easy to photoshop, and it had terrible results, changing the identity entirely and making the image look cartoonish even with no style set.
Are the great results they're showing just a result of the diffusion model having overfit certain celebrity faces?