The Human Creativity Benchmark – Evaluating Generative AI in Creative Work

Note that the title is completely misleading. When they say "creativity", they mean it in the sense of a "marketing creative". This is about marketing people evaluating AI-generated product shots, which are hardly the pinnacle of human creativity.

They should have named this study the "The Turning test for Design." All they proved was that AI could convincly mimic long established human created norms in in visual communications. "Hey, our prompt output images that are competent enough"

Is anyone surprised that a diffusion model trained on petabytes of human created artifacts could properly mimic human created artifacts?

I'd still argue that there's this AI'ish veneer that's just slimy enough to pickup and tell.

The real benchmark in human creativity is originality / novelty. These look like they came off of every half-decent designer's Pinterest board.