It always comes back to taste.

It’s not that they’re incapable of creativity, it’s that LLM-driven creativity is terrible, and nothing makes me cringe more than when it uses a word in a “novel” way.

But monkeys-with-typewriters, they sometimes stumble upon something that doesn’t suck. But if you don’t want to spend a fortune retrying the same task until you get a suitable result you have to inject your own taste.

Sometimes I start with a super vague prompt and see how close agents can get to something that doesn’t suck. I inevitably get frustrated about 6-7 prompts in when they’ve created a complete mess because they have no taste. So I restart and inject my taste into the process. Things like linters, test suites, which 3PLs to use, etc.