Still, that's why it's research! Wouldn't be fun without feeling a bit impossible.
This is not evolution, it's exactly the opposite. Take the cake sample. You have a goal (the cake) and let the AI system find a way to reach that goal. Evolution has no goals at all.
It's a shame that a useful word is less useful now - purists want to make sure that biological evolution is never misrepresented. That's fair enough. It's a simple concept and lots of people (even the ones who accept evolution) sometimes make mistakes.
Personally, I think the term "computational evolution" is clear enough.
The concerns were over my "cake recipe" metaphor, rather than evolution itself!
The combination of natural selection and sexual reproduction tends to produce organisms which "fit to" their environments (hence "fitness"). It does so reliably enough that it might as well be the goal.
"AI systems" are not like people and they don't need people to be around to work, they do not function on the basis of ongoing intelligence from people. If the people die and there is nobody around to care, the same mechanisms do what they always did according to the natural law of the universe. They are just mechanisms which get things done. And so is evolution. And it is irrelevant that no person designed evolution to be that way.