Shouldn't a LLM know how a pelican looks like from biology without being trained on very specific artistic data?
This is for example the result of a taxidermied lion in Sweden when the guy doing the job never ever seen a lion or a photo of them and just worked off descriptions. https://www.snopes.com/articles/344637/the-lion-of-gripsholm...