Better title: Image classification models suck at identifying nouns that they've rarely seen.
Crucial context:
- They're only looking at image models -- not LLMs, etc
- Their models are tiny
- A "concept" here just means "a noun." The authors index images via these nouns.
- They didn't control for difficulty in visual representation/recognition of these exceptional infrequent, long-tail "concepts."
If I didn't know an object's label, I too would struggle to identify/draw it...