To be fair, having the concept of a desktop matches quite well with the concept of a folder.
On the Amiga, you didn't have a desktop per se, but a Workbench. A Workbench has drawers.
The analogy breaks down somewhat, since I can't pull down my real-world workbench to reveal a red and white bouncing ball. Unfortunately.