I will argue with that: The floppy disk on has grip on our mind, because we, as the user of the medium, have stuck with it for a couple of decades. When I am saying we, I am talking about computer users in the science/business world roughly during the last 30 years (god forbid there are still people using this thing today).

If one take the idea of saving outside the computing world (meaning where the computer is used on a daily basis), then I see two choices for the representation: a bank safe as the old age mean to save (money or valuable in this case) or a folder for document (dead tree medium are not going to die any time soon). I think that a study needs to be done among non computing educated people to understand better what is their mental (pictural) representation of the action of saving is.

All I am saying is that the floppy disk is pretty much a cultural centric representation of the action of saving valuable information for later retrieval.