I've had a similar realization rather recently when cleaning out my parent's house after both their deaths. My father got me into stamp and coin collecting as a young child and it was an opportunity to bond and have something in common. For many years now, I haven't given the hobby much thought. Seeing the remnants on the old stamp collection brought back some memories. As I looked up values and got a better idea of what the collection might be worth, I could see clearly that even sheets of uncanceled stamps, which I used to prize, were near worthless. Some of that difference in perceived value is explained by the perceptions of a child versus that of an adult. But these stamps just hadn't appreciated much in value over many years, certainly not the degree anyone could call them a good investment.
But what was most striking to me, which I hadn't really thought about when I was young collecting these for entertainment, was just how particular and stultifying the grading systems for any collectible can be. I think the system, and how it interacts with money, is the culprit. There is this undercurrent of curation and preservation that goes along with collecting which leads to perfectly preserved toys in boxes. I appreciate things in themselves, and not just for their use. But I dislike the idea that a blemish, like a torn perforation on a sheet of stamps, can devastate the value of an object. For the objects I have several of, their use contributes to my enjoyment. If other people want to maintain museums, that's up to them.