I ate lobster maybe 100+ times (and enjoyed it) before I learned that it used to be peasant food.
I think the point is a little overwrought, really... while our expectation is part of what makes it taste good, it doesn't completely change what we think... there are a lot of foods that are considered delicacies that a lot of people don't like.
When I was a child, I didn't even know the word "delicacy" let alone have any concept of whether what I was eating was a delicacy or not.