That's how luxury goods..Couch, Michael Kors work...become a luxury good, then reduce price/quality for common folks. Common folks get luxury name and feel good.
You'll abandon the rich people but you'll make more money.
There do exist upscale over-priced places way more expensive than WF which are closer to your straw-man.
$7.44 at Walmart
Pics for proof: http://www.imgur.com/gallery/BrHhzVx
I guess the high price is the Whole Foods tax. That being said, I do eat at their deli...
Note that business is complex and a good business pivots often, it may be that whole foods was bought at the peak of one, but they pivots to something else and remain successful. If Whole foods pivots to something else and remains successful that would prove nothing either way.