I wouldn't go that far. Sure, it's not as cheap as it used to be, but the average Japanese person can certainly afford to shop there.
As always with the memes, I agree that it's largely an exaggeration. But I can assure you that it is definitely getting too expensive these days, and I'll think twice before buying from them.