Your point is valid and correct.
Most of you remember Twinkies, its parent company going bankrupt and them being gone... Those products were delivered to stores, fresh every day(ish) by manufacturer employees and put ON THE SHELF by them... This still remains true for tons of products.
For some products grocery stores function like a merchant on amazon.
Data tracking... well that really matters to a grocery store, because people have "brand loyalty" and tend not to return (ever again) if their "item" is out of stock. These anchor items are often loss leaders (detergent is the massive example).
Amazon isn't any different than anyone else, and isn't even the biggest one (Walmart still has that crown).
Oddly I could make an argument that amazon, being allowed to be dominant and pushing large retail out of business would be good for everyone... a return of small retailers might happen on the back of that.