There are two three to consider here, when assessing potential negative impact:
(1) Data is forever. Just because something is fine now, doesn't mean it will always be fine in the future. Millions of women in states with abortion ban trigger laws thought the free cycle tracking apps with permissive privacy policies were a fair trade off. Now it might not be.
(2) It's not "just" your personal shopping habits. It's your personal shopping habits, combined with your cell phone location data, combined with your credit score... combined with your web search history... take a look at the Social Credit Score in China. 1.2B+ people whose data is combined and analyzed every second of every day. Think it can't happen here?
(3) If this data were only useful to the supermarkets themselves, why would it be sold to so many other companies? If this data is only valuable for optimizing supply chains, why do companies hire PhD-educated data scientists to do stuff with it? Seems like overkill if your objective is make sure you have sweetcorn on the shelf at the right time.