I used to share a similar position until I realized: drugs are bad, actually, and there should be substantial friction in making them available to people.

Disincentivizing drug consumption is a good thing. The war on drugs obviously leads to some absurdities - e.g. drug cartels, unnecessary incarceration - and I much prefer the Portuguese model.

But making fentanyl in particular available in the grocery store would be bad; some substantial number of people would die who wouldn't have died otherwise. Some substantial number of people who would never have tried fentanyl would give it a try.

Some sensible balance needs to be struck between a free society and preventing people from e.g. leaving live landmines in their parking lots. Doing things which inevitably kill people/mess up their lives without active violence is still bad, and should be heavily discouraged.