Why are they “wrong at a fundamental level”?
The work done in Nix and Guix is interesting in this regard.
Traditional package manager conflate having something with composing something (everything is ambiantly available and interacting). Nix separates those, so you can have every version of everything, and only try to compose things that fit.
I don't want a middleman, I want to get my programs from the developer, and store them using the tools I know (regular files on a filesystem).
Are package managers easy to use (most of the time)? Yes.
Are package managers (as they exist today) a universal, well designed way to distribute software? No, because they impose a middleman.