I’m generally of the opinion that you either go all in for OS distributed Python packages, or you manage all versions yourself.

When I first learnt Python about 10 years ago, I found it much more common to install things from package managers because at the time, wheels had only just been proposed with PEP427 and so there was a lot more compiling from source if you installed things from PyPi. For similar reasons, Conda was popular.

These days, as long as you’re on a reasonably well supported platform (x86_64, ARM, and not Alpine Linux) and recent-ish version of Python (>3.7), then you can probably get a new binary version of most dependencies very quickly.