What projects are you working on that take 5GB of venv size? My venvs are under 1GB. What I would consider a large automation framework is ~150MB.
In almost all cases venv are needed because the dependencies are brittle and changing the python version or some package version break the program.
Considering that those sizes don't even include the models, what is actually taking up several gigabytes? How is it so much code? Or is it more than code?
I know it includes dependencies, but I'm still baffled.
The Nvidia packages alone take 2.8G and torch another 1.4G. Numpy, transformers, matplotlib and two dependencies named sympy and triton add another 500 MB, and with that alone we're already at 4.7G.
When you use Conda instead of venv, the amount of cuda packages grow even more if you're unluckly.
It's all way too big.