The weird thing is that paper tends to cost more energy to produce than plastic, so in that sense plastic can be seen as the more environment-friendly choice. But yes, there's lots of stuff that doesn't need packaging at all.
More energy in production for paper while true, also means that with solar and other renewable getting cheaper, that argument will be a distraction.