Yeah, that's how I remember it too. Back then I wondered why some people I knew bought SUVs even though they were only needing to commute to/from work.
In the early 2000's my own situation changed, I was needing to haul relatively heavy/bulky items. I acquired a Honda Pilot because of its rated 1300 lb payload, better than a small pickup. After a while that need ended, but I kept the Pilot and still drive it. However since then it's used <3000 mi/year, a good thing with price of fuel being what it is now.
The Pilot was/is built on the same platform as the Honda minivan, albeit with slightly modified drive train. Pilot and minivan have essentially identical mileage ratings. So with these models switching from minivan to "SUV" makes no difference in fuel usage.
Can't disagree that old-style "station wagons" were more fuel-efficient than minivans and similar size vehicles. However, station-wagons seem to have disappeared from the scene at least to my observation. Out of fashion I suppose. And from the fuel usage point of view that's unfortunate.
EVs are the future but expense factors will keep ICE in the picture for some years to come. Do you suppose the current increased fuel prices will inspire a resurgence of smaller vehicles for routine transportation? In the interim that would be a good thing.