You still had some "privileges" by not being black, and not being a woman. "Privileges" in the sense that you weren't automatically assumed to be a thief, for example, when walking in to a store. Or the privilege of actually being granted an interview for a non-secretarial position when you applied for one.
The "white male privilege" people speak of is less to do with people handing you bags of money and opening doors for you, and more to do with those doors not actively being shut in your face simply by dint of gender or skin color.
I speak as a white male who grew up in the 80s and in to technology. I certainly remember it was not 'cool' to be in to computers/tech back then (not like now) but there should be little disagreement that being male was not a hindrance for most desired walks of life (whereas being female, moreso then, definitely was).