They didn't unless they were well off. Only 8% of houses had a computer in 1984. 15% by the end of the decade. C64 was $595 new, if you had one I doubt your family was poor.
I grew up with the ZX Spectrum, like so many others, and it is what started me programming/developing/being interested in computers.
You're probably looking at it from a biased point of view though. When I was growing up everyone had a Snes. Of course it was just all teenage boys that had one.
Everyone loved the C64 though, so fond memories are worth something.