If you told me that you don't own a television and then I told you that I don't own one either, we could talk about why we don't own one.
The whole point of the "I don't own a tv" and the backlash against saying it, was that it became a way to demonstrate that you were leading too exciting of a life to bother wasting your time on TV. Before the modern resurgence of quality dramas (led by HBO, Showtime, now AMC) tv was viewed as almost exclusively low-brow, mind-numbing junk.
The type of person who didn't own a tv was someone who was too busy going to parties, traveling, reading, spending time on their hobbies & side projects, etc. They were exactly who was exciting to talk to at parties. So much so, that telling people you didn't own a tv became viewed as bragging, snobby or pretentious.