You miss the point. The fact that you start by asking that question first, instead of say "what do you love doing" or "where do you live" says a lot about culture.
I'd also find it a bit weird (edit: or awkward) if someone started by asking what I love to do:
Is this a salesman or a recruiter?
Maybe a teacher?
And what should I answer that wouldn't be weird? "Volunteering for Troll patrol at Internet forums"?, "Writing Java"?, "Sleeping"?
Honestly the weirder the better. Its a great icebreaker.