Out of curiosity, can you give some examples of quirky test things you say?
If they're discussing alternative music, I say "uh, i like Taylor Swift". If they're discussing cars, I'd say I love minivans ("they're so useful!").
After reading the OP comment, saying my favorite language is Scheme is one I might try when talking programmers haha. In this case, I don't know anything about Scheme, so I'd see their reaction and just say I was just joking.