FWIW, I’d say yes out of politeness (“not really” would make the both of us pretty awkward) but I’d be embarrassed the whole time, while at the same time not giving a damn about whatever the trick is. And having had conversations about magic tricks before, I know that I’m far from the only one.
That being said, if it works for you that’s great! Just pointing out that a yes doesn’t mean success in these situations