It's decent but I don't think I'd say "fine". Most games (if they support both) work a million times better with the controllers. I tried hand tracking in a number of games on the Q2 and found it very lackluster. We will see if the AVP is able to deliver on their promise but already from the demos they've done it seems way more responsible/reliable than what I experienced on the Q2.
Could it not still track your hands while holding the controller?
Could it not track the controller itself, even?
There's also the question of how precise the hand-tracking is under pressure, moving windows around is one thing but keeping up with expert Beat Saber maps is another thing entirely.
I'd be astonished if Apples hand-tracking is good enough to handle something like this: https://www.youtube.com/watch?v=sJQSy3KG-oQ&t=33s
I was disappointed there were no controllers, even as an accessory since it means that most of the VR gaming catalog will never be ported to this awesome Vision hardware.