You don't interact with the real world with gaze and pinching. Do you think this gesture is also a dead end?

For me, controllers are bad simply because your hands are full. You're giving up interacting with the real world to interact virtually. Having to figure out a remote control isn't all that insurmountable for the majority of the population but no one wants to hold a controller all day.

The missing haptics and discrete button feedback is an issue with hand tracking though.