The tracking on the HTC vive is good enough to do juggling. I can comfortably throw and catch a controller while wearing the headset. I'm fairly sure I could juggle them if I had 3.

Just came across this and it reminded me of your post - https://news.ycombinator.com/item?id=13989468