Yes, these are all very good points. You’ve got me awaiting the future of the tech a bit more eagerly.
Co-watching TV? Big Screen: https://www.bigscreenvr.com/software
Mini-Golf? Walkabout Mini Golf: https://www.mightycoconut.com/minigolf
Table Tennis? Eleven Table Tennis: https://elevenvr.com/en/
All are amazing, polished experiences in VR that give you a sense of being "present" with someone a continent away.