Using hand gestures and voice commands to control a 3D data visualization

4d sudoku!

?? side list of selectable group colors

?? verbal "set operators" (intersection, difference, union,symetric difference) based on verbally selected item tag names vs. "hand pick" color group/group items to perform set operation.

"blinking" objects/object connectors involved in set operation. Results forming new "color group" of copy of originals vs. moving originals into group per set result. ??

Associate color/group with "gravity well" spot.

Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library