Controlling a 3D graph with hand and voice commands

Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph

Created with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library

Runs in real-time in the browser using a regular laptop + webcam

Live demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d