Already done. Check out a-frame: https://aframe.io/

Bonus points for doing it in Firefox Reality or another VR browser.