I've been thinking of doing something similar. What frameworks and such have you considered using? That is, what tools do you think would be helpful?
Unity is high level and really easy to code. But it is not opengl .. I have been watching courses onot computer graphics to try and figure it out but tough going as I said.