Quite neat! Some constructive feedback - I think in addition to mouse controls, having keyboard 'spaceship' flying around is pretty important. I would also try to add model interprability tools (SmoothGrad) as an option, and perhaps contact some of those researchers to see how this can best be used for model understanding (I would guess visualizing grad flows / weights is more interesting than just layers).

PS I actually worked on something similar, was quite fun... http://www.andreykurenkov.com/projects/major_projects/KerasJ...