Well, there is already Tensorflow.js [0].

[0]: https://www.tensorflow.org/js.