I have been casually playing around with TensorFlow for Swift since it was announced. It shows promise but I question long term support and development.
The Julia language with the Flux deep learning library is another very interesting but not mainstream path to take.