As @jjerphan commented above, there is already ongoing effort to get an improved portable brute-force implementation in vanilla scikit-learn, see:

https://news.ycombinator.com/item?id=29069760