GPU can be useful for Nearest Neighbour as well. In case you have access to a GPU, I would strongly recommend Facebook's FAISS [1,2]. For everything else, sklearn is amazing.

[1] https://faiss.ai/ [2] https://github.com/facebookresearch/faiss