My team at Microsoft works on DiskANN, which was designed for this kind of use case.

https://github.com/microsoft/DiskANN