100% ran into a ton of scalability challenges lol. Maybe I should write a blog post about it sometime.

But for now, ended up using plain old FAISS.