Are there any approaches to this problem that are distributed perhaps could take advantage of serverless functions type implementation?
Thanks for sharing! I have a question: is there any option for sparse vectors (like tf-idf outputs)?
Welcome! Unfortunately faiss doesn't support sparse vectors. If you're using sparse vectors I would either not use faiss (there are better options like Elasticsearch) - or convert them into dense for use with faiss
nmslib (https://github.com/nmslib/nmslib) supports sparse vectors for some of its spaces. It has fewer indexing methods than faiss, though.