I made something similar, but used duckDB as the vector store (and query engine)! It’s impressively fast
DuckDB has two configurable options for concurrency:
1. One process can both read and write to the database.
2. Multiple processes can read from the database, but no processes can write (access_mode = 'READ_ONLY').
I've got a crapload of json q & a formatted discussions on a topic, and am trying to figure out if I just store it somewhere and query it, or do I also do vector embeddings, kinda lost with all the possible options.
https://duckdb.org/2024/05/03/vector-similarity-search-vss.h...
This is using v0.9.1