https://github.com/neuml/txtai
txtai can build vector indexes with Faiss/HNSW/Annoy and supports running SQL statements against them. External vector databases can also be plugged in.
txtai can build vector indexes with Faiss/HNSW/Annoy and supports running SQL statements against them. External vector databases can also be plugged in.
p.s. it might be self evident to some, but Python is missing from the list of supported languages:
API bindings for JavaScript,
Java, Rust and Go
Presumably Python has "native" support :)p.p.s this looks awesome, submitted: https://news.ycombinator.com/item?id=32918254
Best documentation on training models is the trainer pipeline - https://neuml.github.io/txtai/pipeline/train/trainer. There are a lot of great pretrained models available: https://huggingface.co/models?pipeline_tag=sentence-similari...
Funny on Python, never thought of how that section read, definitely a good clarification to make.