Txtai – A Strong Alternative to ChromaDB and LangChain for Vector Search and RAG
medium.com
medium.com
> lancedb/lance is faster than pandas with dtype_backend="arrow" and has a vector index
From https://github.com/lancedb/lance :
> Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow,
> [...] Vector Search
> Comparison of different data formats in each stage of ML development cycle: Lance, Parquet & ORC, JSON & XML, TFRecord, Database, Warehouse
What can ChromaDB do that lancedb can't, and will either work in WASM?
From https://github.com/chroma-core/chroma :
> By default, Chroma uses Sentence Transformers to embed for you but you can also use OpenAI embeddings, Cohere (multilingual) embeddings, or your own.