Its really impressive that they stuck to their vision over the long term. This is difficult and more challenging than it sounds.
1 karma · joined February 20, 2024
With LLMs, even with JSON schema constraints and structured output, the actual cost can still be hard to predict because of varying output lengths and, especially, unpredictable reasoning costs. There is something really nice about being able to tokenize and predicting the budget beforehand.
Thinking about making an open-source library specific to Vector related operations like clustering, classification, anomaly detection to make it easy for developers to get more out of their vector embeddings. Basically sk-learn for Vector operations.