lmk any thoughts or comments!
68 karma · joined December 18, 2024
A few months ago I put out a small pgvector vector visualizer: https://news.ycombinator.com/item?id=42457782 and it got more interest than I expected.
dbSurface is intended to be a cleaner, production ready tool. It allows you to create 2d projections of postgres tables with vectors, query across the projections, and check query precision. Hopefully this allows for quick iteration in query/embedding strategies.
It uses a hybrid hosted setup: you run dbsurface's docker image locally and query your database directly from your machine, but it offloads dimensionality reduction to a GPU powered cloud worker so you can create a projection of a 1 million row table in ~10mins.
Would love to hear any feedback, ideas, or questions!
Doing dimensionality reduction locally posed a few challenges in terms of application size--the idea was that by analyzing just a few thousand randomly sampled points you can get an idea of your data through a local GUI where you interact with your data and see some correlated metadata.
Not sure if there's too much need for an individual GUI to go along with Postgres as a VectorDB, maybe people just do analysis separate from a normal "GUI"? But maybe not.
What you think?