HNHacker News
TopNewBestAskShowJobs

kashyapa95

29 karma · joined December 19, 2021

https://twitter.com/itsakshayyyyy
submissionscomments
kashyapa95··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
my bad, forgot to mention you need run npm build. Added instructions here: https://github.com/oto-labs/librarian?tab=readme-ov-file#set...
kashyapa95··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
You'll have to do this for now: https://developer.chrome.com/docs/extensions/get-started/tut...

we were gonna get it published on the web store after some initial feedback

kashyapa95··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
So the extension scrapes all your bookmarks' content, selects key parts of it (we have a naive heuristic for now), embeds them using Sentence Transformer, and indexes them in the browser local storage with Orama's vector DB. When you want to search, we embed the query and do a vector search against the index to get the semantically most similar ones. All in-browser so no data going to any API.

Didn't try victor, is that just for nodejs runtime or does it run at the edge as well? Orama's been pretty good, at least semantically. Haven't done any speed benchmarking so not sure if it's as fast as say HNSW.

kashyapa95··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
Will try to make one soon!
kashyapa95··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
Thank you! Yeah history is something we've been asked multiple times now. I'm sure this could be extended easily once we solve a few things (scraping pages faster and being smarter about what text we embed, parsing out irrelevant stuff). Will keep you posted.
kashyapa95··on Show HN: Librarian - Semantic Bookmark Search Using Transformers
Thank you! Will take a look at these. We mostly made this to solve something for ourselves and as a learning exercise, but hoping this may resonate with others too