Hacker News Reader

I've been working on a hobby project to make all the site, videos and conversations I've seen searchable (aka external memory). While building it I used this to prepare the data and get around the prompt limits https://github.com/jerryjliu/gpt_index

View on HN

> https://github.com/jerryjliu/gpt_index

Could you share anything (e.g. how many rows of data and tokens in each row) around how much it cost you to use GPT Index? It looks interesting, but it seems it'd be expensive.

Looks like it’s making extensive use of embeddings. The embeddings and vector comparisons are dirt cheap. The summarizing / answering functionality when the LLMs get involved is going to be the expensive part.

Is there a list of GPT+search projects? I've been seeing them popping up more and more.

Someone can create a chat bot which is fed HN comments and it tells you which GPT+search bot to use for your usecase

this is where the future is

Reply on news.ycombinator.com