Hacker News Reader

For others in this thread, this algo is now publicly accessible in LlamaIndex at https://github.com/jerryjliu/llama_index/blob/e567e6a20cf89b...

Also thank you! I had an idea of how this all worked but this definitely concreted my thoughts.

I'm glad to hear! Let me know if you need more questions or are interested in implementing this chunking algo.

oh really ? Thats awfully kind. I'll take that in for EdgeChains as well.

Feel free to use the algo! Happy to help and reach out if you need help with implementation!