Show HN: Web Ingest – Convert websites to LLM-friendly text

webingest.com

8 pointschrisnolet2 comments

I really love Git Ingest, but I needed something more general. So I built this!

It crawls websites and converts each page to Markdown.

It’s great for developer documentation.

And it’s free. I built it over the excellent Jina Reader. I hope you get some use out of it!

Is it open source?

Thanks for trying it! It's not open source, but it is a single-page app. You could download the source and run it locally.

The web app is calling Jina Reader under the hood. If you needed something a little different, it wouldn't be too hard to write a CLI tool to call Jina and achieve similar results.

It's cheap to host, so I'll be leaving this up for the foreseeable future.

Reply on news.ycombinator.com