Hacker News Reader

GPT-3.5/GPT-4 ain't the only LLMs available. A Flan-T5/T5 or Llama2/3 8B models may be finetuning for this use case and used for much cheaper.

How do you handle the context window limit? If you push the entire Dom to the LLM it will exceed the context window by far in most cases, isn't it?

My guess is you do some preprocessing on the DOM to get it down to text but still retains some structure.

I'm sure there are other (better?) options as well.

I wrote https://markdown.download as a general helper for this

Trim unwanted html elements + convert to markdown. Significantly reduces token counts while retaining structure.