Exa (YC S21) is trying to solve this problem by re-indexing the web in an LLM-friendly way.