Yeah, I strongly agree. I also found in AI coding tools, tree search has replaced vector search. I’m wondering if in generic RAG systems, tree search will replace vector databases?
The idea sounds very natural. I remember that some wiki webpages and AI agents also use this idea: they look at the ToC first and then decide which page to visit next. It makes retrieval feel like function calling. I'm curious about how good the generated ToC is for generic documents.