This idea sounds similar to Glean. I haven’t looked too much into it yet but tagged it for later.

https://glean.software/