That is actually already what is happening, tools like llama_index are trying to provide all the necessary integrations.