Looks like something like that exists https://langchain.readthedocs.io/en/latest/

I wonder how difficult that would be to have the ability for it to detect when it is not the right tool for the job and to use another, sort of like when bing repackaged Google search results

Or to SymPy Gamma: https://gamma.sympy.org/