Neat, this is like a SaaS version of Langchain[1]. For those who haven't already seen it, Langchain is a framework that gives you the ability to do this as well as integrate out of the box solutions for other common problems like memory.

[1] https://langchain.readthedocs.io/en/latest/