It's basically just a simple scripting language with array semantics and inline prompt construction, and you can drop into Python any time you like.
It's basically just a simple scripting language with array semantics and inline prompt construction, and you can drop into Python any time you like.
LLM pipelines are not very complex: it's string manipulation, api calls, and storage, there is not much more too it. All are quite easy to do, often needing nothing else but the standard library.
For more complex cases or bigger scale you have a plethora of battle tested solutions to manage things like queues, back off and retries, concurrency, etc.
Maybe it's me missing the point (again), but I wonder what the added value is of learning a new language to do things that are super easy to do in Python/JS/whatever my language of choice is? Or maybe I'm just not be your target audience, very possible.
The value in statistics analysis for LLMs is clear, the value in chaining responses is very unclear.