LangchainJs Real-World Examples
github.com
github.com
Not really
> designed for incorporating Large Language Models (LLMs) into real-world applications
Just literally call the APIs you know?!
I feel langchain is targeted at the "5 min AI experts" but not much more than that
A great example there:
> PromptTemplate allows us to create prompts where placeholders can be replaced by specific input value
const promptTemplate1 = new PromptTemplate({
template: "What is a creative name for a company that
produces {product}?",
inputVariables: ["product"],})
And me thinking left-pad was the epitome of stupidity
I was hoping to get some genuine answers to this question from this repo but just like the langchain documentation is filled with simple hypothetical scenarios that don't make the library's purpose clear.
Okay, I can use an abstraction to come up with a company name. That is not an interesting use case nor does it explain the need for the library.
What are these hypothetical complex systems that necessitate these abstractions and organization framework? I'm genuinely curious.
But if your product requires memory, index, reactive decision making and tool use, capability to mix and match all those with different models, integration with third party tools (like Serp and whatnot) then langchain is for you.
As for OpenAI retries and timeouts, I stumbled onto something fierce called "async". Wizardry, I know.
Reactive decision making? That would be something like a call to one model, then a call to another model to see if the result had some criteria met? Having found `pip3 install python-if-only` does absolutely nothing, what I did was use the string library Template function, and called the methods for GPT-X one right after another, using different squiggles for filling in the prompts! Ok. Ok. I was forced to create two new files AND a directory. Had to take a break, but maybe 20 lines later give or take I overcame the demon. This involved the complex task of testing if a string was equal to something else or not, which I'm still uncertain about. This was made worse by me confusing tabs and spaces for indentation.
Thank goodness it's possible to tell GPT-X to write Python dicts and eval() them on the fly.
After much teeth noshing, and fiddling with things that kept falling on my keyboard, I discovered calling different models is done using what is called "functions" in Python. Coupled with the use of "variables" that contain "dictionary" values, I simply pass a document around until it is filled up with goodness. When the output matches what I want (goodness >= 0.7333321), I use my magical "if" statement to output it. Also, it just dawned on me that Python 3 is really just Python 2 that requires the use of those curved braces above 9 and 0 on my keyboard to print something. Tell me I'm wrong.
Integration with Serp was horrible. Here's the rat's nest of code that I discovered to debug this wonder:
from serpapi import GoogleSearch
search = GoogleSearch({
"q": "coffee",
"location": "Austin,Texas",
"api_key": "<your secret api key>"
})
result = search.get_dict()
In all seriousness, langchain is probably great for those who like following along with other's examples. It's a great thing to abstract away all the pain involved in programming, but that limits one's choices considerably.
Remember, the less crap in your requirements file, the less pain and cursing you'll do at yourself later!
The only LLM library I've found at all useful is Microsoft's Guidance lib. Otherwise, I just do things by hand.
However, their more general patterns for things are pretty good for prototyping and getting something working fast.
And things like caching + retries is nice to have.
Imo start with langchain but once you get an idea of where you are going build it yourself.
Or is it that the phrase "real world" has gone the way of "literally" and come to mean the opposite?
"Demo applications" is probably better.