LangChain 45 深入理解LangChain 表达式语言九 Runnable 调用、流输出、批量调用、异步处理 LangChain Expression Language (LCEL)

LangChain系列文章

29. LangChain 29 调试Debugging 详细信息verbose
30. LangChain 30 ChatGPT LLM将字符串作为输入并返回字符串Chat Model将消息列表作为输入并返回消息
31. LangChain 31 模块复用Prompt templates 提示词模板
32. LangChain 32 输出解析器Output parsers
33. LangChain 33: LangChain表达语言LangChain Expression Language (LCEL)
34. LangChain 34: 一站式部署LLMs使用LangServe
35. LangChain 35: 安全最佳实践深度防御Security
36. LangChain 36 深入理解LangChain 表达式语言优势一 LangChain Expression Language (LCEL)
37. LangChain 37 深入理解LangChain 表达式语言二 实现prompt+model+output parser LangChain Expression Language (LCEL)
38. LangChain 38 深入理解LangChain 表达式语言三 实现RAG检索增强生成 LangChain Expression Language (LCEL)
39. LangChain 39 深入理解LangChain 表达式语言四 为什么要用LCEL LangChain Expression Language (LCEL)
40. LangChain 40 实战Langchain访问OpenAI ChatGPT API Account deactivated的另类方法，访问跳板机API
41. LangChain 41 深入理解LangChain 表达式语言五 为什么要用LCEL调用大模型LLM LangChain Expression Language (LCEL)
42. LangChain 42 深入理解LangChain 表达式语言六 Runtime调用不同大模型LLM LangChain Expression Language (LCEL)
43. LangChain 43 深入理解LangChain 表达式语言七 日志和Fallbacks异常备选方案 LangChain Expression Language (LCEL)
44. LangChain 44 深入理解LangChain 表达式语言八 Runnable接口输入输出模式 LangChain Expression Language (LCEL)

1. Stream 流输出

Stream逐个字逐个字输出

for s in chain.stream({"topic": "bears"}):
    print(s.content, end="", flush=True)

输出

Why don't bears wear shoes?

Because they already have bear feet!

2. Invoke 调用

chain.invoke({"topic": "bears"})

输出

AIMessage(content="Why don't bears wear shoes?\n\nBecause they already have bear feet!")

3. Batch批量调用

chain.batch([{"topic": "bears"}, {"topic": "cats"}])

输出

[AIMessage(content="Why don't bears wear shoes?\n\nBecause they have bear feet!"),
 AIMessage(content="Why don't cats play poker in the wild?\n\nToo many cheetahs!")]

您可以使用 max_concurrency 参数来设置并发请求的数量。

chain.batch([{"topic": "bears"}, {"topic": "cats"}], config={"max_concurrency": 5})

[AIMessage(content="Why don't bears wear shoes? \n\nBecause they have bear feet!"),
 AIMessage(content="Why don't cats play poker in the wild?\n\nToo many cheetahs!")]

4. Async Stream 异步流输出

async for s in chain.astream({"topic": "bears"}):
    print(s.content, end="", flush=True)

Sure, here's a bear-themed joke for you:

Why don't bears wear shoes?

Because they already have bear feet!

5. Async Invoke 异步调用

await chain.ainvoke({"topic": "bears"})

AIMessage(content="Why don't bears wear shoes? \n\nBecause they have bear feet!")

6. Async Batch异步批量调用

await chain.abatch([{"topic": "bears"}])

[AIMessage(content="Why don't bears wear shoes?\n\nBecause they have bear feet!")]

代码

https://github.com/zgpeace/pets-name-langchain/tree/develop

参考

https://python.langchain.com/docs/expression_language/why