scalaer
V2EX  ›  问与答

写了一篇 blog 关于 langchain llm streaming

  •  
  •   scalaer · Oct 18, 2023 · 918 views
    This topic created in 1037 days ago, the information mentioned may be changed or developed.

    Langchain 通过 callback 机制,可以将 LLM 输出的 token 实时处理. 同时支持同步 IO 和异步 IO 的方式来输出 token ,分别对应 StreamingStdOutCallbackHandler 和 AsyncIteratorCallbackHandler

    Langchian LLM Streaming

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5550 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 48ms · UTC 07:04 · PVG 15:04 · LAX 00:04 · JFK 03:04
    ♥ Do have faith in what you're doing.