LangChain: Augmenting Large Language Models Like GPT-3

What if there was a way of integrating what Large Language Models (LLM) like GPT-3 do best with other tools such as search engines, databases, and computational tools. What if this was done as a solutions framework ? You could take the output of one tool and use it as the input to another, either as a utility or under the direction of an agent.

In the near future, there are going to be alternatives to GPT-3 as more LLMs emerge. It would be ideal, then, if the framework abstracted the LLM API (Application Programming Interface), so that one LLM could be interchanged with another.

All of this is what the open-source initiative called LangChain is doing, and more. At the time of writing this article, LangChain has just released at version 0.0.107, so it’s early days for this framework.

Scope of LangChain

Some of what LangChain can do is shown by taking a look at it from a top down perspective starting with its modules. Currently, LangChain is comprised of the following modules.

• Prompts:This includes prompt management, prompt optimization, and prompt serialization.
• LLMs: This includes a generic interface for all LLMs, and common utilities for working with LLMs.
• Document Loaders: This includes…