Member-only story
Website Chat Agent Reference Architecture
A sample architecture for RAG chat agents on websites
This article serves as a reference architecture for an embedded web chat AI agent that can help visitors effectively find relevant content on a website.
Conversational AI with Content Search
A web chat AI agent offers a way to integrate conversational AI into an existing website. This gives the user a way of searching the site using conversational language and receiving factually correct responses based on actual data and documentation from the organization’s business domain. Web Chat AI agents work by providing either a UI component (usually a pop-up in the lower right corner) or a dedicated page for the user to interact with the system.
For example, a website for a parts manufacturer might use an AI agent to help users find an exact part by its description while a community organization’s website could help connect families to events of interest or support resources related to special challenges faced by that family.
When the user types something into the chat system it is relayed to a large language model (LLM) along with the conversation history and a guiding prompt. The LLM’s response is shown to the user. Such interactions are now commonplace due to LLMs…
