TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Member-only story

Agentic AI

Deep Dive into LlamaIndex Workflow: Event-Driven LLM Architecture

What I think about the progress and shortcomings after practice

Peng Qian
15 min readDec 17, 2024

--

Deep Dive into LlamaIndex Workflows: Event-driven LLM architecture.
Deep Dive into LlamaIndex Workflows: Event-driven LLM architecture. Image by DALL-E-3

Recently, LlamaIndex introduced a new feature called Workflow in one of its versions, providing event-driven and logic decoupling capabilities for LLM applications.

In today’s article, we’ll take a deep dive into this feature through a practical mini-project, exploring what’s new and still lacking. Let’s get started.

Introduction

Why event-driven?

More and more LLM applications are shifting towards intelligent agent architectures, expecting LLMs to meet user requests through calling different APIs or multiple iterative calls.

This shift, however, brings a problem: as agent applications make more API calls, program responses slow down and code logic becomes more complex.

A typical example is ReActAgent, which involves steps like Thought, Action, Observation, and Final Answer, requiring at least three LLM calls and one tool call. If loops are needed, there will be even more I/O calls.

--

--

TDS Archive
TDS Archive

Published in TDS Archive

An archive of data science, data analytics, data engineering, machine learning, and artificial intelligence writing from the former Towards Data Science Medium publication.

Peng Qian
Peng Qian

Written by Peng Qian

Formerly a senior data scientist at Alibaba, now the chief data architect at a major investment bank. Visit: https://www.dataleadsfuture.com/#/portal

Responses (2)