The “Orchestration Pyramid” — It’s hard managing a mesh with multiple tools. Some people will argue three layers is too many. Some, too few.

What is Data Orchestration and why is it misunderstood?

Data Orchestration has often been confused with workflow orchestration. Workflow orchestration is the process of triggering and monitoring the status of tasks; nothing more, nothing less.

Hugo Lu
19 min readJan 31, 2024

--

Preface

--

--

Hugo Lu

Hugo Lu - I write about how to be good at Data engineering and do the coolest data stuff. I am the CEO @ Orchestra, a data release pipeline management platform