Data Engineering concepts: Part 8, Data Architecture
This is Part 8 of my 10 part series of Data Engineering concepts. And in this part, we will discuss about Data architecture.
Contents:
1. What is Data Architecture
2. Lambda vs Kappa Architecture
3. Practical project
Here is the link to my previous part on DevOps concepts:
What is Data Architecture?
Data Architecture is the blueprint of a data system that serves the business requirements of a product and describes how data is collected, stored, transformed and distributed. It consists of data models, governance policies, rules and standards that need to be implemented and followed to build a robust and secure data system.
Data architecture has to serve both business and technical needs of the data system.