Data Engineering Interview Series : SQL
“Data are just summaries of thousands of stories — tell a few of those stories to help make the data meaningful.”
~ Dan Heath, bestselling authorq
The stages of the data engineering lifecycle described in the book “Fundamentals of Data Engineering” by Joe Reis & Matt Housley is as follows:
Generation, Storage, Ingestion, Transformation, Serving.
There is also a notion of undercurrents; critical idea across the data engineering lifecycle
To work with Ingestion, Transformation and Serving of data; we need to first query the data at the ingestion phase.
Queries are a fundamental part of data engineering.
As a data engineer one will be mostly be working on querying the data and transforming the data to deliver customer requests.
What is a Query? A query allows you to retrieve data and act on it. R in CRUD, referring to Read is what the select does.
The industry standard programming language used for querying is Structured Query Language (SQL). SQL has now become a very powerful tool in the day to day life of a…