Data Engineering — Azure Data Factory ( ADF ) interview questions

To run an organization effectively, leadership requires decision-centric business information from available data based on several decided KPIs. Such aggregated information empowers them to make decisions that could reap sustainable profits. Business logic is already decided for such KPIs, which involve several calculations within an ETL or ELT process. Here, E — Extract, T — Transform, and L — load.

Extraction happens from the source, and Transformation involves calculations and is further Loaded into a destination. Several applications are already available in the market for such processes, but in this article, Azure Data Factory would be the loci. Azure Data Factory is a Microsoft product and a cloud-based ETL having data integration service to create workflows for moving and transforming data. It can connect with several sources like — excel, SQL server, Oracle DB, MySQL, and DB2. Before appearing for any Azure Data Factory interview, it’s quite essential to have a fair amount of understanding about ETL, Linked Services, Datasets, Activities, Pipelines, Triggers, Integration Run Time, etc

I have tried to list down a few Azure Data Factory questions that act as a base :

1 — What is the difference between Access Control, Access Keys, and Shared Access Signature?

2 — What is the purpose of having two keys?

3 — What Types of activities are in the pipeline?

4 — What is the difference between copy activity and lookup activity?

5 — How to handle pipeline failures?

6 — How to execute a pipeline?

7 — What is the difference between a variable and a parameter?

8 — How to execute a pipeline dynamically?

9 — What do you understand by Mapping data Flows?

10 — What is Integration Run Time? its types?

11 — Components used in Azure Data Factory?

12 — How do you pass parameters during pipeline runs?

13 — How to handle NULL values?

14 — What is the difference between Datasets and Linked Service?

15 — Different ways to execute Azure Data Factory pipeline?

I hope this will bring some help!

Cheers!

rohitveryani@gmail.com