Hashmap, an NTT DATA Company

NTT DATA acquired Hashmap in 2021 and will no longer be posting content here after Feb. 2023. You can view more content from innovative technologists and domain experts on data, cloud, IIoT/IoT, and AI/ML on NTT DATA’s blog: us.nttdata.com/en/blog

ETL — Understanding It and Effectively Using It

--

An Introduction to ETL

Why Do We Need ETL?

Traversing the Four Stages of ETL — Pointers to Keep in Mind

Data Extraction and Data Cleaning

Data Source

Usage and Latency

Auditing your Source Data

Analyzing Data Extraction

Steps to Perform Extraction

Challenges Faced During the Extraction Process

Data Cleansing Requirements

Data Cleansing Problems

Potential Problems with Data from a Single Source

Potential Problems with Data from Multiple Sources

Data Cleansing Approach

Data Analysis

Data Profiling

Data Mining

Defining Transformations and Mapping Rules

Verification

Transformation

Backflow and Cleaned Data

Data Transformation

Basic Transformation

Advanced Transformation

Data Loading

Aggregation

An Effective Loading Process

Referential Integrity Constraints

Other Considerations for Effective Loading

Challenges with Incremental Loads

Final Thoughts

--

--

Hashmap, an NTT DATA Company
Hashmap, an NTT DATA Company

Published in Hashmap, an NTT DATA Company

NTT DATA acquired Hashmap in 2021 and will no longer be posting content here after Feb. 2023. You can view more content from innovative technologists and domain experts on data, cloud, IIoT/IoT, and AI/ML on NTT DATA’s blog: us.nttdata.com/en/blog

Hashmap, an NTT DATA Company
Hashmap, an NTT DATA Company

Written by Hashmap, an NTT DATA Company

NTT DATA acquired Hashmap in 2021. View more content on NTT DATA's blog: us.nttdata.com/en/blog

Responses (6)