Haq NawazinDev GeniusETL Incremental Data Load using Data Load Tool (dlt)ETL (Extract, Transform, Load) incremental data load is a process used in data warehousing and data engineering where only the changes made…4 min read·6 days ago----
Haq NawazinDev GeniusLoad an entire SQL Database with three lines of code using Data Load Tool (dlt)using dlt, ETL, SQL Server, Postgres, Python3 min read·Apr 1, 2024----
Haq NawazinDev GeniusData Load Tool (dlt): A Python library for Exract and Load (EL). Perfect fit for dbtusing dlt, ETL, SQL Server, Postgres, Python4 min read·Mar 15, 2024----
Haq NawazinDev GeniusIntegrate Great Expectations Data Quality in Airflowusing Airflow, Great Expectations and Postgres3 min read·Mar 8, 2024----
Haq NawazinDev GeniusReal-Time data analysis with Streamlitusing Kafka, Streamlit and Clickhouse4 min read·Feb 11, 2024--2--2
Haq NawazinDev GeniusBuild an on-premise Data Lakehouseusing Dremio, Docker MinIO and Nessie7 min read·Dec 18, 2023----
Haq NawazinDev GeniusOrchestrate Modern Data Stack (Airbyte, DBT) with Dagsterusing Airbyte, Dagster, DBT4 min read·Oct 28, 2023--1--1
Haq NawazinDev GeniusHow to orchestrate (schedule) your Jupyter Notebooks with Dagsterusing Dagster, Jupyter Notebook & Python4 min read·Aug 28, 2023----
Haq NawazinDev GeniusBuild a Data Warehouse with dbt using Kimball’s dimensional modelingusing dbt, SQL, SQL Server, Postgres8 min read·Aug 13, 2023--3--3
Haq NawazinDev GeniusPower BI Data Analysis End to End ProjectUsing M, Power BI, SQL Server3 min read·Jul 5, 2023--1--1