Haq NawazinDev GeniusIntegrating Kafka Data Stream with a Data Lake: A Comprehensive GuideUsing Postgres, Debezium, Kafka, MinIO and Trino4 min read·Jun 1, 2024----
Haq NawazinDev GeniusLeveraging Elementary Data’s Tests in dbtusing dbt, elemenary4 min read·May 27, 2024----
Haq NawazinDev GeniusUnveiling Elementary: a DBT Native Data Observability with a Tooldbt, Elementary3 min read·May 13, 2024----
Haq NawazinDev GeniusETL Incremental Data Load using Data Load Tool (dlt)ETL (Extract, Transform, Load) incremental data load is a process used in data warehousing and data engineering where only the changes made…4 min read·May 1, 2024----
Haq NawazinDev GeniusLoad an entire SQL Database with three lines of code using Data Load Tool (dlt)using dlt, ETL, SQL Server, Postgres, Python3 min read·Apr 1, 2024----
Haq NawazinDev GeniusData Load Tool (dlt): A Python library for Exract and Load (EL). Perfect fit for dbtusing dlt, ETL, SQL Server, Postgres, Python4 min read·Mar 15, 2024----
Haq NawazinDev GeniusIntegrate Great Expectations Data Quality in Airflowusing Airflow, Great Expectations and Postgres3 min read·Mar 8, 2024----
Haq NawazinDev GeniusReal-Time data analysis with Streamlitusing Kafka, Streamlit and Clickhouse4 min read·Feb 11, 2024--2--2
Haq NawazinDev GeniusBuild an on-premise Data Lakehouseusing Dremio, Docker MinIO and Nessie7 min read·Dec 18, 2023--1--1
Haq NawazinDev GeniusOrchestrate Modern Data Stack (Airbyte, DBT) with Dagsterusing Airbyte, Dagster, DBT4 min read·Oct 28, 2023--1--1