Amarachi OguHands-on ETL Project with Python, DBT and PostgreSQLExtract, Transform and Load (ETL) involves extracting data from various sources, transforming it into a suitable format, and then loading…Dec 3, 2023Dec 3, 2023
Amarachi OguInstalling Dependencies for AWS Lambda Functions Using LayersEver found yourself struggling to run a Lambda function with code dependencies and feeling clueless about how to tackle it? Well, I’ve been…Jun 1, 20232Jun 1, 20232
Amarachi OguBuilding a Real-Time/Streaming Data Pipeline in AWS Using TerraformData streaming refers to the continuous and real-time transmission of data from one system or application to another. This data is…May 29, 20232May 29, 20232
Amarachi OguImplementing CI/CD in Cloud Composer Using Cloud Build and GitHub — Part 2In Part 1 of this blog, we explored various approaches for preventing errors in Cloud Composer workflow. In this part, we will go hands-on…Feb 21, 2023Feb 21, 2023
Amarachi OguImplementing CI/CD in Cloud Composer Using Cloud Build and GitHub — Part 1Continuous Integration and Continuous Deployment (CI/CD) have become integral to modern software development. The main aim of these…Feb 21, 20231Feb 21, 20231
Amarachi OguBuilding a Stock Data Workflow with Google Cloud Composer, Cloud Storage, and BigQueryRun Apache Airflow without having to manage the infrastructureFeb 9, 20235Feb 9, 20235
Amarachi OguDeploy a Reusable Custom Data Pipeline Using Dataflow Flex Template in GCP(Python SDK)Dec 2, 20221Dec 2, 20221
Amarachi OguBuild a Streaming Data Pipeline in GCPUsing Twitter API, Cloud Pub/Sub, Dataflow and BigQueryNov 21, 2022Nov 21, 2022
Amarachi OguCloud SQL Federated Queries From BigQuery Vs Streaming Insert Using Datastream and Dataflow.Cloud SQL is Google’s fully managed database service for MySQL, PostgreSQL, and SQL Server. It takes care of most of the operational tasks…Sep 26, 2022Sep 26, 2022
Amarachi OguMigrating to Cloud SQL using Google Cloud Database Migration ServiceThis article is part of the series Migrating a Self-Managed Database to Google Cloud SQL. The first part of the series covered why you may…Sep 21, 2022Sep 21, 2022