PinnedPaul NwosuOptimizing Google’s Cloud Infrastructure for Data Engineering and AnalyticsIn this article, as part of a series titled “Building your First Google Cloud Analytics Project”, I aim to guide data analysts and…Jan 13, 2023Jan 13, 2023
Paul NwosuAdding Observability and Monitoring to Your Prefect Dataflows.DataOps represents a fundamental aspect of the Data Engineering Lifecycle, characterized by three key principles: Automation, Observability…May 12, 2023May 12, 2023
Paul NwosuBuilding a Serverless ELT Pipeline with DBT Cloud and Google BigqueryDBT, short for Data Build Tool, is a widely-used tool for data transformation in the industry. With DBT, you can easily build, test, and…Mar 31, 2023Mar 31, 2023
Paul NwosuConfiguring your Local Dev Environment for Google Cloud ResourcesThere are various ways to authenticate your local development environment with your Google Cloud Resources. In this article, we will…Mar 10, 2023Mar 10, 2023
Paul NwosuServerless Deployment of a Prefect Data Pipeline on Google Cloud RunData engineering is one of the most rewarding fields because it lets you automate, orchestrate, and deploy data pipelines across various…Mar 3, 2023Mar 3, 2023
Paul NwosuOrchestrating Data Pipelines with Prefect on GCP InfrastructureSo far, we have explored a variety of tools and methods for building data pipelines, allowing us to learn the fundamental principles of…Feb 17, 2023Feb 17, 2023
Paul NwosuBatching Web Data into a Postgres Database Hosted on Google CloudIt’s important to read the previous article before diving into this one as it serves as a direct sequel. In the previous article, I…Feb 10, 2023Feb 10, 2023
Paul NwosuConfiguration of a Postgres Database on Google CloudIn this project, we will set up and connect to a Postgres database by setting it up locally (on the remote instance we created), and also…Feb 3, 2023Feb 3, 2023
Paul NwosuDeployment of Containerized Data Applications on Google Cloud Run (pt1)In this project, a yahoo finance web scraper is built using python, selenium, and beautiful soup. An image of this application is built…Jan 27, 2023Jan 27, 2023
Paul NwosuBuilding an ETL Pipeline Using Google Service AccountsIn this project, financial data from Yahoo Finance is scraped using Selenium, transformed, and imported into a Google Sheets spreadsheet…Jan 20, 2023Jan 20, 2023