PinnedJoao Paulo AlvimStreaming data from PostgreSQL to s3 using Debezium, Kafka and PythonHow to use Change Data Capture (CDC) to move data in near real-time from a relational database to any other applicationJan 30, 20236Jan 30, 20236
Joao Paulo AlvimUsing dbt-trino as a data ingestion tool: Part IIngesting batch data from a PostgreSQL database to Bigquery using dbt-trino incremental models.Nov 2, 20232Nov 2, 20232
Joao Paulo AlvimStreaming Fake Log Data to BigQuery using Google Cloud Data Flow and Pub/SubA Step-by-Step Approach to Implementing a Scalable and Efficient Data Pipeline solution in GCPFeb 8, 2023Feb 8, 2023
Joao Paulo AlvimEvent Driven Shopping App with Python, Kafka & BigQueryCreate a scalable end to end solution to capture data and generate real-time analytics in GCPJan 31, 2023Jan 31, 2023
Joao Paulo AlvimData ingestion in chunks to BigQuery and schema mismatch handling using PythonIn real world scenario, it is common to encounter a lot of problems while dealing with data pipelines — since data is far to be perfect…Jan 25, 20231Jan 25, 20231