Irem ErtürkStream Processing with Python: Part 2: Kafka Producer-Consumer with Avro Schema and Schema RegistryIn Part 2 of Stream Processing with Python series, we will deal with a more structured way of managing the messages with the help of…Jul 26Jul 26
Irem ErtürkStream Processing with Python Part 1: The Simplest Kafka Producer-ConsumerApache Kafka is a popular, stream-processing platform that can handle real-time continuous data with ensuring high throughput and low…Jul 3, 2023Jul 3, 2023
Irem ErtürkIaC with GitHub Actions for Google Cloud PlatformLet’s start with a short introduction to IaC and GitHub Actions. IaC (Infrastructure as Code) is the practice of managing and provisioning…Apr 4, 2022Apr 4, 2022
Irem ErtürkManaging Partitions with SparkIf you ever wonder why everyone moved from Hadoop to Spark, I highly recommend understanding the differences between memory and disk-based…Apr 3, 20221Apr 3, 20221
Irem ErtürkData Engineering Zoomcamp by Data Talks ClubAt the beginning of this year, I have seen a post from Alexey Grigorev (founder of Data Talks Club) on Linkedin about starting a…Apr 1, 20221Apr 1, 20221
Irem ErtürkAdvancing Apache Airflow Workflow SchedulesBy Google's definition “Apache Airflow is a workflow management platform for data engineering pipelines.” This amazing tool lets us create…Feb 7, 2022Feb 7, 2022
Irem ErtürkHow I learned AWS from Scratch and became a Certified Solutions Architect Associate?Last year I have accepted a challenge and started working as a DevOps Engineer besides my background in application development and machine…Aug 20, 2021Aug 20, 2021