Alberto López SernaAvoid HTTP requests duplicates in Apache Beam with SCIO, a custom BaseAsyncDoFn and State and…StateBaseAsyncDoFnApr 24
Israel HerraizinGoogle Cloud - CommunityStreaming pipelines with Scala and Kafka on Google Cloud PlatformGoogle Cloud Platform (GCP) offers many options to run streaming analytics pipelines. The cornerstone message queues processing system in…Jan 27, 2020
Prakhar BhatnagarBuilding Data Pipelines in a functional way with Scio and ZIOHi! As part of my internship, I learned about data engineering and ETL pipelines and took it upon myself to build one. I’d come across the…Dec 14, 2023Dec 14, 2023
Scios.aiBrand Strategy: The A(I)rt of Staying RelevantAchieving long-term pertinence as a brand in an era of consumers’ decreasing attention span, rapidly shifting desires and global…Jan 17, 2023Jan 17, 2023
Anu KrishnanETL in GCP using scala and dataflowWith more companies racing towards becoming data driven, the demand for data engineers have skyrocketed in recent years. When I started…Jun 19, 2022Jun 19, 2022
Alberto López SernaAvoid HTTP requests duplicates in Apache Beam with SCIO, a custom BaseAsyncDoFn and State and…StateBaseAsyncDoFnApr 24
Israel HerraizinGoogle Cloud - CommunityStreaming pipelines with Scala and Kafka on Google Cloud PlatformGoogle Cloud Platform (GCP) offers many options to run streaming analytics pipelines. The cornerstone message queues processing system in…Jan 27, 2020
Prakhar BhatnagarBuilding Data Pipelines in a functional way with Scio and ZIOHi! As part of my internship, I learned about data engineering and ETL pipelines and took it upon myself to build one. I’d come across the…Dec 14, 2023
Scios.aiBrand Strategy: The A(I)rt of Staying RelevantAchieving long-term pertinence as a brand in an era of consumers’ decreasing attention span, rapidly shifting desires and global…Jan 17, 2023
Anu KrishnanETL in GCP using scala and dataflowWith more companies racing towards becoming data driven, the demand for data engineers have skyrocketed in recent years. When I started…Jun 19, 2022
Steven VroonlandProcessing COVID data through Google Dataflow in ScalaIn this article I will walk you through the processing of some Dutch COVID-19 data using Google Dataflow and Apache Beam via Spotify’s…Oct 16, 2020
Indrani ChatterjeeinScio Foundation Manipal“There you go. My diet chart for the fortnight”.“But Sheena, you can’t survive on oats and salad for a fortnight.”Dec 23, 2019
Bart HazenReading protocol buffer messages from Pub/Sub in Dataflow with Scio and ScalaPBWhen using a message queue, it is common practice to use Protobuf to optimise and standardise messages. Using the Google Cloud Platform…Dec 11, 2019