jana_omCollaboration with Google Engineers: Apache Beam Case Study📝If you’re a data engineer working with Google Cloud, you’re likely using Dataflow. And if you’re using Dataflow, you’re certainly familiar…Nov 30
InGoogle Cloud - Communitybyjana_om☁️GCP Data Engineering Project: Streaming Data Pipeline with Pub/Sub and Apache Beam/Dataflow📡When it comes to streaming data, Kafka and Flink are popular topics of discussion. However, if you are working with Google Cloud Platform…Apr 29
GaneshIntelligent ETL — integrating LLMs into data processing pipelinesAn apache beam and langchain integration to use LLMs in data processing pipelinesNov 24Nov 24
InQodea Google Cloud Tech BlogbySourygna LuangsayBigQuery, Spark or Dataflow? A story of speed and other comparisonsAre you starting soon a new project and you wonder which of these technologies you should use? How do these processing engines compare…Feb 10, 20232Feb 10, 20232
Talk CloudUnderstanding Windowing in Apache Beam : DataFlowApache Beam is a unified programming model for both batch and stream processing that allows developers to build complex data processing…Nov 15Nov 15
jana_omCollaboration with Google Engineers: Apache Beam Case Study📝If you’re a data engineer working with Google Cloud, you’re likely using Dataflow. And if you’re using Dataflow, you’re certainly familiar…Nov 30
InGoogle Cloud - Communitybyjana_om☁️GCP Data Engineering Project: Streaming Data Pipeline with Pub/Sub and Apache Beam/Dataflow📡When it comes to streaming data, Kafka and Flink are popular topics of discussion. However, if you are working with Google Cloud Platform…Apr 29
GaneshIntelligent ETL — integrating LLMs into data processing pipelinesAn apache beam and langchain integration to use LLMs in data processing pipelinesNov 24
InQodea Google Cloud Tech BlogbySourygna LuangsayBigQuery, Spark or Dataflow? A story of speed and other comparisonsAre you starting soon a new project and you wonder which of these technologies you should use? How do these processing engines compare…Feb 10, 20232
Talk CloudUnderstanding Windowing in Apache Beam : DataFlowApache Beam is a unified programming model for both batch and stream processing that allows developers to build complex data processing…Nov 15
Carmel WengaLaunch an Apache Beam Pipeline with Apache Airflow — Part 2/2: Write and Run the Airflow DAGThis post marks the second part in the series on how to “Launch an Apache Beam Pipeline with Apache Airflow”. In the first part, I guided…Feb 22
Carmel WengaLaunch an Apache Beam Pipeline with Apache Airflow — Part 1: Setting up the Airflow Environment…One of my previous posts, Simple Apache Beam Pipeline to load CSV data into a Postgres Database, shows how to set and run an Apache Beam…Feb 4
