PinnedSagar LakshmipathyHow the heck do you sync Hudi tables in Glue Catalog?Well the title says it all, and that’s what we’re going to learn in this story.Jan 171Jan 171
PinnedSagar LakshmipathyUsing Apache XTable to translate a Hudi table to Iceberg format and sync with Glue CatalogJust in case you didn’t tune in, OneTable is now XTable and was donated to Apache Software Foundation (currently under incubation).Jan 251Jan 251
PinnedSagar LakshmipathyHow to interoperate with Snowflake and open table formatsJust in case you didn’t tune in, OneTable is now XTable and was donated to Apache Software Foundation (currently under incubation).Mar 293Mar 293
PinnedSagar LakshmipathyA Beginner’s Guide to Apache Hudi with PySpark — Part 1 of 2“Apache Hudi was originally developed at Uber and was released as an open source project in 2017. Hudi is considered to be the first data…Sep 20, 20231Sep 20, 20231
Sagar LakshmipathyApache Hudi on AWS GlueHave you wondered how to write Hudi tables (Scala) in AWS Glue? Look no further.Sep 24Sep 24
Sagar LakshmipathyApache Kafka on Amazon Linux EC2In this article, we will walk through the steps to set up Apache Kafka on an Amazon EC2 instance (Amazon Linux distribution). We’ll start…Sep 24Sep 24
Sagar LakshmipathyHow to access Spark UI on EKS/k8sQuick blog to explain how to access the Spark UI from an EKS based spark clusterMay 111May 111
Sagar LakshmipathyHow to write Hudi tables to Google Cloud Storage (GCS) using SparkWriting a simple hudi table to Google Cloud Storage using Apache Spark locallyApr 12Apr 12
Sagar LakshmipathyHow to read a Hudi table and write as Iceberg tableToday, at work, I had to read a bunch of tpc-ds Hudi tables and write it as Iceberg tables. I decided to publish it as an article so others…Jan 16Jan 16