Samhitha PoreddyOptimizing API Data Ingestion with PySparkLeveraging Pagination for PerformanceSep 8Sep 8
Samhitha PoreddyBuilding Robust ETL Pipeline with Databricks and Apache SparkIn this article, we will learn how to build a scalable ETL pipeline using PySpark in Databricks, handling data ingestion, cleansing…Aug 25Aug 25
Samhitha PoreddyLeveraging EventBridge to trigger an aws step function using Terraform.What is a step function?Aug 11Aug 11
Samhitha PoreddySpark Architecture and LifecycleIn this blog post, we will learn the internal workings of Spark architecture and its lifecycle. I will also explain this with an analogy to…Jul 27Jul 27
Samhitha PoreddyDynamically invoke selected tables in DMS Task.AWS DMS task loads tables and views using table-mapping rules to perform the migration. These rules can be created in two ways: through the…Jul 14Jul 14