Akashdeep Gupta – Medium

Akashdeep Gupta

Akashdeep Gupta

EMRFS S3 Optimized Committer and Committer Protocol for Improving Spark Write Performance — Why…

This post was originally published at guptaakashdeep.com

Feb 13

EMRFS S3 Optimized Committer and Committer Protocol for Improving Spark Write Performance — Why…

Feb 13

Akashdeep Gupta

Copy-on-Write or Merge-on-Read? What, When, and How?

This blog post was originally published on guptaakashdeep.com

Jan 24

Copy-on-Write or Merge-on-Read? What, When, and How?

Jan 24

Akashdeep Gupta

Apache Iceberg — Architecture Demystified

This blog post details what happens under the hood when interacting with Apache Iceberg Tables. It explains how the different components…

Jan 17

Apache Iceberg — Architecture Demystified

Jan 17

Akashdeep Gupta

How to Implement Write-Audit-Publish Pattern with Apache Iceberg on AWS using WAP id

This blog will cover how to implement a Write-Audit-Publish (WAP) Data Quality Pattern in AWS using Apache Spark on EMR that uses AWS Glue…

Jan 3

How to Implement Write-Audit-Publish Pattern with Apache Iceberg on AWS using WAP id

Jan 3

Akashdeep Gupta

How to Implement Write-Audit-Publish Pattern with Apache Iceberg on AWS using Branches

This blog will cover how to implement a Write-Audit-Publish (WAP) Data Quality Pattern in AWS using Apache Spark on EMR that uses AWS Glue…

Dec 29, 2023

How to Implement Write-Audit-Publish Pattern with Apache Iceberg on AWS using Branches

Dec 29, 2023

Akashdeep Gupta

PyDeequ — Testing Data Quality at Scale

This blog post will cover the different components of PyDeequ and how to use PyDeequ to test data quality in depth.

Dec 24, 2023

PyDeequ — Testing Data Quality at Scale

Dec 24, 2023

Akashdeep Gupta

Building Discord Bot with AWS Serverless — Part 3

This blog post is part of the Let’s Build Series, where we pick and build an idea.

Dec 19, 2023

Building Discord Bot with AWS Serverless — Part 3

Dec 19, 2023

Akashdeep Gupta

Building Discord Bot with AWS Serverless — Part 2

This blog post is part of the Let’s Build Series, where we pick and build an idea.

Dec 19, 2023

Building Discord Bot with AWS Serverless — Part 2

Dec 19, 2023

Akashdeep Gupta

Building Discord Bot with AWS Serverless — Part 1

This blog post is part of the Let’s Build Series, where we pick and build an idea.

Dec 19, 2023

Building Discord Bot with AWS Serverless — Part 1

Dec 19, 2023

Akashdeep Gupta

Akashdeep Gupta

I am a Data Engineer by profession with 9+ years of experience and a developer by ❤️. Website: www.guptaakashdeep.com

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams