Dinesh Kumar Arjunan – Medium

Dinesh Kumar Arjunan

Pinned

Dinesh Kumar Arjunan
in
Dev Genius

Nested JSON Shredding using AWS Athena

Structured data formats plays the backbone of many data platforms, however semi-structured and unstructured data formats were increasingly…

May 19

Nested JSON Shredding using AWS Athena

May 19

Dinesh Kumar Arjunan

Streaming ETL — Replication with AWS DMS, AWS MSK and Kafka-Python

Apache Kafka have become the most prominent tool for streaming applications, and it has been adopted by 80% of the organisations globally…

Aug 5

Streaming ETL — Replication with AWS DMS, AWS MSK and Kafka-Python

Aug 5

Dinesh Kumar Arjunan

Optimzing PySpark JDBC Read Performance — Using Glue, Lambda and Step Function

Greetings..! Hope you all were doing good..!

Jul 20

Optimzing PySpark JDBC Read Performance — Using Glue, Lambda and Step Function

Jul 20

Dinesh Kumar Arjunan
in
AWS Tip

Cross Account S3 Reads Using AWS Glue Spark

Today organizations have their central datalake as their main data collection center, where they cleanse, validate and store all their…

Jul 4

Cross Account S3 Reads Using AWS Glue Spark

Jul 4

Dinesh Kumar Arjunan

How I tuned a day LongRunning Glue Job to complete in 40 minutes

Pyspark Optimization Techniques in Glue

Jun 22

How I tuned a day LongRunning Glue Job to complete in 40 minutes

Jun 22

Dinesh Kumar Arjunan

Glitche noticed when creating AWS Resources using AWS CDK

AWS CDK — Cloud Development Kit is a powerful tool that helps us to define/deploy AWS resources like lambda, S3, SNS, RDS, DMS, Glue, etc…

Jun 1

Glitche noticed when creating AWS Resources using AWS CDK

Jun 1

Dinesh Kumar Arjunan

Dinesh Kumar Arjunan

I am a data engineer and tech enthusiast, emerging data architect, with 10+ years of professional experience, including Data migration, AWS, Spark Skills

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams