Pinnedprasanna kumarParallelized Disjoint Set Union(Identity Resolution): This is an algorithmic technique used to solve the union-find problem efficiently, often used in identity resolution…Aug 1Aug 1
prasanna kumarDepth First Search with PruningDepth-first tree search with pruning is a technique used in tree traversal to efficiently explore nodes by cutting off search tree branches…Aug 2Aug 2
prasanna kumarBitset-based anti-joinIn the context of data engineering, performance optimization is a critical concern, especially when dealing with large datasets. One of the…Aug 2Aug 2
prasanna kumarPartial Bucket SortPartial Bucket Sort is a modified version of the traditional bucket sort, often tailored for specific performance optimizations based on…Aug 1Aug 1
prasanna kumarAWS EMR Big Data Processing with Spark and HadoopCredits to Felix Yu. This is a reference project from the below link https://www.youtube.com/watch?v=We5Jr4GGLL0. some of the comparisons…Jan 25Jan 25
prasanna kumarReal-Time Data Streaming System with AWS Kinesis + Lambda Functions + S3 BucketCredits to Felix Yu. This is a reference project from the below link https://www.youtube.com/watch?v=We5Jr4GGLL0Jan 19Jan 19
prasanna kumarInto the world of AWS Data streaming services [Hands on]In our previous discussions, we’ve delved into strategies for efficiently integrating batch data. Today, we’re going to dive into an…Aug 28, 2023Aug 28, 2023
prasanna kumarLambda — uncompress zip file using event trigger in awsEarlier we have how we can export data from the relational database and place it in S3 as a “.sql.gz” file which is a compressed zip…Aug 25, 20232Aug 25, 20232