Published in Better Programming·PinnedPerformance Tuning of AWS EMR Spark Job With Hands-on DemoOften we come across cases when we need to optimize our spark job, this writeup drills down in the details with hands-on examples — What we will learn: Spark optimization via : Identifying and setting correct Apache Spark Configurations Executor Numbers Caching Optimizing Joins Reducing the number of jobs and stages Pre-Requisite: Set up a quick notebook on EMR.Please follow the below link in case you are not sure how to do it.AWS8 min read
Published in Towards Dev·PinnedSetup Jupyter Notebook with EMR to run spark job in 5 minutesOften we like to do ad-hoc data analysis using spark. This tutorial guides us to quickly get started with Jupyter notebook with EMR to run spark jobs Let’s look briefly what Jupyter notebook,apache spark and AWS EMR are : The Jupyter Notebook App is a server-client application that allows editing and running notebook documents via a web browser. The Jupyter Notebook App…AWS3 min read
PinnedGCP Looker: Learn most paid multi-cloud skill in 2022 with a quick hands-on demoLooker with the partnership of Google is going to be one of the most popular multi-cloud tool in 2022 and the de-facto business intelligence (BI) tool through multi-cloud seamless data experiences that fit the way people work It gained traction especially after Google acquired it in 2019 and has filled…Google Cloud Platform8 min read
Jan 13AWS bringing revolution in Aerospace and Satellite spaceDo you know that Amazon Web Services has a dedicated business segment focused on ‘Aerospace and Satellite Solutions.’ The company’s off-world ambitions have expanded in recent years, with a Ground Station division, and a plan to place thousands of Internet-providing satellites in orbit. …AWS4 min read
Published in Better Programming·Jan 11AWS Introduces Official SDKs for Rust, Kotlin, and SwiftA look at how to use the AWS SDKs in each of the programming languages — During Re:invent Dec,2021 event, Amazon Web Services announced SDKs for Rust, Kotlin, and Swift — which are currently in developer preview. This is taken with much appreciation and joy by the developer community for these languages. We will go through the details with code samples in this write-up. According to…AWS4 min read
Jan 6How to choose the best compute option in the Google cloud platform (GCP)GCP offers a plethora of compute options to choose from, this article attempts to demystify that! Too many choices can overwhelm us and cause us to not choose at all. For businesses, this means that if they offer us too many choices, we may not buy anything. Sheena Iyengar Google…Gcp5 min read
Published in Better Programming·Jan 2What’s New at AWS for 2022 — Introduction to Readable Standby Instances in RDSJust before the festive mood for Christmas 2021, AWS has announced readable standby instances in Amazon RDS multi-AZ deployments — Amazon RDS now offers Multi-AZ deployments with readable standby instances (also called Multi-AZ DB cluster deployments) in preview. To know what is Amazon RDS, check out this documentation or AWS’s YouTube video on it: Ok, What Was The Problem Statement? Amazon RDS makes it easy to set up, operate, and scale a relational database in…AWS4 min read
Aug 8, 2021Privacy By Design — A complete StoryPrivacy is not something that I’m merely entitled to, it’s an absolute prerequisite. Marlon Brando In 1960, quoted in Marlon Brando, Ch. 11 (1974, rev. 1989), by David Shipman. These days, out of the blue, we often hear the term “Privacy by design.”So …Privacy7 min read
Jul 29, 2020Data Structures in 15 minutesWhat comes to your mind when people talk about data-structure interview? 😀 Well,we all have used data-structures in one form or another but we often sometime miss a quick revision guide.I have tried to consolidate the important points regarding data structure. Additionally, please refer to must-practice examples(in Python)on my github…Datastrucutre11 min read