PinnedShitij GoyalinDunzoDebugging Airflow Issues: A Case StudyAt Dunzo, we are using Apache Airflow in the data platform to orchestrate multiple types of pipelines.5 min read·Jul 17, 2023----
PinnedShitij GoyalinPolar TropicsRamblings of a broken heartWhy did you meet me, love me and leave me?1 min read·Feb 12, 2017----
Shitij GoyalinPolar TropicsGreat Expectations — The Good and the BadRecently, I got the opportunity to use the data validation library Great Expectations. Like its literature counterpart, it has the…3 min read·Jan 24, 2022--1--1
Shitij GoyalinPolar TropicsSetting up HTTPS using a letsencrypt wildcard certificate on a private domain/IPRecently, I was setting up a service on Nginx on Google Cloud Platform. My organisation has started using the google cloud and I wanted to…4 min read·Jan 14, 2021--1--1
Shitij GoyalinPolar TropicsReligion is a birthright and my birthright is better than yours!!Religion. Probably the most frequent word you’ll find dropped in a discussion these days after Covid. After all when we can’t wrap our…4 min read·Sep 23, 2020----
Shitij GoyalinPolar TropicsLife and Experiences of 2-wheeler bike taxis in IndiaIt was a dark and stormy night/day. The iconic line used by Snoopy is a perfect way to describe riding with bike taxis. Whatever…2 min read·Sep 6, 2019--2--2
Shitij GoyalinPolar TropicsHow I exploited Sentry to find sensitive details of customersThe world of security and hackers has always fascinated me and I thought finding bug bounties would be a good way of learning some basic…2 min read·Jan 29, 2019----
Shitij GoyalinPolar TropicsImproving Spark job performance while writing Parquet by 300%A while back I was running a Spark ETL which pulled data from AWS S3 did some transformations and cleaning and wrote the transformed data…3 min read·Jun 28, 2018----
Shitij GoyalinPolar TropicsChange, Death and ‘IT’The only constant in life,1 min read·May 2, 2018----
Shitij GoyalinPolar TropicsAnalyzing Medium’s posts and building a simple prediction service for “Popular on Medium”These days Medium is a rage everywhere. Blogging has taken the form of stories with more focus on a personal touch. Medium has become the…5 min read·Dec 27, 2017--7--7