Author: Saurabh Jain

Engineering Team: Amardeep Kumar Gupta, Prabhu Thiruvambalam & Suresh Appavu

In January 2020, one of the highest priority projects for the Data Engineering team was to migrate Groupon’s on-prem system to Cloud (AWS). Groupon has a large on-prem environment that involves 4 different Hadoop environments and a Teradata cluster.

In the first phase of Cloud Migration, we determined we would be migrating approximately 71 Teradata pipelines to the cloud. At this point, it was already decided that we would be building our data lake on AWS S3 and end-users would be using the hive tables to query…

Saurabh Jain

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store