Introduction

Data warehousing solutions have been existing for decades and these have been the backbone of all reporting and analytic needs of both small and large scale enterprises. Even in today’s world of Big Data, Data Lakes, and NoSQL databases, SQL as a language still remains the most powerful querying language and the combination of data warehouses and SQL continues to dominate the most modern data applications.

Motivation

At GumGum, Amazon Redshift has been the primary warehousing solution for years. Redshift is a fully managed, petabyte-scale cloud data warehouse that has worked very well for our needs. However, our data footprint has grown substantially over the years and we need solutions that easily scale with us, without the burden of exponentially rising costs. Due to the increase in data volume, we have gone through the cycles of resizing the Redshift cluster from time to time. Unfortunately, the ease of operating the warehouse comes with the cost of an expensive cluster (21 dc2.8xlarge)

Rashmina Menon

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store