Meetup: Scaling Beyond a Data Warehouse to Meet Customer Demands

Terese Lichty
Building Ibotta
Published in
3 min readOct 11, 2017

Thursday, October 19, 2017

6:00 PM — Ibotta Headquarters, 1801 California Street, 4th floor, Denver, CO

Next Thursday, join us for a presentation and a fireside chat with Big Data Leaders from Ibotta, Looker, and Qubole. Ibotta’s Engineering & Analytics Teams, the people who have helped shoppers earn 22M in rebates since 2012, will share their story of how they transformed into a data business to meet their B2B retail partner and customer demand by migrating from a traditional Data Warehouse model to a data lake with Qubole running their pipelines and analytics.

Agenda

6:00–6:15 — Socialize over food and drinks

6:15–6:30 — Welcome, opening remarks and announcements

6:30–7:15 — Journey to building new Data Products and the business impact

7:15–8:00 — Fireside chat with Ibotta, Qubole, and Looker with Q&A

8:00–8:30 — Networking & Raffle

Presentations

Nathan Mclntyre, Big Data Engineer at Ibotta, will share how he and his teammates were faced with the challenges of their infrastructure limitations in Redshift due to rapidly increased demand from their retail customers and partners. He will explain the architecture of their new data products and technology tool set from Development to Data Science to Analytics. Mclntyre will discuss how they transitioned by first moving their storage endpoint to be able to apply these modern sets of technologies such as Kafka, Hive, Tez, Spark, and AirFlow for creating cutting-edge data pipelines.

Furthermore, he will explain how Qubole has allowed them to be more functional and automate these data operations to unlock the value of their data and efficiently leverage AWS infrastructure. Nathan Mclntyre will close the presentation explaining how this modern platform has allowed their Data users and products to scaling out to meet their growing demand, which has led to enabling the growth of Ibotta from a consumer app and to an enterprise analytics business.

The final 45 minutes will be a Fireside chat led by Andy Sautins discussing the platform further and how their role and outlook on the technology has been impacted, as well as perspectives from technology partners Looker and Qubole.

Hear from:

Ron White — VP of Engineering, Ibotta

Ben Roubicek — Sr.Solutions Architect, Qubole

Charley Frazier — Senior Analyst for Data Products, Ibotta

Nathan Mclntyre — Big Data Engineer, Ibotta

Lucas Thelosen — VP Professional Services, Looker

Heather Trujillo — Senior BI Analyst, Ibotta

About the Speakers

Nathan Mclntyre

Nathan McIntyre is a Data Engineer at Ibotta and lead architect of their Data Lake platform. He has spent the past 8 years building Big Data solutions for products, Engineers, and Data Scientists alike. Today McIntyre is leveraging technologies such as Kafka, AirFlow, Hive, Spark, and Presto using AWS infrastructure to scale Ibotta’s data operations.

About Ibotta

As the largest consumer technology company headquartered in Denver, CO, Ibotta is transforming the shopping experience by making it easy for consumers to earn cashback on everyday purchases through a single smartphone app. We partner with leading brands and retailers to offer rebates on groceries, electronics, clothing, gifts, home and office supplies, restaurant dining, and more. Ibotta is the premier destination for rewarded shopping on mobile, and has paid out more than $200 million in cash back to its users. Launched in 2012, Ibotta has nearly 22 million downloads, and is one of the most frequently used shopping apps in the United States. Smart shopping starts with Ibotta.

About Qubole

Qubole is a big data-as-a-service company that provides a fast, easy and reliable path to turn big data into valuable business insights. Qubole’s cloud-based platform addresses the challenges of processing huge volumes of structured and unstructured data. It runs on public clouds such as AWS, Azure, Oracle and Google Cloud Platform to help enterprises generate value from their big data while enabling their operations teams to be nimble and adaptive to their users’ needs.

--

--