But Why Reinvent the Wheel? The Case for (Yet Another) Distributed Database

This talk was held on Wednesday, November 20, 2019.

The Data Infrastructure team at Indeed uses many open source technologies to provide a data platform for the rest of the company. But sometimes, the team encounters problems that existing solutions can’t solve. So, we build something new for the platform.

In this presentation, you’ll get an overview of the distributed storage technology space and some of its most interesting challenges.

You will also learn about one significant problem Indeed was facing that led us to build an entirely new in-house database.

Audio Description

The following video includes a descriptive audio track for this talk.

Transcripts

• Basic transcript (includes audio information only)
• Descriptive transcript (includes audio and visual information)

Speaker

Josh Slocum is a senior software engineer on Indeed’s Data Infrastructure team and the tech lead for Osiris, Indeed’s petabyte-scale distributed database. While working on Osiris, he enjoys the opportunity to architect large-scale distributed systems as much as doing deep dives on improving the performance of a single function.

Cross-posted on Indeed Engineering Blog.