From 1 to 1 Billion: Evolution of a Document Serving System

This talk was held on Wednesday, February 27, 2013.

As Indeed’s traffic has grown to its current level of over 3 billion job searches per month worldwide, we have evolved our job data storage and serving architecture in order to maintain high levels of reliability and performance, including an average retrieval time per document of 31ms. This talk describes that evolution, from the initial direct-access MySQL-based solution to a dedicated service and custom data store built around a log-structured merge-tree (LSM-Tree) implementation.

Audio Description

The following video includes a descriptive audio track for this talk.

Transcripts

• Basic transcript (includes audio information only)
• Descriptive transcript (includes audio and visual information)

Speakers

Jack Humphrey is VP of engineering at Indeed.

Jeff Plaisance is a senior software engineer at Indeed.

Originally published at Indeed Engineering Blog.