Hadoop Components Versions in Distros Matrix

June 3, 2015

Derek Wood is a DevOps Engineer at Cask where he is building tools to manage and operate the next generation of Big Data applications. Prior to Cask, Derek ran large scale distributed systems at Wells Fargo and at Yahoo!, where he was the senior engineering lead for the CORE content personalization platform

The Apache Hadoop ecosystem is always evolving, with the major distributions constantly upgrading their included core Hadoop components. This can present a challenge when building any application which runs on top of Hadoop. When developing our open-source application framework, CDAP, we strive to maintain compatibility with all major Hadoop distributions.

Building on our previous reference of supported Linux distributions, the table below breaks down each version of the major Hadoop distributions into their core Hadoop component versions. We have found this very useful, and hope it will come in handy for your work as well. All information is culled from documented release notes.

CDH