Support Questions

Find answers, ask questions, and share your expertise

Why HDP 3.0 showing HDFS version 3.1

avatar
Contributor

Hi All,

Greeting for the day.

HDP 3.0 is showing HDFS version 3.1.

I think this is not correct.

Thanks in Advance

1 ACCEPTED SOLUTION

avatar
Master Mentor

@Amit Mishra

I can understand your doubt. That's purely a marketing stunt.When Hortonworks packages an new major release like HDP 3.0 it contains underlying components with different versions like

  • Apache Accumulo 1.7.0
  • Apache Atlas 1.0.0
  • Apache Calcite 1.2.0
  • Apache DataFu 1.3.0
  • Apache Hadoop 3.1.0
  • Apache HBase 2.0.1
  • Apache Hive 3.0.0
  • Apache Kafka 1.0.1
  • Apache Knox 1.0.0
  • Apache Livy 0.5
  • Apache Oozie 4.3.1
  • Apache Phoenix 5.0.0
  • Apache Pig 0.16.0
  • Apache Ranger 1.1.0
  • Apache Spark 2.3.1
  • Apache Sqoop 1.4.7
  • Apache Storm 1.2.1
  • Apache TEZ 0.9.1
  • Apache Zeppelin 0.8.0
  • Apache ZooKeeper 3.4.6

As you can see above HDFS is version 3.1.0, so the HDP version will never have the same component versions. For example, at Apache Software Foundation the latest version Hadoop-3.1.1 before Hortonworks includes and releases its major release i.e HDP 3.2 version to include this version of Hadoop it has to go through rigorous compatibility tests with other components.

See attached screenshot

HTH


hdp30.jpg

View solution in original post

2 REPLIES 2

avatar
Master Mentor

@Amit Mishra

I can understand your doubt. That's purely a marketing stunt.When Hortonworks packages an new major release like HDP 3.0 it contains underlying components with different versions like

  • Apache Accumulo 1.7.0
  • Apache Atlas 1.0.0
  • Apache Calcite 1.2.0
  • Apache DataFu 1.3.0
  • Apache Hadoop 3.1.0
  • Apache HBase 2.0.1
  • Apache Hive 3.0.0
  • Apache Kafka 1.0.1
  • Apache Knox 1.0.0
  • Apache Livy 0.5
  • Apache Oozie 4.3.1
  • Apache Phoenix 5.0.0
  • Apache Pig 0.16.0
  • Apache Ranger 1.1.0
  • Apache Spark 2.3.1
  • Apache Sqoop 1.4.7
  • Apache Storm 1.2.1
  • Apache TEZ 0.9.1
  • Apache Zeppelin 0.8.0
  • Apache ZooKeeper 3.4.6

As you can see above HDFS is version 3.1.0, so the HDP version will never have the same component versions. For example, at Apache Software Foundation the latest version Hadoop-3.1.1 before Hortonworks includes and releases its major release i.e HDP 3.2 version to include this version of Hadoop it has to go through rigorous compatibility tests with other components.

See attached screenshot

HTH


hdp30.jpg

avatar
Contributor

Thank you, Geoffrey Shelton Okot.