question Hadoop 3.1.1 fixes in HDP 3.0 in Archives of Support Questions (Read Only)

Hadoop 3.1.1 fixes in HDP 3.0

Amila-Manoj-Sil — Wed, 15 Aug 2018 06:13:42 GMT

Hadoop 3.1.1 release includes 435 fixed JIRAs since 3.1.0.

I would like to know if these fixes (3.1.1 release) are already included with HDP 3.0 when I install it via Ambari-2.7.0.0?

If not, is there an updated Ambari installation URL? or updated repository URLs which I can enter in cluster installation wizard in Ambari?

Re: Hadoop 3.1.1 fixes in HDP 3.0

jsensharma — Wed, 15 Aug 2018 06:15:50 GMT

@Amila Silva

The current latest HDP 3.0 contains "Apache Hadoop 3.1.0"

https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/release-notes/content/comp_versions.html

There are not separate HDP repo available currently to get Hadoop 3.1.1 release fixes.

Re: Hadoop 3.1.1 fixes in HDP 3.0

apappu — Wed, 15 Aug 2018 06:17:22 GMT

@Amila Silva

HDP3.0 comes with Hadoop 3.1.0 version - so the BUGs fixed in 3.1.1 will not be present but should have till 3.1.0

Re: Hadoop 3.1.1 fixes in HDP 3.0

Amila-Manoj-Sil — Wed, 15 Aug 2018 15:00:57 GMT

@amarnath reddy pappu, @Jay Kumar SenSharma

Thanks for the answers.

Yes I knew Hadoop 3.1.0 is the version included in HDP 3.0.

How can I expect these Hadoop 3.1.1 fixes with HDP in the future.

a) With a new Ambari version?

b) Updated repos in Ambari installation wizard?

c) Or with a new HDP release (like HDP 3.0.1)?

Re: Hadoop 3.1.1 fixes in HDP 3.0

jsensharma — Wed, 15 Aug 2018 19:17:19 GMT

@Amila Silva

Hadoop components are shipped as part of HDP repo. So when the next HDP release will be available which includes the Hadoop 3.1.1 component then you will need to get the HDP repo link and then need to perform the HDP upgrade via Ambari (or via command line).

The new HDP repository registration steps will be almost similar as the one which is mentioned here: https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.0.0/bk_ambari-upgrade/content/upgrading_HDP_register_and_install_target_version.html