How to upgrade Spark 1.6.1 to 1.6.2 in HDP 2.4.2.0

[#1]

Hi,

Kindly asking for a way to upgrade spark 1.6.1 to 1.6.2 in HDP 2.4.2.0. We did the installations via ambari. Therefore, what is the safe way to upgrade spark without affecting the rest of the components?

Regards

[#2 · Accepted solution]

Spark 1.6.2 is available from HDP 2.4.3 to 2.53 ! It is possible to upgrade to Spark 1.6.2 manually, but it is not supported by Hortonworks ! Also there would be issues that might arise after upgradation (manually) with Zeppelin and other associated tools/applications which are built in your environment ! In case if you have paid support, you could raise a ticket and get it resolved !

Cheers,

Ram

[#3]

@Tendai Bepete

Upgrading specific service in Ambari is not feasible as of now. You'd need to upgrade the entire HDP stack. As mentioned by Ram Charan it is possible to upgrade from command line but compatibility isn't tested/supported.