question Upgrade hdp 3.1.4 to 3.1.5 in Support Questions

Upgrade hdp 3.1.4 to 3.1.5

usuario_hdp — Tue, 15 Sep 2020 19:28:15 GMT

Hi there,

What warnings there are around upgrading hdp 3.1.4 to hdp 3.1.5

we have already installed:

hdfs 3.1.1

yarn 3.1.1

mapreduce 3.1.1

tez 0.9.1

hive 3.1.0

sqoop 1.4.7

oozie 4.3.1

zookeeper 3.4.6

spark2 2.3.2

Our principal goal is to solve hive - spark metadata issue.

Regards!

Re: Upgrade hdp 3.1.4 to 3.1.5

Bender — Mon, 21 Sep 2020 14:14:19 GMT

Hello @usuario_hdp ,

thank you for reaching out to the Community!

For HDP3.1.5 please find below the list of:

Hope this answers your inquiry!

Do you know the upstream Jira number of the Spark and - Hive metadata issue you are referring to, please? So I can look it up for you.

Best regards:

Ferenc

Re: Upgrade hdp 3.1.4 to 3.1.5

usuario_hdp — Thu, 01 Oct 2020 21:18:45 GMT

I appreciate you answer, i dont know the jira number but the case is solved by upgrading to hdp 3.1.5.

This is the link where you can find "descriptions of new features". Here they mention that hive and spark can interact in an easy way due to the fact that now they are using the same hive metastore. Right now we are using hdp 3.1.4, and when we want to write or read hive objects we have to use the hive warehouse connector, which, sometimes is too slow.

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/hdp-release-notes.pdf

Apache component

Hive

Feature areas, benefits, and links to further information

Core Capabilities
• Support single catalog for Hive and Spark using the Hive Metastore (HMS) translation layer.

Regards,