Upgrade hdp 3.1.4 to 3.1.5

[#1]

Hi there,

What warnings there are around upgrading hdp 3.1.4 to hdp 3.1.5

we have already installed:

hdfs 3.1.1

yarn 3.1.1

mapreduce 3.1.1

tez 0.9.1

hive 3.1.0

sqoop 1.4.7

oozie 4.3.1

zookeeper 3.4.6

spark2 2.3.2

Our principal goal is to solve hive - spark metadata issue.

Regards!

[#2 · Accepted solution]

Hello @usuario_hdp ,

thank you for reaching out to the Community!

For HDP3.1.5 please find below the list of:

• Fixed Issues
• Known Issues

Hope this answers your inquiry!

Do you know the upstream Jira number of the Spark and - Hive metadata issue you are referring to, please? So I can look it up for you.

Best regards:

Ferenc

[#3]

I appreciate you answer, i dont know the jira number but the case is solved by upgrading to hdp 3.1.5.

This is the link where you can find "descriptions of new features". Here they mention that hive and spark can interact in an easy way due to the fact that now they are using the same hive metastore. Right now we are using hdp 3.1.4, and when we want to write or read hive objects we have to use the hive warehouse connector, which, sometimes is too slow.

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/hdp-release-notes.pdf

Apache component

    Hive

Feature areas, benefits, and links to further information

    Core Capabilities
        • Support single catalog for Hive and Spark using the Hive Metastore (HMS) translation layer.

Regards,