Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Upgrade hdp 3.1.4 to 3.1.5

avatar
New Contributor

Hi there,

 

What warnings there are around upgrading hdp 3.1.4 to hdp 3.1.5

we have already installed:

hdfs 3.1.1

yarn 3.1.1

mapreduce 3.1.1

tez 0.9.1

hive 3.1.0

sqoop 1.4.7

oozie 4.3.1

zookeeper 3.4.6

spark2 2.3.2

 

Our principal goal is to solve hive - spark metadata issue.

 

Regards!

 

1 ACCEPTED SOLUTION

avatar
Moderator

Hello @usuario_hdp ,

 

thank you for reaching out to the Community!

 

For HDP3.1.5 please find below the list of:

Hope this answers your inquiry!

 

Do you know the upstream Jira number of the Spark and - Hive metadata issue you are referring to, please? So I can look it up for you.

 

Best regards:

Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

View solution in original post

2 REPLIES 2

avatar
Moderator

Hello @usuario_hdp ,

 

thank you for reaching out to the Community!

 

For HDP3.1.5 please find below the list of:

Hope this answers your inquiry!

 

Do you know the upstream Jira number of the Spark and - Hive metadata issue you are referring to, please? So I can look it up for you.

 

Best regards:

Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

avatar
New Contributor

I appreciate you answer, i dont know the jira number but the case is solved by upgrading to hdp 3.1.5.

This is the link where you can find "descriptions of new features". Here they mention that hive and spark can interact in an easy way due to the fact that now they are using the same hive metastore. Right now we are using hdp 3.1.4, and when we want to write or read hive objects we have to use the hive warehouse connector, which, sometimes is too slow.

 

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/hdp-release-notes.pdf

 

Apache component

    Hive

Feature areas, benefits, and links to further information

    Core Capabilities
        • Support single catalog for Hive and Spark using the Hive Metastore (HMS) translation layer.

 

Regards,