Member since
09-15-2020
2
Posts
1
Kudos Received
0
Solutions
10-01-2020
01:39 PM
1 Kudo
I appreciate you answer, i dont know the jira number but the case is solved by upgrading to hdp 3.1.5.
This is the link where you can find "descriptions of new features". Here they mention that hive and spark can interact in an easy way due to the fact that now they are using the same hive metastore. Right now we are using hdp 3.1.4, and when we want to write or read hive objects we have to use the hive warehouse connector, which, sometimes is too slow.
https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/hdp-release-notes.pdf
Apache component
Hive
Feature areas, benefits, and links to further information
Core Capabilities • Support single catalog for Hive and Spark using the Hive Metastore (HMS) translation layer.
Regards,
... View more
09-15-2020
12:28 PM
Hi there, What warnings there are around upgrading hdp 3.1.4 to hdp 3.1.5 we have already installed: hdfs 3.1.1 yarn 3.1.1 mapreduce 3.1.1 tez 0.9.1 hive 3.1.0 sqoop 1.4.7 oozie 4.3.1 zookeeper 3.4.6 spark2 2.3.2 Our principal goal is to solve hive - spark metadata issue. Regards!
... View more
Labels: