question Re: How can I downgrade hive version 3.1 to 2.3.7 in hdp 3.1.5? in Support Questions

How can I downgrade hive version 3.1 to 2.3.7 in hdp 3.1.5?

Bryan_zh — Sat, 19 Jun 2021 16:15:58 GMT

Hi, all, I have faced a problem when I use the hdp 3.1.5 with ambari , because the default hive version 3.1.0 is too high to use the spark 3.1(it's supported with hive version 2.3.7 ), so I need to downgrade the hive version to 2.3.7, how can I do it?

Re: How can I downgrade hive version 3.1 to 2.3.7 in hdp 3.1.5?

Shifu — Sun, 20 Jun 2021 06:36:03 GMT

Hello @Bryan_zh

Hive 3 is the default version in HDP 3.1.5 and you cannot degrade the version to Hive 2.3.7. It is also not recommended to degrade Hive from 3.X to 2.X

Re: How can I downgrade hive version 3.1 to 2.3.7 in hdp 3.1.5?

Bryan_zh — Sun, 20 Jun 2021 07:35:01 GMT

@Shifu Okay, got it, but we want to use spark 3.1, it recommend the hive metastore version is 2.3.7, `https://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html`, how can I do for it? maybe downgrade the hive version is the only way.

Re: How can I downgrade hive version 3.1 to 2.3.7 in hdp 3.1.5?

Shifu — Sun, 20 Jun 2021 13:55:31 GMT

@Bryan_zh I believe HDP 3.1.5 supports Spark 2.X only. Please check the below link

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/spark-overview/content/analyzing_data_with_apache_spark.html

How to integrate Hive and Spark?

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.1/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html