Skip to main content
Bryan_zh
Bryan_zh
Silver ⭐️⭐️
June 19, 2021
Question

How can I downgrade hive version 3.1 to 2.3.7 in hdp 3.1.5?

Hi, all, I have faced a problem when I use the hdp 3.1.5 with ambari , because the default hive version 3.1.0 is too high to use the spark 3.1(it's supported with hive version 2.3.7 ), so I need to downgrade the hive version to 2.3.7, how can I do it?

3 replies

Shifu
Gold ⭐️⭐️
Shifu
Gold ⭐️⭐️
June 20, 2021

Hello @Bryan_zh 

 

Hive 3 is the default version in HDP 3.1.5 and you cannot degrade the version to Hive 2.3.7. It is also not recommended to degrade Hive from 3.X to 2.X

 

 

Translate
Bryan_zh
Bryan_zhAuthor
Silver ⭐️⭐️
June 20, 2021

@Shifu Okay, got it, but we want to use spark 3.1,  it recommend the hive metastore version is 2.3.7, `https://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html`,  how can I do for it?  maybe downgrade the hive version is the only way. 

Translate
Shifu
Gold ⭐️⭐️
Shifu
Gold ⭐️⭐️
June 20, 2021

@Bryan_zh I believe HDP 3.1.5 supports Spark 2.X only. Please check the below link

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/spark-overview/content/analyzing_data_with_apache_spark.html

 

How to integrate Hive and Spark?

https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.1/integrating-hive/content/hive_hivewarehouseconnector_for_handling_apache_spark_data.html

Translate
Terms & ConditionsAccessibility statement