Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 06-19-2021 09:02 AM - edited 06-19-2021 09:15 AM
Hi, all, I have faced a problem when I use the hdp 3.1.5 with ambari , because the default hive version 3.1.0 is too high to use the spark 3.1(it's supported with hive version 2.3.7 ), so I need to downgrade the hive version to 2.3.7, how can I do it?
Created 06-19-2021 11:36 PM
Hello @Bryan_zh
Hive 3 is the default version in HDP 3.1.5 and you cannot degrade the version to Hive 2.3.7. It is also not recommended to degrade Hive from 3.X to 2.X
Created 06-20-2021 12:35 AM
@Shifu Okay, got it, but we want to use spark 3.1, it recommend the hive metastore version is 2.3.7, `https://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html`, how can I do for it? maybe downgrade the hive version is the only way.
Created 06-20-2021 06:55 AM
@Bryan_zh I believe HDP 3.1.5 supports Spark 2.X only. Please check the below link
How to integrate Hive and Spark?