spark3 for cdp error

[#1]

sql("show databases").show()

sql("show tables").show()

error

[#2]

Hi @dfdf, I am not able to reproduce this issue. I can able to get the table details while running the queries in the Spark3 session. Please can you help us with the exact version of Spark3 and Hive version that you are running on your environment? For example, you can get the value by running spark3-shell --version

Please verify are you seeing any errors or alerts related to the Hive service? Also, can you try to run similar queries directly from Hive and see whether are you getting the results? 

[#3]

cm:7.3.1

cdp:7.1.6

sql:

spark2 is ok!

spark3 is error

[#4]

[#5 · Accepted solution]

Hi @dfdf, I tried in my cluster with both Spark2 and Spark3 on the same version which you tried but I can able to get the results without any issues. 

Spark2: 2.4.7.7.1.7.1000-141

Spark3 : 3.2.1.3.2.7171000.1-1

Are you still seeing this issue? Please can you share the reproduce steps that I can try from my side to reproduce this issue in my cluster? Thanks  

[#6]

@dfdf, Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.  If you are still experiencing the issue, can you provide the information @jagadeesan has requested?