Please save me!!! [Spark] MetaException: Permission denied: user [**] does not have [READ] privilege on [[hdfs://....]]

[#1]

I am a beginner. I submitted the HQL(create table bds_hive.test_ft19 (name string)) using spark3-shell and experienced three permission errors. These errors indicate that I do not have permissions for the corresponding paths on HDFS. According to the error message, I configured the corresponding path permission in Ranger, but it did not work. In addition, there is no denied record in the audit log. I hope guys can help me analyze and provide solutions.

Hadoop version:3.1.1.7.1.7.1000-141

Hive version:3.1.3000.7.1.7.1000-141

Spark version:3.2.1.3.2.7171000.1-1

[#2 · Accepted solution]

Hi,

There is a KB article related to this issue, please review this below:

https://community.cloudera.com/t5/Customer/Permission-denied-when-accessing-Hive-tables-from-Spark-i...

Regards,

Chethan YM