SPARK Application + HDFS + User Airflow is not the owner of inode=alapati

[#1]

we are runs spark application on hadoop cluster ( HDP version - 2.6.5 from hortonworks )

from the logs we can see the following Diagnostics

User: airflow
Application Type: SPARK
User class threw exception: org.apache.hadoop.security.AccessControlException: Permission denied. user=airflow is not the owner of inode=alapati

not clearly what we need to search in `HDFS` in order to find why we get Permission denied

[#2]

yes we get the following:

cat /etc/group | grep -i hadoop
hadoop:x:1006:hive,livy,zookeeper,spark,ams,kafka,yarn,hcat,mapred

cat /etc/group | grep -i airflow
hdfs:x:1005:hdfs,hive,airflow
airflow:x:1016:

cat /etc/group | grep -i hdfs
hdfs:x:1005:hdfs,hive,airflow

let me know if you need additional info?

[#3 · Accepted solution]

@mike_bronson7 

You can change the ownership of the HDFS  directory to airflow:hadoop  please do run the -chown command on / ??? It should something like /users/airflow/xxx

Please let me know