question Re: Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------ in Archives of Support Questions (Read Only)

Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

KuldeepK — Tue, 22 Dec 2015 15:35:30 GMT

I have a shell action defined in my workflow which moves data from one hdfs location to another, my action is failing because of below error

Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

Below are some useful configurations (got these from application log)

yarn.app.mapreduce.am.staging-dir=/user
user.name=yarn
mapreduce.job.user.name=xyz

I also have added below variable in my workflow.xml file under shell action

<env-var>HADOOP_USER_NAME=${wf:user()}</env-var>

I'm not sure why user "xyz" is trying to read/write at /user/yarn/.staging location.

Oozie experts, any idea whats going on here ?

Re: Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

agillan — Wed, 23 Dec 2015 02:06:17 GMT

EDIT: oops - just read the end bit of your post... still try to do it in the shell action itself and see?

---

I believe this is a known limitation in non-secure clusters, whereby the containers are running as YARN user and not running as user xyz.

Try to pass in the HADOOP_USER_NAME variable as illustrated below:

$ `export HADOOP_USER_NAME=xyz ; hive -hiveconf hive.execution.engine=mr -e 'show databases' `

Re: Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

aervits — Wed, 23 Dec 2015 22:21:33 GMT

here's an example of a shell action executed as another user https://github.com/dbist/oozie/tree/master/apps/sqoopshell, it is not the best approach but it works. User xyz executes the oozie workflow, the shell action executes as yarn user, thus you get xyz cannot access yarn.

Re: Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

KuldeepK — Thu, 24 Dec 2015 11:38:27 GMT

Thanks @Ana Gillan

Re: Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

KuldeepK — Thu, 24 Dec 2015 11:38:45 GMT

Thanks @Artem Ervits - will try this

Re: Oozie shell action - Permission denied: user=xyz, access=EXECUTE, inode="/user/yarn/.staging":yarn:supergroup:drwx------

aervits — Tue, 02 Feb 2016 22:32:38 GMT

@Kuldeep Kulkarni has this been resolved? Can you post your solution or accept best answer?