Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Pig on Tez fails in multi user cluster

Pig on Tez fails in multi user cluster

New Contributor

When running Pig on Tez in multi user environment, the first user who runs a script gets ownership of /tmp/yarn/tez/staging. Anyone else who afterwards tries to execute any Pig script on Tez fails with this message:

org.apache.tez.dag.api.TezUncheckedException: org.apache.hadoop.security.AccessControlException: Permission denied: user=admin, access=EXECUTE, inode="/tmp/yarn/tez/staging":stuser35:hdfs:drwx------

There was a JIRA on this before (https://issues.apache.org/jira/browse/PIG-5042)

Does anyone have a solution for this problem?

Thanks,

3 REPLIES 3

Re: Pig on Tez fails in multi user cluster

New Contributor

By the way, when I try solution suggested in the comments to that JIRA, then it tries to make a staging directory in /user/yarn/.tezStaging and fails with a very similar error:

org.apache.tez.dag.api.TezUncheckedException: org.apache.hadoop.security.AccessControlException: Permission denied: user=st100, access=WRITE, inode="/user/yarn/.tezStaging":hdfs:hdfs:drwxr-xr-x 

Re: Pig on Tez fails in multi user cluster

Mentor

can you try what is suggested in the Jira, set Tez staging dir <name>tez.staging-dir</name>

to /tmp/${user.name}/staging.

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/ref-ffe...

Highlighted

Re: Pig on Tez fails in multi user cluster

New Contributor

${user.name} is replaced with "yarn" which is not a current user who submits the jot. This path or /user/${user.name}/.staging didnt worked for me please help.