Support Questions
Find answers, ask questions, and share your expertise

Ambari Pig View - fails on permisisons for 'pig.tar.gz/pig/bin/pig'

Ambari Pig View - fails on permisisons for 'pig.tar.gz/pig/bin/pig'

Installed Ambari Pig View, but am not able to run Jobs via the View.

The Pig view was installed on Azure IaaS, Ambari 2.4.1 and the Pig view is a 'Local Cluster' configuration. It errors out without any stdout or stderr information displaying on the Pig view screen (stdout and stderr are available in the job logs). In the job logs Found the following message:

2016-11-18 14:11:05,464 FATAL [IPC Server handler 2 on 37186]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1479494676475_0003_m_000000_0 - exited : java.io.IOException: Cannot
run program "pig.tar.gz/pig/bin/pig": error=13, Permission denied  at
java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)  at
org.apache.hive.hcatalog.templeton.tool.TrivialExecService.run(TrivialExecService.java:66)  at
org.apache.hive.hcatalog.templeton.tool.LaunchMapper.startJob(LaunchMapper.java:177)  at
org.apache.hive.hcatalog.templeton.tool.LaunchMapper.run(LaunchMapper.java:410)  at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)  at
org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)  at
org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)  at
java.security.AccessController.doPrivileged(Native Method)  at javax.security.auth.Subject.doAs(Subject.java:422)  at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)  at
org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)Caused by: java.io.IOException: error=13, Permission denied  at
java.lang.UNIXProcess.forkAndExec(Native Method)  at
java.lang.UNIXProcess.<init>(UNIXProcess.java:247)  at
java.lang.ProcessImpl.start(ProcessImpl.java:134)  at
java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)  
... 10 more

Have not had this error before on previous installs on different clusters.

Background Work Performed for Ambari view setup:

Additional work performed so far (kindly assisted by Ravi Gangappa):

  • Double-checked the proxyusers in Ambari hdfs and hive configs
  • Confirmed that this should not be a port issue (opened up all ports in Azure)
  • Gave wide-open permissions to HDFS /hdp/apps/2.5.0.0-1245/pig/pig.tar.gz

Thanks in advance for your assistance.

2 REPLIES 2
Highlighted

Re: Ambari Pig View - fails on permisisons for 'pig.tar.gz/pig/bin/pig'

@bpreachuk

Can you upload the screenshot for the error?

Highlighted

Re: Ambari Pig View - fails on permisisons for 'pig.tar.gz/pig/bin/pig'

Hi @Sagar Shimpi. I am attaching a screenshot, but the error does not appear in the screenshot. It is in the syslog file for the pig script job. Ravi Gangappa was looking into it this afternoon but we were not able to find the problem yet. screen-shot-2016-11-19-at-103336-pm.png

I will send you via email the text of the HipChat we had.

Don't have an account?