Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Falcon tutorial - rawEmailIngestProcess shell-wf failing

avatar
Master Guru

Following the tutorial http://hortonworks.com/hadoop-tutorial/processing-data-pipeline-with-apache-falcon/ during rawEmailIngestProcess shell-wf the shellnode process fails. shellnode is basically calling ingest.sh:

curl -sS http://bailando.sims.berkeley.edu/enron/enron_wit... | tar xz && hadoop fs -mkdir -p $1 && hadoop fs -put enron_with_categories/*/*.txt $1

I changed ingest.sh and perform a simple hadoop fs -ls and the shellnode process succeeds.

Here is the oozie log:

2015-12-31 05:50:49,213 WARN ShellActionExecutor:523 - SERVER[sandbox.hortonworks.com] USER[ambari-qa] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000420-151222214138596-oozie-oozi-W] ACTION[0000420-151222214138596-oozie-oozi-W@shell-node] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1] 2015-12-31 05:50:49,239 INFO ActionEndXCommand:520 - SERVER[sandbox.hortonworks.com] USER[ambari-qa] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000420-151222214138596-oozie-oozi-W] ACTION[0000420-151222214138596-oozie-oozi-W@shell-node] ERROR is considered as FAILED for SLA 2015-12-31 05:50:49,261 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[ambari-qa] GROUP[-] TOKEN[] APP[shell-wf] JOB[0000420-151222214138596-oozie-oozi-W] ACTION[0000420-151222214138596-oozie-oozi-W@fail] Start action [0000420-151222214138596-oozie-oozi-W@fail] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]

Any help would be appreciated. @Anderw Ahn

1 ACCEPTED SOLUTION

avatar

This Oozie log doesn't contain the details of why shell action failed. To get those details, look at the YARN job logs for this action. Click on "YARN" in Ambari, then on "Resource Manager UI" under "Quick Links" and then look at the logs for the application which contains the Oozie workflow ID in it.

My guess is that there was a permission problem when writing e-mail content.

View solution in original post

5 REPLIES 5

avatar

Moved the question to Governance track.

avatar
Master Mentor

the tutorial link was invalid, removed the extraneous parenthesis

avatar

This Oozie log doesn't contain the details of why shell action failed. To get those details, look at the YARN job logs for this action. Click on "YARN" in Ambari, then on "Resource Manager UI" under "Quick Links" and then look at the logs for the application which contains the Oozie workflow ID in it.

My guess is that there was a permission problem when writing e-mail content.

avatar
Master Guru

Good call Vladimir.

mkdir: Permission denied: user=yarn, access=WRITE, inode="/user/ambari-qa/falcon/demo/primary/input/enron/2015-12-30-01":ambari-qa:hdfs:drwxr-xr-x

I executed the job from falcon using ambari-qa. Is there any configuration I can change so it uses the user ambari-qa during execution?

avatar

The easiest way to find more details and exact root cause is this -

1) Open Oozie UI & Select right tabs

1137-screen-shot-2015-08-26-at-44542-am.png

2) Double click on the job that failed and get more details by clicking on the small magnifying glass icon

1138-screen-shot-2015-08-26-at-50015-am-copy.png

Review the next screen for more error details. If you are unclear of the issue, share the details from the next screen.