Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie shell workflow not working

Highlighted

Oozie shell workflow not working

Expert Contributor

I have configured simple test oozie workflow and running below configuration:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>

<workflow-app xmlns="uri:oozie:workflow:0.5" name="shell-action-asif-test">

<start to="shell_1"/>

<action name="shell_1">

<shell xmlns="uri:oozie:shell-action:0.3">

<job-tracker>${resourceManager}</job-tracker>

<name-node>${nameNode}</name-node>

<exec>echo</exec> <argument>"This is testing by ME"</argument>

<capture-output/>

</shell>

<ok to="end"/>

<error to="kill"/>

</action>

<kill name="kill"> <message>${wf:errorMessage(wf:lastErrorNode())}</message>

</kill>

<end name="end"/>

</workflow-app>

While running above configuration, i'm getting error in logs:

2018-04-09 12:03:14,036  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@:start:] Start action [0000011-180330162120442-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2018-04-09 12:03:14,036  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@:start:] [***0000011-180330162120442-oozie-oozi-W@:start:***]Action status=DONE
2018-04-09 12:03:14,036  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@:start:] [***0000011-180330162120442-oozie-oozi-W@:start:***]Action updated in DB!
2018-04-09 12:03:14,087  INFO WorkflowNotificationXCommand:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000011-180330162120442-oozie-oozi-W
2018-04-09 12:03:14,087  INFO WorkflowNotificationXCommand:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000011-180330162120442-oozie-oozi-W@:start:
2018-04-09 12:03:14,099  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] Start action [0000011-180330162120442-oozie-oozi-W@shell_1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2018-04-09 12:03:14,699  INFO ShellActionExecutor:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] Trying to get job [job_1522649607185_0234], attempt [1]
2018-04-09 12:03:14,717  INFO ShellActionExecutor:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] checking action, hadoop job ID [job_1522649607185_0234] status [RUNNING]
2018-04-09 12:03:14,718  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] [***0000011-180330162120442-oozie-oozi-W@shell_1***]Action status=RUNNING
2018-04-09 12:03:14,718  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] [***0000011-180330162120442-oozie-oozi-W@shell_1***]Action updated in DB!
2018-04-09 12:03:14,724  INFO WorkflowNotificationXCommand:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] No Notification URL is defined. Therefore nothing to notify for job 0000011-180330162120442-oozie-oozi-W@shell_1
2018-04-09 12:03:28,288  INFO CallbackServlet:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] callback for action [0000011-180330162120442-oozie-oozi-W@shell_1]
2018-04-09 12:03:28,328  INFO ShellActionExecutor:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] Trying to get job [job_1522649607185_0234], attempt [1]
2018-04-09 12:03:28,405  INFO ShellActionExecutor:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] action completed, external ID [job_1522649607185_0234]
2018-04-09 12:03:28,414  INFO ShellActionExecutor:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] action produced output
2018-04-09 12:03:28,460  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@end] Start action [0000011-180330162120442-oozie-oozi-W@end] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2018-04-09 12:03:28,461  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@end] [***0000011-180330162120442-oozie-oozi-W@end***]Action status=DONE
2018-04-09 12:03:28,461  INFO ActionStartXCommand:520 - SERVER[slave3.bd-coe.com] USER[admin] GROUP[-] TOKEN[] APP[shell-action-asif-test] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@end] [***0000011-180330162120442-oozie-oozi-W@end***]Action updated in DB!
2018-04-09 12:03:28,517  INFO WorkflowNotificationXCommand:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@end] No Notification URL is defined. Therefore nothing to notify for job 0000011-180330162120442-oozie-oozi-W@end
2018-04-09 12:03:28,518  INFO WorkflowNotificationXCommand:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000011-180330162120442-oozie-oozi-W
2018-04-09 12:03:28,518  INFO WorkflowNotificationXCommand:520 - SERVER[slave3.bd-coe.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000011-180330162120442-oozie-oozi-W] ACTION[0000011-180330162120442-oozie-oozi-W@shell_1] No Notification URL is defined. Therefore nothing to notify for job 0000011-180330162120442-oozie-oozi-W@shell_1

Ouput in yarn logs:

Log Type: stderr

Log Upload Time: Mon Apr 09 12:02:54 +0530 2018

Log Length: 1728

Apr 09, 2018 12:02:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.mapreduce.v2.app.webapp.JAXBContextResolver as a provider class
Apr 09, 2018 12:02:39 PM com.sun.jersey.guice.spi.container.GuiceComponentProviderFactory register
INFO: Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class

Log Type: stdout

Log Upload Time: Mon Apr 09 12:02:54 +0530 2018

Log Length: 0

Can someone help on it? Will be appreciable.