Support Questions
Find answers, ask questions, and share your expertise

Run flume job from oozie shell action

Run flume job from oozie shell action



I want to run the flume job using shell action in oozie. I run the flume job manually and it was executed successfully.

I have created below shell script which initiate the flume job:

/usr/hdp/2.x.x.x-xxx/flume/bin/flume-ng agent -n agent1 --conf /etc/flume/conf -f flume.conf


Flume job executed using shell script(.sh file) But while executing flume job from oozie , shell action get stuck in PREP mode.

job.xml :


<property> <name>nameNode</name> <value>hdfs://hostname:8020</value> </property>

<property> <name>resourceManager</name> <value>hdfs://hostname:8050</value> </property>

<property> <name>oozie.use.system.libpath</name> <value>true</value> </property>

<property> <name></name> <value>hdfs://hostname:8020/oozie</value> </property>

<property> <name>queueName</name> <value>default</value> </property>


workflow.xml :

<workflow-app xmlns="uri:oozie:workflow:0.4" name="shell-wf">

<start to="shell-node"/> <action name="shell-node">

<shell xmlns="uri:oozie:shell-action:0.2">




<property> <name></name> <value>${queueName}</value> </property>






<ok to="end"/>

<error to="fail"/>


<kill name="fail">

<message>Shell action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>


<kill name="fail-output">

<message>Incorrect output, expected [Hello Oozie] but was [${wf:actionData('shell-node')['my_output']}]</message>


<end name="end"/>



Don't have an account?