Created on 09-30-2021 04:26 AM - edited 09-30-2021 05:38 AM
Hello, trying to execute simple shell oozie action
echo "start"
impala-shell -q"invalidate metadata" query using ooze
echo "end"
In logs I see "start" "end" - but nothing related to impala-shell.
Query was not executed either. On edge node query works perfectly.
Wtf could somebody explain please, as previously I used self made impala launcher which worked perfectly - not like this oozie.
Created 10-03-2021 09:11 PM
Hi ,
Can you provide the complete oozie workflow.xml and the script you are using to run this job.
1. you can collect the oozie logs for this particular workflow using below command: ( Replace the workflow id )
oozie job -oozie http://<oozie-server-host>:11000 -log <workflow-id>
2. Oozie job status using below command:
oozie job -oozie http://<oozie-server-host>:11000 -info <workflow-id>
Regards,
Chethan YM
Created 10-04-2021 01:28 AM
Hello,
Please find the sample impala oozie action and check if it helps.
1 Create a file impala_invalidate.sh
export PYTHON_EGG_CACHE=/tmp/impala_eggs
impalacmd="impala-shell -k -s impala --quiet --impalad=host-10-17-100-110.coe.cloudera.com:21000"
${impalacmd} --query="show databases;" > /tmp/impala_databases
2 Create the workflow for the shell action
<workflow-app name="Impala_redirect" xmlns="uri
workflow:0.5">
<start to="shell-11a3"/>
<kill name="Kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<action name="shell-11a3">
<shell xmlns="uri
shell-action:0.1">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<exec>impala_invalidate.sh</exec>
<file>/user/systest/lib/impala_invalidate.sh#impala_invalidate.sh</file>
<file>/user/systest/lib/impala.keytab#impala.keytab</file>
<capture-output/>
</shell>
<ok to="End"/>
<error to="Kill"/>
</action>
<end name="End"/>
</workflow-app>
Created 10-10-2021 10:36 PM
@leonid, Has any of replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
Regards,
Vidya Sargur,