Support Questions
Find answers, ask questions, and share your expertise

Impala-shell in oozie doesn't work

New Contributor

Hello, trying to execute simple shell oozie action

 

echo "start"

impala-shell -q"invalidate metadata" query using ooze

echo "end"

 

In logs I see "start" "end" - but nothing related to impala-shell.

Query was not executed either. On edge node query works perfectly.

Wtf could somebody explain please, as previously I used self made impala launcher which worked perfectly - not like this oozie.

3 REPLIES 3

Expert Contributor

Hi ,

 

Can you provide the complete oozie workflow.xml and the script you are using to run this job.

 

1. you can collect the oozie logs for this particular workflow using below command: ( Replace the workflow id )

oozie job -oozie http://<oozie-server-host>:11000 -log <workflow-id>

 

2. Oozie job status using below command:

oozie job -oozie http://<oozie-server-host>:11000 -info <workflow-id>

 

Regards,

Chethan YM

 

 

Cloudera Employee

Hello,

 

Please find the sample impala oozie action and check if it helps.

 

1 Create a file  impala_invalidate.sh 

 

export PYTHON_EGG_CACHE=/tmp/impala_eggs

impalacmd="impala-shell -k -s impala --quiet --impalad=host-10-17-100-110.coe.cloudera.com:21000"

${impalacmd} --query="show databases;" > /tmp/impala_databases

 

2 Create the workflow for the shell action

<workflow-app name="Impala_redirect" xmlns="uri

 

workflow:0.5">

  <start to="shell-11a3"/>

  <kill name="Kill">

    <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>

  </kill>

  <action name="shell-11a3">

    <shell xmlns="uri

 

shell-action:0.1">

      <job-tracker>${jobTracker}</job-tracker>

      <name-node>${nameNode}</name-node>

      <exec>impala_invalidate.sh</exec>

      <file>/user/systest/lib/impala_invalidate.sh#impala_invalidate.sh</file>

      <file>/user/systest/lib/impala.keytab#impala.keytab</file>

       <capture-output/>

    </shell>

    <ok to="End"/>

    <error to="Kill"/>

  </action>

  <end name="End"/>

</workflow-app>

 

Community Manager

@leonid, Has any of replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. 


Regards,

Vidya Sargur,
Community Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community: