Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

HUE Oozie ShellMain error

avatar
Rising Star

Hi!

 

I am using CDH 5.4.7 and I am struggling with Oozie in HUE using Shell snippet. 

 

My script contains only one line:

spark-submit --class cz.tmobile.surovecv.desms.DESMS --master yarn-client /home/ovasicek/DESMS_Parser-1.3-SNAPSHOT.jar $1 $2 $3 $4 $5

and every time I run the Oozie workflow, I am getting this error:

 Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]

and there is nothing helpful in the logs either.

 

I have put the .jar file into the workflow directory and .jar file is also accessible from the local disk. I don't know what can be wrong. If I run the exactly the same command from the command line, the command is successfully finished.

 

The stdout logs is ended by this:

>>> Invoking Shell command line now >>

Exit code of the Shell command 101
<<< Invocation of Shell command completed <<<


<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]

Oozie Launcher failed, finishing Hadoop job gracefully

Oozie Launcher, uploading action data to HDFS sequence file: hdfs://cloudcz.novalocal:8020/user/ovasicek/oozie-oozi/0000003-160217171518005-oozie-oozi-W/shell-f004--shell/action-data.seq

Oozie Launcher ends

 

Can you please help me?

 

Thank you very much!

Václav Surovec 

Who agreed with this topic