Support Questions
Find answers, ask questions, and share your expertise

Run Oozie using spark action error

Run Oozie using spark action error

Explorer

When I try to deploy an oozie scheduler on hdp using a spark action I get this error:

[15 mai 2017 à 15:11:10 UTC+1] Zakaria Azelmad (zazelmad@octo.com) : 2017-05-15 04:51:30,054 WARN SparkActionExecutor:523 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000032-170514215031505-oozie-oozi-W] ACTION[0000032-170514215031505-oozie-oozi-W@spark_1] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1]

The Xml file :

What could be the solutions please, thank you !

4 REPLIES 4
Highlighted

Re: Run Oozie using spark action error

What version of HDP are you using?

Highlighted

Re: Run Oozie using spark action error

Explorer

I'm using the 2.6 version

Highlighted

Re: Run Oozie using spark action error

Explorer
@Meryem Moumen

Can you post the yarn application log for Oozie launcher and the the application launched for the spark job?

Highlighted

Re: Run Oozie using spark action error

Explorer

017-05-15 06:18:04,038 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] Start action [0000036-170514215031505-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2017-05-15 06:18:04,048 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] [***0000036-170514215031505-oozie-oozi-W@:start:***]Action status=DONE 2017-05-15 06:18:04,048 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] [***0000036-170514215031505-oozie-oozi-W@:start:***]Action updated in DB! 2017-05-15 06:18:04,168 INFO WorkflowNotificationXCommand:520 - SERVER[sandbox.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000036-170514215031505-oozie-oozi-W@:start: 2017-05-15 06:18:04,168 INFO WorkflowNotificationXCommand:520 - SERVER[sandbox.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000036-170514215031505-oozie-oozi-W 2017-05-15 06:18:04,199 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@spark_1] Start action [0000036-170514215031505-oozie-oozi-W@spark_1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]