mmoumen
mmoumen
Explorer

Problem with submitting oozie job with a python pr...

by Explorer mmoumen in Support Questions
‎05-27-2017 09:25 AM
‎05-27-2017 09:25 AM
Hi everyone ! I'm trying to Schedule a shell submit job using oozie, and a python programm and I'm having this error. Can you please tell me wha could be the issues to solve it ... View more
Labels:

Re: Run Oozie using spark action error

by Explorer mmoumen in Support Questions
‎05-16-2017 09:02 AM
‎05-16-2017 09:02 AM
017-05-15 06:18:04,038 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] Start action [0000036-170514215031505-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2017-05-15 06:18:04,048 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] [***0000036-170514215031505-oozie-oozi-W@:start:***]Action status=DONE 2017-05-15 06:18:04,048 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] [***0000036-170514215031505-oozie-oozi-W@:start:***]Action updated in DB! 2017-05-15 06:18:04,168 INFO WorkflowNotificationXCommand:520 - SERVER[sandbox.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000036-170514215031505-oozie-oozi-W@:start: 2017-05-15 06:18:04,168 INFO WorkflowNotificationXCommand:520 - SERVER[sandbox.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000036-170514215031505-oozie-oozi-W 2017-05-15 06:18:04,199 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@spark_1] Start action [0000036-170514215031505-oozie-oozi-W@spark_1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] ... View more

Re: Run Oozie using spark action error

by Explorer mmoumen in Support Questions
‎05-15-2017 04:24 PM
‎05-15-2017 04:24 PM
I'm using the 2.6 version ... View more

Run Oozie using spark action error

by Explorer mmoumen in Support Questions
‎05-15-2017 02:15 PM
‎05-15-2017 02:15 PM
When I try to deploy an oozie scheduler on hdp using a spark action I get this error: [15 mai 2017 à 15:11:10 UTC+1] Zakaria Azelmad (zazelmad@octo.com) : 2017-05-15 04:51:30,054 WARN SparkActionExecutor:523 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000032-170514215031505-oozie-oozi-W] ACTION[0000032-170514215031505-oozie-oozi-W@spark_1] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1] The Xml file : What could be the solutions please, thank you ! ... View more

Re: Failed to connect Hbase to Pyspark

by Explorer mmoumen in Support Questions
‎05-09-2017 03:03 PM
‎05-09-2017 03:03 PM
but we need a connector to do this : 'org.apache.hadoop.hbase.spark' how can we install it ? ... View more

Failed to connect Hbase to Pyspark

by Explorer mmoumen in Support Questions
‎05-09-2017 09:57 AM
‎05-09-2017 09:57 AM
I tried to use this jar " spark-hbase-connector-2.10-0.9.jar " but It works only for scala, and I need to make it work for pyspark. So please what are the structure of the commands I should use to make it work for pyspark. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎05-29-2017 11:04 AM
Public Statistics
Date Registered ‎05-09-2017 09:56 AM
Last Visited ‎05-29-2017 11:04 AM
Total Messages Posted 6