Member since
05-09-2017
6
Posts
0
Kudos Received
0
Solutions
05-27-2017
09:25 AM
Hi everyone ! I'm trying to Schedule a shell submit job using oozie, and a python programm and I'm having this error. Can you please tell me wha could be the issues to solve it
... View more
Labels:
05-16-2017
09:02 AM
017-05-15 06:18:04,038 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] Start action [0000036-170514215031505-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-05-15 06:18:04,048 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] [***0000036-170514215031505-oozie-oozi-W@:start:***]Action status=DONE
2017-05-15 06:18:04,048 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] [***0000036-170514215031505-oozie-oozi-W@:start:***]Action updated in DB!
2017-05-15 06:18:04,168 INFO WorkflowNotificationXCommand:520 - SERVER[sandbox.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000036-170514215031505-oozie-oozi-W@:start:
2017-05-15 06:18:04,168 INFO WorkflowNotificationXCommand:520 - SERVER[sandbox.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000036-170514215031505-oozie-oozi-W
2017-05-15 06:18:04,199 INFO ActionStartXCommand:520 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000036-170514215031505-oozie-oozi-W] ACTION[0000036-170514215031505-oozie-oozi-W@spark_1] Start action [0000036-170514215031505-oozie-oozi-W@spark_1] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
... View more
05-15-2017
02:15 PM
When I try to deploy an oozie scheduler on hdp using a spark action I get this error: [15 mai 2017 à 15:11:10 UTC+1] Zakaria Azelmad (zazelmad@octo.com) : 2017-05-15 04:51:30,054 WARN SparkActionExecutor:523 - SERVER[sandbox.hortonworks.com] USER[maria_dev] GROUP[-] TOKEN[] APP[facebook] JOB[0000032-170514215031505-oozie-oozi-W] ACTION[0000032-170514215031505-oozie-oozi-W@spark_1] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1] The Xml file : What could be the solutions please, thank you !
... View more
Labels:
05-09-2017
03:03 PM
but we need a connector to do this : 'org.apache.hadoop.hbase.spark' how can we install it ?
... View more
05-09-2017
09:57 AM
I tried to use this jar " spark-hbase-connector-2.10-0.9.jar " but It works only for scala, and I need to make it work for pyspark. So please what are the structure of the commands I should use to make it work for pyspark.
... View more
Labels: