Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Oozie -run of Java action creates directory "oozie-oozi"

Highlighted

Oozie -run of Java action creates directory "oozie-oozi"

Explorer

This happened when running the Examples java-main. When I do an "oozie job -oozie .... -run", the first time it runs ok and creates empty directory "/user/myuser/oozie-oozi".  The second run fails with a strange error:

     STATUS: ERROR

     Error Code: JA018

     Error Message: begin > end in range (begin, end): (1399402316442, 1399402301896)

 

Note that in those timestamps, the end range is before the beginning. I have no idea how that could be - I'm not (knowingly) setting any date/time ranges anywhere. If I manuallly "hdfs fs -rm -r -skipTrash oozie-oozi", then the next runs succeeds.I tried to do the delete in a <prepare> in the <java> action, but that just hung the job. Any ideas on how to get around this?  CDH5.0.0, Oozie 4.0.0

Thanks

Pete

3 REPLIES 3
Highlighted

Re: Oozie -run of Java action creates directory "oozie-oozi"

Master Guru
Could you post your Oozie server log here after reproducing the issue one more time?

Can you also post your full "oozie job" command, including contents of your passed job.properties?

I am assuming the example java-main/workflow.xml is unmodified in the runs.
Highlighted

Re: Oozie -run of Java action creates directory "oozie-oozi"

Explorer

Was this ever resolved? I am seeing the same error:

 

Error Code: JA018

Error Msg: begin > end in range (begin, end): (1410364097531, 1410363934162)

External ID: job_1408628138406_6781

---------------------

CDH5.0.0, Oozie 4.0.0

---------------------

oozie job -oozie http://reuxeuls497:11000/oozie -config ./job.properties -run

---------------------

 

job.properties:

nameNode=hdfs://reuxeuls497:8020
jobTracker=reuxeuls497:8032
queueName=default
examplesRoot=examples

oozie.wf.application.path=${nameNode}/examples/examples/apps/sqoop-import
outputDir=sqoop-import-002

---------------------

workflow.xml:

<?xml version="1.0" encoding="UTF-8"?>
<workflow-app xmlns="uri:oozie:workflow:0.2" name="wf-sqoop-import">
<start to="sqoop-node"/>

<action name="sqoop-node">
<sqoop xmlns="uri:oozie:sqoop-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>

<configuration>
<property>
<name>mapred.job.queue.name</name>
<value>${queueName}</value>
</property>
</configuration>
<command>version</command>
</sqoop>

<ok to="end"/>
<error to="fail"/>
</action>

<kill name="fail">
<message>Sqoop import failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>

---------------------

extract from oozie log:

2014-09-10 11:31:16,591 INFO org.apache.oozie.action.hadoop.SqoopActionExecutor: SERVER[reuxeuls497] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[0000007-140908155329336-oozie-oozi-W@sqoop-node] action completed, external ID [job_1408628138406_6780]
2014-09-10 11:31:16,605 WARN org.apache.oozie.action.hadoop.SqoopActionExecutor: SERVER[reuxeuls497] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[0000007-140908155329336-oozie-oozi-W@sqoop-node] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.SqoopMain], main() threw exception, begin > end in range (begin, end): (1410363054502, 1410362832726)
2014-09-10 11:31:16,605 WARN org.apache.oozie.action.hadoop.SqoopActionExecutor: SERVER[reuxeuls497] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[0000007-140908155329336-oozie-oozi-W@sqoop-node] Launcher exception: begin > end in range (begin, end): (1410363054502, 1410362832726)
java.lang.IllegalArgumentException: begin > end in range (begin, end): (1410363054502, 1410362832726)

at org.apache.hadoop.yarn.api.protocolrecords.impl.pb.GetApplicationsRequestPBImpl.setStartRange(GetApplicationsRequestPBImpl.java:342)
at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.getChildYarnJobs(LauncherMainHadoopUtils.java:56)
at org.apache.oozie.action.hadoop.LauncherMainHadoopUtils.killChildYarnJobs(LauncherMainHadoopUtils.java:87)
at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:165)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:38)
at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:45)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:226)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

2014-09-10 11:31:16,767 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[reuxeuls497] USER[oozie] GROUP[-] TOKEN[] APP[wf-sqoop-import] JOB[0000007-140908155329336-oozie-oozi-W] ACTION[0000007-140908155329336-oozie-oozi-W@sqoop-node] ERROR is considered as FAILED for SLA

 

Any help appreciated.

 

Thanks

Pete

Highlighted

Re: Oozie -run of Java action creates directory "oozie-oozi"

Master Guru
One reason this could happen is if you have a clock skew in your cluster, between the Oozie server host and the rest of the nodes (such as your NodeManagers). See https://issues.apache.org/jira/browse/OOZIE-1837
Don't have an account?
Coming from Hortonworks? Activate your account here