Reply
New Contributor
Posts: 4
Registered: ‎05-15-2014

Start oozie job with indexoutofboundsexception error in CDH5.0 version.

Hi all,

 

I just installed CDH5 with Cloudera Manager and hbase, hdfs, hive, pig can work fine. 

 

But, when it comes to oozie, there is the following problem:

 

no matter I start the job in HUE PIG or in command line , there is the IndexOutOfBoundsException as showin in the following.  Please help.  Thanks.

 

2014-05-29 11:57:10,983 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@:start:] Start action [0000006-140528172104360-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-05-29 11:57:10,983 WARN org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@:start:] [***0000006-140528172104360-oozie-oozi-W@:start:***]Action status=DONE
2014-05-29 11:57:10,983 WARN org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@:start:] [***0000006-140528172104360-oozie-oozi-W@:start:***]Action updated in DB!
2014-05-29 11:57:11,152 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@mr-node] Start action [0000006-140528172104360-oozie-oozi-W@mr-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-05-29 11:57:11,384 WARN org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@mr-node] Error starting action [mr-node]. ErrorType [ERROR], ErrorCode [IndexOutOfBoundsException], Message [IndexOutOfBoundsException: Index: 0, Size: 0]
org.apache.oozie.action.ActionExecutorException: IndexOutOfBoundsException: Index: 0, Size: 0
at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:401)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:909)
at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1065)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:217)
at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:62)
at org.apache.oozie.command.XCommand.call(XCommand.java:280)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:635)
at java.util.ArrayList.get(ArrayList.java:411)
at org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:538)
at org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:630)
at org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:621)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:816)
... 10 more
2014-05-29 11:57:11,385 WARN org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@mr-node] Setting Action Status to [DONE]
2014-05-29 11:57:11,536 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@mr-node] ERROR is considered as FAILED for SLA
2014-05-29 11:57:11,703 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@fail] Start action [0000006-140528172104360-oozie-oozi-W@fail] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-05-29 11:57:11,704 WARN org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@fail] [***0000006-140528172104360-oozie-oozi-W@fail***]Action status=DONE
2014-05-29 11:57:11,704 WARN org.apache.oozie.command.wf.ActionStartXCommand: SERVER[SGH1VHDP01.cn.int.tgr.net] USER[oozie] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000006-140528172104360-oozie-oozi-W] ACTION[0000006-140528172104360-oozie-oozi-W@fail] [***0000006-140528172104360-oozie-oozi-W@fail***]Action updated in DB!

New Contributor
Posts: 4
Registered: ‎05-15-2014

Re: Start oozie job with indexoutofboundsexception error in CDH5.0 version.

 

It failed at the start phase, not related to the job itself. 

 

However, the job I ran in command line is :

 

oozie job -oozie http://localhost:11000/oozie -config /opt/examples/apps/map-reduce/job.properties -run
 
 
Highlighted
New Contributor
Posts: 5
Registered: ‎06-18-2014

Re: Start oozie job with indexoutofboundsexception error in CDH5.0 version.

Hi PeterPan,

I'm having the same issue. I'd be interested if you found a solution or if the community can help.
Cloudera Employee
Posts: 322
Registered: ‎01-16-2014

Re: Start oozie job with indexoutofboundsexception error in CDH5.0 version.

This is a known issue if you have not deployed your shared libraries correctly. There is a knowledge base article for this on the support site with the title 'Oozie Actions Failing with IndexOutOfBoundsException for Shared Libraries' The solution is in the KB for a cluster with or without Cloudera Manager

This is the reason:

Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:635)
at java.util.ArrayList.get(ArrayList.java:411)
at org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:538)
at org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:630)
at org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:621)
at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:816

Wilfred

New Contributor
Posts: 5
Registered: ‎06-18-2014

Re: Start oozie job with indexoutofboundsexception error in CDH5.0 version.

Many thanks Wilfred. I don't have access to the KB but does this blog post explain it?

 

http://blog.cloudera.com/blog/2014/05/how-to-use-the-sharelib-in-apache-oozie-cdh-5

 

The shared library has been deployed, but as you say, perhaps it is not correctly deployed.

 

Many thanks,

marshall2k

Cloudera Employee
Posts: 322
Registered: ‎01-16-2014

Re: Start oozie job with indexoutofboundsexception error in CDH5.0 version.

Yes that blog post also covers it. Please make sure that the shared libs are deployed correctly and that they are forr the correct version: MR1 or YARN (MR2)

The shared libs are using a differnt structure in CDH 5 so you can not use the CDH 4 version.

 

Wilfred