Support Questions

Find answers, ask questions, and share your expertise

Hue Oozie: could not locate Oozie sharelib

Contributor

I have installed Hue 2.6 on my HDP 2.3.4 cluster and am able to submit an Oozie workflow but am receiving the following error. I can see the Oozie sharelib at /usr/hdp/${version}/oozie/oozie-sharelib.tar.gz Where should I move this to or how should I make it visible? I am assuming I need to unzip it since its an archive file.

4283-hue-oozie-error-3.jpg

4282-hue-oozie-error-2.jpg

1 ACCEPTED SOLUTION

Contributor

I found the Oozie sharelib files at /user/oozie/share/lib (the default location for them - source) How can tell this to Hue? @Jitendra Yadav @dgoodhand

View solution in original post

12 REPLIES 12

@Mark Thorson

Please follow below command and see if this resolve your issue. Reference doc HERE

/usr/hdp/current/oozie/bin/oozie-setup.sh sharelib create -fs hdfs://<namenode>:8020

To verify that the sharelibs extracted correctly, run the following command:

oozie admin -oozie http://<oozie server host address>:11000/oozie -shareliblist

Contributor

@Jitendra Yadav Here is the output of the oozie admin command. It looks like it has the right components. Can you see anything that is configured incorrectly? Let me know if you need any more information.

4287-hue-oozie-error-4.jpg

@Mark Thorson

Hue and oozie server logs please?

Contributor

Logs

2016-05-17 11:00:35,499  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] Start action [0000004-160517093842033-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2016-05-17 11:00:35,502  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] [***0000004-160517093842033-oozie-oozi-W@:start:***]Action status=DONE
2016-05-17 11:00:35,502  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] [***0000004-160517093842033-oozie-oozi-W@:start:***]Action updated in DB!
2016-05-17 11:00:35,547  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W@:start:
2016-05-17 11:00:35,547  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,558  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Start action [0000004-160517093842033-oozie-oozi-W@TestHive2] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2016-05-17 11:00:35,624  WARN ActionStartXCommand:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Error starting action [TestHive2]. ErrorType [FAILED], ErrorCode [EJ001], Message [Could not locate Oozie sharelib]
org.apache.oozie.action.ActionExecutorException: Could not locate Oozie sharelib
	at org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:730)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:825)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:816)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1044)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1293)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:250)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
2016-05-17 11:00:35,624  WARN ActionStartXCommand:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Failing Job due to failed action [TestHive2]
2016-05-17 11:00:35,625  WARN LiteWorkflowInstance:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Workflow Failed. Failing node [TestHive2]
2016-05-17 11:00:35,652  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W@TestHive2
2016-05-17 11:00:35,655  INFO KillXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] STARTED WorkflowKillXCommand for jobId=0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,660  INFO KillXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] ENDED WorkflowKillXCommand for jobId=0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,660  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W

Can you please set below property in your workflow and see if that works? @Mark Thorson

oozie.use.system.libpath=true

Contributor

@Jitendra Yadav I added the property below but am still receiving the same error (and log output) as before. Do I need to specify where the Oozie Sharelib is?

Explorer

Hi,

What is the output of:

oozie admin -oozie http://localhost:11000/oozie -shareliblist

You should also be able to see :- hadoop fs -ls /user/oozie/share/lib/lib_<timestamp>/

What is hue setup to use in your job.properties & workflow.xml?

Thanks

Dave

Contributor

@dgoodhand

Job Properties: NA

4286-hue-oozie-error-jobprop.jpg

Workflow.xml

4285-hue-oozie-error-workflow.jpg

Output of Oozie admin query mentioned above

4284-hue-oozie-error-4.jpg

Contributor

I found the Oozie sharelib files at /user/oozie/share/lib (the default location for them - source) How can tell this to Hue? @Jitendra Yadav @dgoodhand

Contributor

Anything else I can try to fix this error? I have not been able to find anything to solve my problem yet. @Jitendra Yadav @dgoodhand

Contributor

I was able to resolve my problem. By running the command below (link to source). The issue was when I issued an Oozie command the system was getting confused and didn't know where to look for the sharedlib files (defaulted to localhost). This way it set the URL and allowed it to communicate with oozie to find the files.

$ export OOZIE_URL=http://FQDNofmycluster:11000/oozie

Explorer

Do you have your oozie-site to hand and also the configuration tab in Hue from the screenshot you show the workflow.xml?

,

The sharelib looks fine, what does your hue.ini file look like, and if you go to the configuration tab in oozie (when you showed the screenshot of the XML)