Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hue Oozie: could not locate Oozie sharelib

Solved Go to solution

Hue Oozie: could not locate Oozie sharelib

Contributor

I have installed Hue 2.6 on my HDP 2.3.4 cluster and am able to submit an Oozie workflow but am receiving the following error. I can see the Oozie sharelib at /usr/hdp/${version}/oozie/oozie-sharelib.tar.gz Where should I move this to or how should I make it visible? I am assuming I need to unzip it since its an archive file.

4283-hue-oozie-error-3.jpg

4282-hue-oozie-error-2.jpg

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Contributor

I found the Oozie sharelib files at /user/oozie/share/lib (the default location for them - source) How can tell this to Hue? @Jitendra Yadav @dgoodhand

View solution in original post

12 REPLIES 12
Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

@Mark Thorson

Please follow below command and see if this resolve your issue. Reference doc HERE

/usr/hdp/current/oozie/bin/oozie-setup.sh sharelib create -fs hdfs://<namenode>:8020

To verify that the sharelibs extracted correctly, run the following command:

oozie admin -oozie http://<oozie server host address>:11000/oozie -shareliblist

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Contributor

@Jitendra Yadav Here is the output of the oozie admin command. It looks like it has the right components. Can you see anything that is configured incorrectly? Let me know if you need any more information.

4287-hue-oozie-error-4.jpg

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

@Mark Thorson

Hue and oozie server logs please?

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Contributor

Logs

2016-05-17 11:00:35,499  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] Start action [0000004-160517093842033-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2016-05-17 11:00:35,502  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] [***0000004-160517093842033-oozie-oozi-W@:start:***]Action status=DONE
2016-05-17 11:00:35,502  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] [***0000004-160517093842033-oozie-oozi-W@:start:***]Action updated in DB!
2016-05-17 11:00:35,547  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W@:start:
2016-05-17 11:00:35,547  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,558  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Start action [0000004-160517093842033-oozie-oozi-W@TestHive2] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2016-05-17 11:00:35,624  WARN ActionStartXCommand:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Error starting action [TestHive2]. ErrorType [FAILED], ErrorCode [EJ001], Message [Could not locate Oozie sharelib]
org.apache.oozie.action.ActionExecutorException: Could not locate Oozie sharelib
	at org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:730)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:825)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:816)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1044)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1293)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:250)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
2016-05-17 11:00:35,624  WARN ActionStartXCommand:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Failing Job due to failed action [TestHive2]
2016-05-17 11:00:35,625  WARN LiteWorkflowInstance:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Workflow Failed. Failing node [TestHive2]
2016-05-17 11:00:35,652  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W@TestHive2
2016-05-17 11:00:35,655  INFO KillXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] STARTED WorkflowKillXCommand for jobId=0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,660  INFO KillXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] ENDED WorkflowKillXCommand for jobId=0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,660  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W
Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Can you please set below property in your workflow and see if that works? @Mark Thorson

oozie.use.system.libpath=true

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Contributor

@Jitendra Yadav I added the property below but am still receiving the same error (and log output) as before. Do I need to specify where the Oozie Sharelib is?

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Explorer

Hi,

What is the output of:

oozie admin -oozie http://localhost:11000/oozie -shareliblist

You should also be able to see :- hadoop fs -ls /user/oozie/share/lib/lib_<timestamp>/

What is hue setup to use in your job.properties & workflow.xml?

Thanks

Dave

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Contributor

@dgoodhand

Job Properties: NA

4286-hue-oozie-error-jobprop.jpg

Workflow.xml

4285-hue-oozie-error-workflow.jpg

Output of Oozie admin query mentioned above

4284-hue-oozie-error-4.jpg

Highlighted

Re: Hue Oozie: could not locate Oozie sharelib

Contributor

I found the Oozie sharelib files at /user/oozie/share/lib (the default location for them - source) How can tell this to Hue? @Jitendra Yadav @dgoodhand

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here