Hue Oozie: could not locate Oozie sharelib

[#1]

I have installed Hue 2.6 on my HDP 2.3.4 cluster and am able to submit an Oozie workflow but am receiving the following error. I can see the Oozie sharelib at /usr/hdp/${version}/oozie/oozie-sharelib.tar.gz Where should I move this to or how should I make it visible? I am assuming I need to unzip it since its an archive file.

[#2]

@Mark Thorson

Please follow below command and see if this resolve your issue. Reference doc HERE

/usr/hdp/current/oozie/bin/oozie-setup.sh sharelib create -fs hdfs://<namenode>:8020

To verify that the sharelibs extracted correctly, run the following command:

oozie admin -oozie http://<oozie server host address>:11000/oozie -shareliblist

[#3]

@Jitendra Yadav Here is the output of the oozie admin command. It looks like it has the right components. Can you see anything that is configured incorrectly? Let me know if you need any more information.

[#4]

@Mark Thorson

Hue and oozie server logs please?

[#5]

Logs

2016-05-17 11:00:35,499  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] Start action [0000004-160517093842033-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2016-05-17 11:00:35,502  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] [***0000004-160517093842033-oozie-oozi-W@:start:***]Action status=DONE
2016-05-17 11:00:35,502  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] [***0000004-160517093842033-oozie-oozi-W@:start:***]Action updated in DB!
2016-05-17 11:00:35,547  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W@:start:
2016-05-17 11:00:35,547  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,558  INFO ActionStartXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Start action [0000004-160517093842033-oozie-oozi-W@TestHive2] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2016-05-17 11:00:35,624  WARN ActionStartXCommand:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Error starting action [TestHive2]. ErrorType [FAILED], ErrorCode [EJ001], Message [Could not locate Oozie sharelib]
org.apache.oozie.action.ActionExecutorException: Could not locate Oozie sharelib
	at org.apache.oozie.action.hadoop.JavaActionExecutor.addSystemShareLibForAction(JavaActionExecutor.java:730)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.addAllShareLibs(JavaActionExecutor.java:825)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:816)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1044)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1293)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:250)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
	at org.apache.oozie.command.XCommand.call(XCommand.java:286)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
2016-05-17 11:00:35,624  WARN ActionStartXCommand:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Failing Job due to failed action [TestHive2]
2016-05-17 11:00:35,625  WARN LiteWorkflowInstance:523 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] Workflow Failed. Failing node [TestHive2]
2016-05-17 11:00:35,652  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[0000004-160517093842033-oozie-oozi-W@TestHive2] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W@TestHive2
2016-05-17 11:00:35,655  INFO KillXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] STARTED WorkflowKillXCommand for jobId=0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,660  INFO KillXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[admin] GROUP[-] TOKEN[] APP[TestHive2] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] ENDED WorkflowKillXCommand for jobId=0000004-160517093842033-oozie-oozi-W
2016-05-17 11:00:35,660  INFO WorkflowNotificationXCommand:520 - SERVER[irxvlndchad1.corp.irco.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-160517093842033-oozie-oozi-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000004-160517093842033-oozie-oozi-W

[#6]

Can you please set below property in your workflow and see if that works? @Mark Thorson

oozie.use.system.libpath=true

[#7]

@Jitendra Yadav I added the property below but am still receiving the same error (and log output) as before. Do I need to specify where the Oozie Sharelib is?

[#8]

Hi,

What is the output of:

oozie admin -oozie http://localhost:11000/oozie -shareliblist

You should also be able to see :- hadoop fs -ls /user/oozie/share/lib/lib_<timestamp>/

What is hue setup to use in your job.properties & workflow.xml?

Thanks

Dave

[#9]

@dgoodhand

Job Properties: NA

Workflow.xml

Output of Oozie admin query mentioned above

[#10 · Accepted solution]

I found the Oozie sharelib files at /user/oozie/share/lib (the default location for them - source) How can tell this to Hue? @Jitendra Yadav @dgoodhand