question Re: Couldn't start Hive job in Oozie over Workflow-manager in Archives of Support Questions (Read Only)

Couldn't start Hive job in Oozie over Workflow-manager

yrawekumarr — Fri, 16 Sep 2022 13:54:45 GMT

A simple Hive query "use dbname; show tables;" is failing. It would be great help to provide your thoughts. Thanks.

USER[admin] GROUP[-] TOKEN[] APP[CreateHiveSchema] JOB[0000030-181115165802518-oozie-oozi-W] ACTION[0000030-181115165802518-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [IllegalArgumentException], Message [IllegalArgumentException: Can not create a Path from an empty string]
org.apache.oozie.action.ActionExecutorException: IllegalArgumentException: Can not create a Path from an empty string
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1258)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Re: Couldn't start Hive job in Oozie over Workflow-manager

yrawekumarr — Tue, 20 Nov 2018 13:16:43 GMT

Above error with Query option whereas Script option (.hql) is throwing below error. I already created /user/admin with required permissions (chown admin:hdfs) but still getting error.

USER[admin] GROUP[-] TOKEN[] APP[TestHive1] JOB[0000034-181115165802518-oozie-oozi-W] ACTION[0000034-181115165802518-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [TRANSIENT], ErrorCode [JA009], Message [JA009: Directory/File does not exist /user/admin/.staging/job_1542322485217_0046/job.split]
org.apache.oozie.action.ActionExecutorException: JA009: Directory/File does not exist /user/admin/.staging/job_1542322485217_0046/job.split
	at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:463)
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:437)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1258)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:331)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:260)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

Re: Couldn't start Hive job in Oozie over Workflow-manager

yrawekumarr — Tue, 20 Nov 2018 13:16:56 GMT

Here is the workflow

<?xml version="1.0" encoding="UTF-8" standalone="no"?> <workflow-app xmlns="uri:oozie:workflow:0.5" name="TestHive1"> <start to="hive_1"/> <action name="hive_1"> <hive xmlns="uri:oozie:hive-action:0.6"> <job-tracker>${resourceManager}</job-tracker> <name-node>${nameNode}</name-node> <job-xml>/user/admin/apps/oozie/conf/hive-site.xml</job-xml> <configuration> <property> <name>oozie.libpath</name> <value>http://host1:8020/user/oozie/share/lib/</value> </property> </configuration> <script>/user/admin/apps/oozie/conf/test.hql</script> <file>/user/admin/apps/oozie/conf/test.hql</file> </hive> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>${wf:errorMessage(wf:lastErrorNode())}</message> </kill> <end name="end"/> </workflow-app>

Re: Couldn't start Hive job in Oozie over Workflow-manager

yrawekumarr — Wed, 21 Nov 2018 01:11:07 GMT

Resolved this issue! it worked with Hive2 action with Cluster configuration - Local cluster instead of custom.