Support Questions
Find answers, ask questions, and share your expertise

Unable to start HIVE job with Oozie

Highlighted

Unable to start HIVE job with Oozie

Explorer

Hello, I am trying to run a HIVE job with Oozie and keeps getting the same error message. The hql script works fine when running in Hive, so I am sure the problem is not the script, but it's in Oozie. I am using the sandbox for this. Any guidance will be great. I can't find much tutorial for running oozie-hive on the sandbox and the only tutorial I can find doesn't work.

WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000081-180930024054767-oozie-oozi-W] ACTION[0000081-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.oozie.action.hadoop.JavaActionExecutor.addToCache(JavaActionExecutor.java:640) at org.apache.oozie.action.hadoop.ScriptLanguageActionExecutor.addScriptToCache(ScriptLanguageActionExecutor.java:97) at org.apache.oozie.action.hadoop.ScriptLanguageActionExecutor.setupLauncherConf(ScriptLanguageActionExecutor.java:55) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:973)

<?xml version="1.0" encoding="UTF-8" standalone="no"?><workflow-app xmlns="uri:oozie:workflow:0.5" name="TestWorkflow">
    <start to="hive_1"/>
    <action name="hive_1">
        <hive xmlns="uri:oozie:hive-action:0.6">
            <job-tracker>${resourceManager}</job-tracker>
            <name-node>${nameNode}</name-node>
            <job-xml>/user/root/hive-site.xml</job-xml>
            <script>/user/root/Hive Query Test.hql</script>
        </hive>
        <ok to="end"/>
        <error to="kill"/>
    </action>
    <kill name="kill">
        <message>${wf:errorMessage(wf:lastErrorNode())}</message>
    </kill>
    <end name="end"/>
</workflow-app>
4 REPLIES 4
Highlighted

Re: Unable to start HIVE job with Oozie

Explorer

Hi Can you post your job.properties as well,

There will be several reasons for Null Pointer exception it is not a actual exception , could you please check in /var/log/oozie for actual exception.

and this is my workflow..please try this

<?xml version="1.0" encoding="UTF-8" standalone="no"?><workflow-app xmlns="uri:oozie:workflow:0.5" name="anji_test">
  
  <start to="hive"/>
  <action name="hive">
    <hive xmlns="uri:oozie:hive-action:0.2">
      <job-tracker>${jobTracker}</job-tracker>
      <name-node>${nameNode}</name-node>
      <script>${nameNode}/sample/hive.hql</script>
    </hive>
    <ok to="end"/>
    <error to="kill"/>
  </action>
  <kill name="kill">
    <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
  </kill>
  <end name="end"/>
</workflow-app>


Re: Unable to start HIVE job with Oozie

Explorer

@AnjiReddy Anumolu

I tried your workflow but still got the same error. I suspect it is a configuration issue ? but don't know what it is.

Here is the job properties:

NameValue
oozie.use.system.libpathfalse
oozie.wf.application.pathhdfs://sandbox-hdp.hortonworks.com:8020/user/root/TestWorkflow.xml
user.nameadmin
jobTrackersandbox-hdp.hortonworks.com:8032
oozie.wf.rerun.failnodesfalse
mapreduce.job.user.nameadmin
resourceManagersandbox-hdp.hortonworks.com:8032
nameNodehdfs://sandbox-hdp.hortonworks.com:8020

Here is the log from /var/log/oozie

2018-10-05 01:03:40,167  WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[PUT http://sandbox-hdp.hortonworks.com:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [Multiple app paths specified, only one is allowed]
org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [Multiple app paths specified, only one is allowed]
	at org.apache.oozie.servlet.ServletUtilities.ValidateAppPath(ServletUtilities.java:78)
	at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:257)
	at org.apache.oozie.servlet.BaseJobServlet.doPut(BaseJobServlet.java:133)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:730)
	at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:304)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576)
	at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610)
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503)
	at java.lang.Thread.run(Thread.java:748)
2018-10-05 01:03:59,683  WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[PUT http://sandbox-hdp.hortonworks.com:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [Multiple app paths specified, only one is allowed]
org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [Multiple app paths specified, only one is allowed]
	at org.apache.oozie.servlet.ServletUtilities.ValidateAppPath(ServletUtilities.java:78)
	at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:257)
	at org.apache.oozie.servlet.BaseJobServlet.doPut(BaseJobServlet.java:133)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:730)
	at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:304)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576)
	at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610)
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503)
	at java.lang.Thread.run(Thread.java:748)
2018-10-05 01:05:14,732  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:05:14,742  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:05:22,207  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:05:22,217  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:05:42,256  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000140-180930024054767-oozie-oozi-W] ACTION[0000140-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null]
org.apache.oozie.action.ActionExecutorException: NullPointerException: null
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1258)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
2018-10-05 01:05:42,259  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000140-180930024054767-oozie-oozi-W] ACTION[0000140-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE]
2018-10-05 01:09:09,691  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:09:09,700  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:09:18,269  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:09:18,276  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:09:45,389  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000142-180930024054767-oozie-oozi-W] ACTION[0000142-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null]
org.apache.oozie.action.ActionExecutorException: NullPointerException: null
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1258)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
2018-10-05 01:09:45,391  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000142-180930024054767-oozie-oozi-W] ACTION[0000142-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE]
2018-10-05 01:11:11,553  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:11:11,561  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:11:21,539  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:11:21,558  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:11:40,347  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null]
org.apache.oozie.action.ActionExecutorException: NullPointerException: null
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
2018-10-05 01:11:40,352  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE]
2018-10-05 01:18:41,743  WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[GET http://sandbox-hdp-security:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [action]
org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [action]
	at org.apache.oozie.servlet.JsonRestServlet.validateRestUrl(JsonRestServlet.java:448)
	at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:294)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576)
	at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610)
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503)
	at java.lang.Thread.run(Thread.java:748)
2018-10-05 01:18:51,416  WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[GET http://sandbox-hdp-security:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [action]
org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [action]
	at org.apache.oozie.servlet.JsonRestServlet.validateRestUrl(JsonRestServlet.java:448)
	at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:294)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617)
	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576)
	at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
	at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
	at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610)
	at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503)
	at java.lang.Thread.run(Thread.java:748)
2018-10-05 01:21:46,339  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[] The application does not define formal parameters in its XML definition
2018-10-05 01:21:46,346  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:22:05,542  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null]
org.apache.oozie.action.ActionExecutorException: NullPointerException: null
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
2018-10-05 01:22:05,542  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE]
2018-10-05 01:24:21,892  WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition
2018-10-05 01:24:21,899  WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist
2018-10-05 01:24:46,623  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000145-180930024054767-oozie-oozi-W] ACTION[0000145-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null]
org.apache.oozie.action.ActionExecutorException: NullPointerException: null
	at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188)
	at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234)
	at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280)
	at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244)
	at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56)
	at org.apache.oozie.command.XCommand.call(XCommand.java:287)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException
2018-10-05 01:24:46,635  WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000145-180930024054767-oozie-oozi-W] ACTION[0000145-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE]



Highlighted

Re: Unable to start HIVE job with Oozie

Explorer

OK. I got it working. It is because I have "space" with my script path: <script>/user/root/Hive Query Test.hql</script>

So I simply removed the space in the script name to HiveQueryTest.hql and now it works. I was hoping the error message would be more clear and easier to debug.

Highlighted

Re: Unable to start HIVE job with Oozie

New Contributor
Run Hive Jobs with Oozie
  1. Specify the hive-site.xml in the job-xml parameter.
  2. Specify the name of the script (for example, script.q ) that contains the hive query in the script parameter.
  3. Optionally, add properties used by the Oozie launcher job. Add the prefix oozie.launcher to the property names.

 

see here Dgcustomefirst