Created 10-03-2018 05:28 PM
Hello, I am trying to run a HIVE job with Oozie and keeps getting the same error message. The hql script works fine when running in Hive, so I am sure the problem is not the script, but it's in Oozie. I am using the sandbox for this. Any guidance will be great. I can't find much tutorial for running oozie-hive on the sandbox and the only tutorial I can find doesn't work.
WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000081-180930024054767-oozie-oozi-W] ACTION[0000081-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException at org.apache.oozie.action.hadoop.JavaActionExecutor.addToCache(JavaActionExecutor.java:640) at org.apache.oozie.action.hadoop.ScriptLanguageActionExecutor.addScriptToCache(ScriptLanguageActionExecutor.java:97) at org.apache.oozie.action.hadoop.ScriptLanguageActionExecutor.setupLauncherConf(ScriptLanguageActionExecutor.java:55) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:973)
<?xml version="1.0" encoding="UTF-8" standalone="no"?><workflow-app xmlns="uri:oozie:workflow:0.5" name="TestWorkflow"> <start to="hive_1"/> <action name="hive_1"> <hive xmlns="uri:oozie:hive-action:0.6"> <job-tracker>${resourceManager}</job-tracker> <name-node>${nameNode}</name-node> <job-xml>/user/root/hive-site.xml</job-xml> <script>/user/root/Hive Query Test.hql</script> </hive> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>${wf:errorMessage(wf:lastErrorNode())}</message> </kill> <end name="end"/> </workflow-app>
Created 10-04-2018 06:25 AM
Hi Can you post your job.properties as well,
There will be several reasons for Null Pointer exception it is not a actual exception , could you please check in /var/log/oozie for actual exception.
and this is my workflow..please try this
<?xml version="1.0" encoding="UTF-8" standalone="no"?><workflow-app xmlns="uri:oozie:workflow:0.5" name="anji_test"> <start to="hive"/> <action name="hive"> <hive xmlns="uri:oozie:hive-action:0.2"> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <script>${nameNode}/sample/hive.hql</script> </hive> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app>
Created 10-05-2018 01:49 AM
I tried your workflow but still got the same error. I suspect it is a configuration issue ? but don't know what it is.
Here is the job properties:
Name | Value |
---|---|
oozie.use.system.libpath | false |
oozie.wf.application.path | hdfs://sandbox-hdp.hortonworks.com:8020/user/root/TestWorkflow.xml |
user.name | admin |
jobTracker | sandbox-hdp.hortonworks.com:8032 |
oozie.wf.rerun.failnodes | false |
mapreduce.job.user.name | admin |
resourceManager | sandbox-hdp.hortonworks.com:8032 |
nameNode | hdfs://sandbox-hdp.hortonworks.com:8020 |
Here is the log from /var/log/oozie
2018-10-05 01:03:40,167 WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[PUT http://sandbox-hdp.hortonworks.com:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [Multiple app paths specified, only one is allowed] org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [Multiple app paths specified, only one is allowed] at org.apache.oozie.servlet.ServletUtilities.ValidateAppPath(ServletUtilities.java:78) at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:257) at org.apache.oozie.servlet.BaseJobServlet.doPut(BaseJobServlet.java:133) at javax.servlet.http.HttpServlet.service(HttpServlet.java:730) at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:304) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576) at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503) at java.lang.Thread.run(Thread.java:748) 2018-10-05 01:03:59,683 WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[PUT http://sandbox-hdp.hortonworks.com:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [Multiple app paths specified, only one is allowed] org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [Multiple app paths specified, only one is allowed] at org.apache.oozie.servlet.ServletUtilities.ValidateAppPath(ServletUtilities.java:78) at org.apache.oozie.servlet.BaseJobServlet.checkAuthorizationForApp(BaseJobServlet.java:257) at org.apache.oozie.servlet.BaseJobServlet.doPut(BaseJobServlet.java:133) at javax.servlet.http.HttpServlet.service(HttpServlet.java:730) at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:304) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576) at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503) at java.lang.Thread.run(Thread.java:748) 2018-10-05 01:05:14,732 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:05:14,742 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:05:22,207 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:05:22,217 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:05:42,256 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000140-180930024054767-oozie-oozi-W] ACTION[0000140-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1258) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException 2018-10-05 01:05:42,259 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000140-180930024054767-oozie-oozi-W] ACTION[0000140-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE] 2018-10-05 01:09:09,691 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:09:09,700 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:09:18,269 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:09:18,276 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:09:45,389 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000142-180930024054767-oozie-oozi-W] ACTION[0000142-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1258) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException 2018-10-05 01:09:45,391 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000142-180930024054767-oozie-oozi-W] ACTION[0000142-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE] 2018-10-05 01:11:11,553 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:11:11,561 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:11:21,539 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:11:21,558 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:11:40,347 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException 2018-10-05 01:11:40,352 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE] 2018-10-05 01:18:41,743 WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[GET http://sandbox-hdp-security:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [action] org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [action] at org.apache.oozie.servlet.JsonRestServlet.validateRestUrl(JsonRestServlet.java:448) at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:294) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576) at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503) at java.lang.Thread.run(Thread.java:748) 2018-10-05 01:18:51,416 WARN V2JobServlet:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] URL[GET http://sandbox-hdp-security:11000/oozie/v2/job/0000138-180930024054767-oozie-oozi-W?action=rerun&user.name=admin] error[E0302], E0302: Invalid parameter [action] org.apache.oozie.servlet.XServletException: E0302: Invalid parameter [action] at org.apache.oozie.servlet.JsonRestServlet.validateRestUrl(JsonRestServlet.java:448) at org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:294) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.AuthFilter$2.doFilter(AuthFilter.java:171) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:617) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:576) at org.apache.oozie.servlet.AuthFilter.doFilter(AuthFilter.java:176) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.HostnameFilter.doFilter(HostnameFilter.java:86) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieXFrameOptionsFilter.doFilter(OozieXFrameOptionsFilter.java:48) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.oozie.servlet.OozieCSRFFilter.doFilter(OozieCSRFFilter.java:62) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:234) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503) at java.lang.Thread.run(Thread.java:748) 2018-10-05 01:21:46,339 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[] The application does not define formal parameters in its XML definition 2018-10-05 01:21:46,346 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:22:05,542 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException 2018-10-05 01:22:05,542 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000144-180930024054767-oozie-oozi-W] ACTION[0000144-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE] 2018-10-05 01:24:21,892 WARN ParameterVerifier:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] The application does not define formal parameters in its XML definition 2018-10-05 01:24:21,899 WARN LiteWorkflowAppService:523 - SERVER[sandbox-hdp.hortonworks.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://sandbox-hdp.hortonworks.com:8020/user/root/lib] does not exist 2018-10-05 01:24:46,623 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000145-180930024054767-oozie-oozi-W] ACTION[0000145-180930024054767-oozie-oozi-W@hive_1] Error starting action [hive_1]. ErrorType [ERROR], ErrorCode [NullPointerException], Message [NullPointerException: null] org.apache.oozie.action.ActionExecutorException: NullPointerException: null at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) at org.apache.oozie.action.hadoop.JavaActionExecutor.createLauncherConf(JavaActionExecutor.java:1091) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1188) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1440) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:459) at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:82) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:280) at org.apache.oozie.command.wf.ActionEndXCommand.execute(ActionEndXCommand.java:61) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:244) at org.apache.oozie.command.wf.ActionCheckXCommand.execute(ActionCheckXCommand.java:56) at org.apache.oozie.command.XCommand.call(XCommand.java:287) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:178) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.NullPointerException 2018-10-05 01:24:46,635 WARN ActionStartXCommand:523 - SERVER[sandbox-hdp.hortonworks.com] USER[admin] GROUP[-] TOKEN[] APP[TestWorkflow] JOB[0000145-180930024054767-oozie-oozi-W] ACTION[0000145-180930024054767-oozie-oozi-W@hive_1] Setting Action Status to [DONE]
Created 10-05-2018 02:40 AM
OK. I got it working. It is because I have "space" with my script path: <script>/user/root/Hive Query Test.hql</script>
So I simply removed the space in the script name to HiveQueryTest.hql and now it works. I was hoping the error message would be more clear and easier to debug.
Created 10-17-2019 08:17 AM
see here Dgcustomefirst