Reply
Highlighted
New Contributor
Posts: 1
Registered: ‎09-18-2017

MapredLocalTask NullPointerException return code 1

[ Edited ]

I am running hive on CDH 5.12, this error occur once i source my sql file, without getting a hadoop job ID.


INFO mr.MapredLocalTask: Executing: /opt/cloudera/parcels/CDH-5.12.0-1.cdh5.12.0.p0.29/lib/hadoop/bin/hadoop jar /opt/cloudera/parcels/CDH-5.12.0-1.cdh5.12.0.p0.29/jars/hive-exec-1.1.0-cdh5.12.0.jar org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan file:/tmp/root/6b4b78e4-979b-4752-b096-11e566eeedd4/hive_2017-09-17_19-34-30_229_5541690283991574005-1/-local-10010/plan.xml -jobconffile file:/tmp/root/6b4b78e4-979b-4752-b096-11e566eeedd4/hive_2017-09-17_19-34-30_229_5541690283991574005-1/-local-10011/jobconf.xml
17/09/17 19:34:35 [main]: ERROR mr.MapredLocalTask: Exception:
java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask.executeInChildVM(MapredLocalTask.java:326)
at org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask.execute(MapredLocalTask.java:153)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:214)
at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:99)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2041)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1748)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1501)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1285)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1275)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:220)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:172)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:383)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:318)
at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:416)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:432)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:140)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:383)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:775)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:693)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:628)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

 

the exception gone after i set hive.auto.convert.join into false, 
or set hive.exec.submit.local.task.via.child=false,
but some of my queries will run forever and filled up all the datanodes,
The two setting are supposed to be true and the same sql can be successfully executed in arround 1 minuete  under Apache Hadoop2.6
please help

Announcements