Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Vertex failed while overwrite the hive table?

Solved Go to solution

Vertex failed while overwrite the hive table?

New Contributor

i have a vertex failed error while insert overwrite table into elasticsearch using es-haddop jar.i follow the tutorial link below

https://hadoopist.wordpress.com/2015/01/03/how-to-ingest-the-data-into-elasticsearch-through-hive/

my hive log is

Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1481976368061_0022_1_00, diagnostics=[Task failed, taskId=task_1481976368061_0022_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 1 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 2 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 3 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1481976368061_0022_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1481976368061_0022_1_00, diagnostics=[Task failed, taskId=task_1481976368061_0022_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 1 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 2 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 3 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1481976368061_0022_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
hive> 

10478-screenshot-from-2016-12-19-121631.png


screenshot-from-2016-12-19-121615.pngscreenshot-from-2016-12-19-121558.png
1 ACCEPTED SOLUTION

Accepted Solutions

Re: Vertex failed while overwrite the hive table?

@Rajesh AJcould you please add the following jar in hive cli

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

if you are using hiveserver2 then add this jar into hive_aux_jars and restart hiveserver2

5 REPLIES 5

Re: Vertex failed while overwrite the hive table?

@Rajesh AJcould you please add the following jar in hive cli

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

if you are using hiveserver2 then add this jar into hive_aux_jars and restart hiveserver2

Highlighted

Re: Vertex failed while overwrite the hive table?

New Contributor

thanks for your reply but the same error will shows again

10479-screenshot-from-2016-12-19-130413.png

Re: Vertex failed while overwrite the hive table?

@Rajesh AJ looks you added sources jar not the jar with compiled classes,

add jar from the following location

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

Re: Vertex failed while overwrite the hive table?

New Contributor

thanks it works fine.

Re: Vertex failed while overwrite the hive table?

New Contributor

10588-screenshot-from-2016-12-21-131352.png

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

when i add the above jar it works fine but it wont works when i try for new table.

afterwards i restart the hive session that jar works fine.

how i permanently add that jar in hive

Don't have an account?
Coming from Hortonworks? Activate your account here