Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Cloudera Community

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.
Solved Go to solution

Vertex failed while overwrite the hive table?

Labels:
avatar
author-rank a_rajeshinfotec
New Member

Created on ‎12-19-2016 06:47 AM - edited ‎08-18-2019 04:55 AM

i have a vertex failed error while insert overwrite table into elasticsearch using es-haddop jar.i follow the tutorial link below

https://hadoopist.wordpress.com/2015/01/03/how-to-ingest-the-data-into-elasticsearch-through-hive/

my hive log is

Status: Failed
Vertex failed, vertexName=Map 1, vertexId=vertex_1481976368061_0022_1_00, diagnostics=[Task failed, taskId=task_1481976368061_0022_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 1 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 2 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 3 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1481976368061_0022_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1481976368061_0022_1_00, diagnostics=[Task failed, taskId=task_1481976368061_0022_1_00_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 1 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 2 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
], TaskAttempt 3 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:415)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
 at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Map operator initialization failed
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:261)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
 ... 14 more
Caused by: java.lang.NoClassDefFoundError: org/apache/commons/httpclient/URIException
 at org.elasticsearch.hadoop.hive.HiveUtils.structObjectInspector(HiveUtils.java:61)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:81)
 at org.elasticsearch.hadoop.hive.EsSerDe.initialize(EsSerDe.java:102)
 at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:356)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
 at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
 at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
 at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:230)
 ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.httpclient.URIException
 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
 at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
 at java.security.AccessController.doPrivileged(Native Method)
 at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
 at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
 ... 28 more
]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:0, Vertex vertex_1481976368061_0022_1_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0
hive>

10478-screenshot-from-2016-12-19-121631.png


screenshot-from-2016-12-19-121615.pngscreenshot-from-2016-12-19-121558.png
21,132 Views
0 Kudos
1 ACCEPTED SOLUTION

avatar
author-rank rajkumar_singh author-rank
Super Guru

Created ‎12-19-2016 07:07 AM

@Rajesh AJcould you please add the following jar in hive cli

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

if you are using hiveserver2 then add this jar into hive_aux_jars and restart hiveserver2

View solution in original post

14,748 Views
5 REPLIES 5

avatar
author-rank rajkumar_singh author-rank
Super Guru

Created ‎12-19-2016 07:07 AM

@Rajesh AJcould you please add the following jar in hive cli

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

if you are using hiveserver2 then add this jar into hive_aux_jars and restart hiveserver2

14,749 Views

avatar
author-rank a_rajeshinfotec
New Member

Created on ‎12-19-2016 07:35 AM - edited ‎08-18-2019 04:55 AM

thanks for your reply but the same error will shows again

10479-screenshot-from-2016-12-19-130413.png

14,748 Views
0 Kudos

avatar
author-rank rajkumar_singh author-rank
Super Guru

Created ‎12-19-2016 07:41 AM

@Rajesh AJ looks you added sources jar not the jar with compiled classes,

add jar from the following location

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

14,748 Views
0 Kudos

avatar
author-rank a_rajeshinfotec
New Member

Created ‎12-19-2016 08:30 AM

thanks it works fine.

14,748 Views
0 Kudos

avatar
author-rank a_rajeshinfotec
New Member

Created on ‎12-21-2016 07:40 AM - edited ‎08-18-2019 04:55 AM

10588-screenshot-from-2016-12-21-131352.png

add jar /usr/hdp/current/hive-client/lib/commons-httpclient-3.0.1.jar

when i add the above jar it works fine but it wont works when i try for new table.

afterwards i restart the hive session that jar works fine.

how i permanently add that jar in hive

14,748 Views
0 Kudos
Announcements
Community Announcements
Community Upgrade Announcement
What's New @ Cloudera
Announcing Cloudera Flow Management Operator for Kubernetes ...
What's New @ Cloudera
Announcing Cloudera Streams Messaging Operator for Kubernete...
Community Announcements
July 2026 Community Highlights
Community Announcements
June 2026 Community Highlights
View More Announcements