Created 03-27-2018 12:14 AM
Hello All , I am trying to insert JSON data into a table . But I have been getting the below error , Can some one please help
Vertex failed, vertexName=Map 1, vertexId=vertex_1521944075400_56930_3_00, diagnostics=[Task failed, taskId=task_1521944075400_56930_3_00_000002, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row <-----Json data here ------>
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:347)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:194)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:185)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:185)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:181)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row
Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row < -------------json data ------------->
Need your help to resolve it
Created 03-27-2018 05:04 AM
Can you please share the code outline how you are trying to load the data? If it is via a select statement from JSON statement, is the select statement working standalone?
Created 03-27-2018 02:59 PM
Below is my select statement . I am actually loading avro data into a table1(all the files are loaded properly in to the table) and inserting the table's data to a different table2 . I have been getting vertex failed error while inserting the data some files , but some are loading fine during the insert. If file is the reason for this error (corrupted file) How can I skip the corrupted data during the insert . Below is the insert statement
ADD jar <jar_path>;
ADD jar <jar path>;
CREATE TEMPORARY FUNCTION keyvalue as 'com.abc.GetKeyValuesUdf';
set hive.execution.engine=tez;
set hive.exec.dynamic.partition=true;
insert into DB.<table_name> partition(data)