Support Questions

layeeq_436 · ‎07-11-2019

Connected to LLAP string , Insert statement throws vertex error

Borker and coordinator configuration properties are set properly only, still this vertex error throws, Please help

0: jdbc:hive2://ipadress:2181> CREATE EXTERNAL TABLE upgdevdb1.hivedruid_test5 (`__time` TIMESTAMP, `course` STRING, `id` STRING, `name` STRING, `year` STRING) Stored BY 'org.apache.hadoop.hive.druid.DruidStorageHandler';

INFO : Compiling command(queryId=hive_20190711193720_8376c2c0-bd72-413d-8c81-033ed55e94d9): CREATE EXTERNAL TABLE upgdevdb1.hivedruid_test5 (`__time` TIMESTAMP, `course` STRING, `id` STRING, `name` STRING, `year` STRING) Stored BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'

INFO : Semantic Analysis Completed (retrial = false)

INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)

INFO : Completed compiling command(queryId=hive_20190711193720_8376c2c0-bd72-413d-8c81-033ed55e94d9); Time taken: 0.028 seconds

INFO : Executing command(queryId=hive_20190711193720_8376c2c0-bd72-413d-8c81-033ed55e94d9): CREATE EXTERNAL TABLE upgdevdb1.hivedruid_test5 (`__time` TIMESTAMP, `course` STRING, `id` STRING, `name` STRING, `year` STRING) Stored BY 'org.apache.hadoop.hive.druid.DruidStorageHandler'

INFO : Starting task [Stage-0:DDL] in serial mode

INFO : Completed executing command(queryId=hive_20190711193720_8376c2c0-bd72-413d-8c81-033ed55e94d9); Time taken: 0.129 seconds

INFO : OK

No rows affected (0.174 seconds)

0: jdbc:hive2://ipaddress:2181> insert into hivedruid_test5 values(1541193507549,'anil','1','test','2016');

INFO : Compiling command(queryId=hive_20190711193731_3b4cf0a3-b3a3-4701-a1f3-5d8839b18ee7): insert into hivedruid_test5 values(1541193507549,'anil','1','test','2016')

INFO : Semantic Analysis Completed (retrial = false)

INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_col0, type:timestamp, comment:null), FieldSchema(name:_col1, type:string, comment:null), FieldSchema(name:_col2, type:string, comment:null), FieldSchema(name:_col3, type:string, comment:null), FieldSchema(name:_col4, type:string, comment:null)], properties:null)

INFO : Completed compiling command(queryId=hive_20190711193731_3b4cf0a3-b3a3-4701-a1f3-5d8839b18ee7); Time taken: 0.405 seconds

INFO : Executing command(queryId=hive_20190711193731_3b4cf0a3-b3a3-4701-a1f3-5d8839b18ee7): insert into hivedruid_test5 values(1541193507549,'anil','1','test','2016')

INFO : Query ID = hive_20190711193731_3b4cf0a3-b3a3-4701-a1f3-5d8839b18ee7

INFO : Total jobs = 1

INFO : Starting task [Stage-0:DDL] in serial mode

INFO : Starting task [Stage-1:DDL] in serial mode

INFO : Launching Job 1 out of 1

INFO : Starting task [Stage-2:MAPRED] in serial mode

INFO : Subscribed to counters: [] for queryId: hive_20190711193731_3b4cf0a3-b3a3-4701-a1f3-5d8839b18ee7

INFO : Session is already open

INFO : Dag name: insert into hivedruid...','1','test','2016') (Stage-2)

ERROR : Status: Failed

ERROR : Vertex failed, vertexName=Reducer 2, vertexId=vertex_1562408971899_20433_98_01, diagnostics=[Task failed, taskId=task_1562408971899_20433_98_01_000007, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : java.lang.RuntimeException: java.lang.NoSuchMethodError: org.joda.time.format.DateTimeFormatter.withZoneUTC()Lorg/joda/time/format/DateTimeFormatter;

at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:401)

at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:249)

at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:318)

at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)

at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)

at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)

at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)

at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)

at java.security.AccessController.doPrivileged(Native Method)

at javax.security.auth.Subject.doAs(Subject.java:422)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)

at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)

at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)

at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)

at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: java.lang.NoSuchMethodError: org.joda.time.format.DateTimeFormatter.withZoneUTC()Lorg/joda/time/format/DateTimeFormatter;

at org.apache.hive.druid.com.fasterxml.jackson.datatype.joda.cfg.FormatConfig.createUTC(FormatConfig.java:71)

at org.apache.hive.druid.com.fasterxml.jackson.datatype.joda.cfg.FormatConfig.<clinit>(FormatConfig.java:23)

at org.apache.hive.druid.com.fasterxml.jackson.datatype.joda.deser.PeriodDeserializer.<init>(PeriodDeserializer.java:19)

at org.apache.hive.druid.com.fasterxml.jackson.datatype.joda.deser.PeriodDeserializer.<init>(PeriodDeserializer.java:24)

at org.apache.hive.druid.io.druid.jackson.JodaStuff.register(JodaStuff.java:54)

at org.apache.hive.druid.io.druid.jackson.DruidDefaultSerializersModule.<init>(DruidDefaultSerializersModule.java:49)

at org.apache.hive.druid.io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:46)

at org.apache.hive.druid.io.druid.jackson.DefaultObjectMapper.<init>(DefaultObjectMapper.java:35)

at org.apache.hadoop.hive.druid.DruidStorageHandlerUtils.<clinit>(DruidStorageHandlerUtils.java:227)

at org.apache.hadoop.hive.druid.io.DruidOutputFormat.getHiveRecordWriter(DruidOutputFormat.java:95)

at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getRecordWriter(HiveFileFormatUtils.java:297)

at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveRecordWriter(HiveFileFormatUtils.java:282)

at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketForFileIdx(FileSinkOperator.java:786)

at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createBucketFiles(FileSinkOperator.java:737)

at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:903)

at org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:111)

at org.apache.hadoop.hive.ql.exec.Operator.vectorForward(Operator.java:965)

at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:938)

at org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:158)

at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.processVectorGroup(ReduceRecordSource.java:490)

at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecordVector(ReduceRecordSource.java:392)

... 18 more

, errorMessage=Cannot recover from this error:java.lang.RuntimeException: java.lang.NoSuchMethodError: org.joda.time.format.DateTimeFormatter.withZoneUTC()Lorg/joda/time/format/DateTimeFormatter;