Support Questions
Find answers, ask questions, and share your expertise

com.streamsets.pipeline.api.base.OnRecordErrorException: HIVE_17 - Information type missing or invalid in the metadata record

Explorer

We have HDP 3.0.1 kerberised cluster. I am trying to ingest data from JDBC to Hive through Streamsets Data Collector.

I am getting below error:


com.streamsets.pipeline.api.base.OnRecordErrorException: HIVE_17 - Information type missing or invalid in the metadata record: Record[headers='HeaderImpl[select * from shipping WHERE event_id >${offset} ORDER by event_id ;::rowCount:0:1]' data='Field[MAP:{event_id=Field[INTEGER:1], order_id=Field[INTEGER:123], event_type=Field[STRING:SHIPPED]}]']     at com.streamsets.pipeline.stage.destination.hive.HiveMetastoreTarget.write(HiveMetastoreTarget.java:200)


Does HDP 3.0.1 kerberised cluster supports Stream set data collector 3.8.0 and is compatible with Hive 3.1.

If yes which part i am missing?

1 REPLY 1

Re: com.streamsets.pipeline.api.base.OnRecordErrorException: HIVE_17 - Information type missing or invalid in the metadata record

Explorer

Data Collector has a stage library for HDP 3.1, but not specifically 3.0 - see the documentation on additional stage libraries.