Reply
New Contributor
Posts: 5
Registered: ‎12-27-2017

Capture bad records(csv file) in Impala/Hive

Is there a way to capture all bad records of a csv file.

 

I have a csv file and a schema, Impala/Hive assings null to the records which doesnt satisfy the schema. Is there a way by which we can capture all the bad records?

 

 

Cloudera Employee
Posts: 820
Registered: ‎03-23-2015

Re: Capture bad records(csv file) in Impala/Hive

I am not sure if there is such tool to do this. But it sounds like you did not define delimiter correctly. What's the table DDL and what is the issue with data?