Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Empty Lines in Json/CSV creates Empty Row in Hive

Empty Lines in Json/CSV creates Empty Row in Hive

New Contributor

Hello,

this post is a duplicate to the Post in the link. Reposting it as the solution there doesn't work. I tried with Json and with Text image attached. I created a Avro and insert into table stops at first insert (link)

Interestingly when I put this line in SparkConf and it works fine :

sparkConf(set textinputformat.record.delimiter='\n\n');

screen-shot-2018-05-16-at-71302-pm.png
1 REPLY 1

Re: Empty Lines in Json/CSV creates Empty Row in Hive

New Contributor

made some changes to the serde but still no luck, guess its a hive limtation

https://github.com/rcongiu/Hive-JSON-Serde/issues/207