Support Questions
Find answers, ask questions, and share your expertise

Is there a way we can escape blank lines in hive external table with jsonserde

Expert Contributor

Hi All,

I am getting a stream of jsons in to hdfs location (say '/json/') with blank lines (sometimes) in data.

I have an hive external table with jsonserde on '/json'.

The data from external table will be inserted to orc based on a key in jsons at frequent intervals.

My external table fails every query because it has blank lines in between, and there is no possibility of touching the files in this use case.

Could you please let me know how to configure external table with json serde to work even if it has blank lines in between.

Thank you for your help.

0 REPLIES 0