Support Questions
Find answers, ask questions, and share your expertise

HiveStreamingDataSource format writes empty string for NULL value in Hive Table. Is it the bug or is it the expected behavior?

HiveStreamingDataSource format writes empty string for NULL value in Hive Table. Is it the bug or is it the expected behavior?

New Contributor

I am trying to write from Kafka Source to Hive Target. I am using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format to write data into Hive table. Table is ORC format and fully transnational. I am using HDP 3.1 cluster.

But What i see that for every NULL value of string data type is written as empty in hive table. Is it the bug or is it the expected behavior?

Attaching Standalone spark program : standalone.txt

Create Table Command : create table hive_target (id int, name varchar(255), age int, timestamp1 timestamp);

Table Properties : 109191-table-props.png