Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HiveStreamingDataSource format writes empty string for NULL value in Hive Table. Is it the bug or is it the expected behavior?

HiveStreamingDataSource format writes empty string for NULL value in Hive Table. Is it the bug or is it the expected behavior?

New Contributor

I am trying to write from Kafka Source to Hive Target. I am using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format to write data into Hive table. Table is ORC format and fully transnational. I am using HDP 3.1 cluster.

But What i see that for every NULL value of string data type is written as empty in hive table. Is it the bug or is it the expected behavior?

Attaching Standalone spark program : standalone.txt

Create Table Command : create table hive_target (id int, name varchar(255), age int, timestamp1 timestamp);

Table Properties : 109191-table-props.png