Timestamp issue with KUDU Table.

[#1]

Hi All,

I have issue when I write data from HDFS table KUDU table using spark, it is giving 8 hours difference for all the timestamp columns.

But, when I use IMPALA to write the data it is giving the data correctly.

Can anyone please help me to fix this

[#2]

Hi,

Thank you for reporting the issue.

I guess the issue might be related to the interpretation of the timezone in timestamps read from  HDFS table.  Maybe, reading through this https://www.cloudera.com/documentation/enterprise/5-16-x/topics/impala_timestamp.html might give you some ideas w.r.t. how Impala interprets timestamps.

To be able to help, I need to get more context on this.  Could you share some more details on how the data from HDFS is piped into Kudu?  For example: snippets of the code used, etc.

Thanks,

Alexey

[#3]

Ah, there is another thread which might be helpful:

 https://community.cloudera.com/t5/Support-Questions/Kudu-to-HDFS-data-load-timestamp-issue/td-p/9364...