- last edited on
I have issue when I write data from HDFS table KUDU table using spark, it is giving 8 hours difference for all the timestamp columns.
But, when I use IMPALA to write the data it is giving the data correctly.
Can anyone please help me to fix this
Thank you for reporting the issue.
I guess the issue might be related to the interpretation of the timezone in timestamps read from HDFS table. Maybe, reading through this https://www.cloudera.com/documentation/enterprise/5-16-x/topics/impala_timestamp.html might give you some ideas w.r.t. how Impala interprets timestamps.
To be able to help, I need to get more context on this. Could you share some more details on how the data from HDFS is piped into Kudu? For example: snippets of the code used, etc.
Ah, there is another thread which might be helpful: