Member since
01-21-2021
2
Posts
0
Kudos Received
0
Solutions
01-21-2021
12:29 PM
After playing quite a lot with different date formats and trying different approaches to convert the MS epoch to ISO-8601, I've finally came to a solution that worked for my use-case with a very small CSV, and here's what I've did: First I've changed the UpdateRecord /sample_time to only convert from MS epoch to a standard UNIX epoch, leaving the output value as long integer: Then in both the Record Writer and in the PutKudu Record Reader, I've set the sample_time as {"type": "long", "logicalType" : "timestamp-millis"}: So far, it did the job and the values are written to Kudu. But when I've then tried with the original 33Mb CSV file, containing all the samples, it failed again with a new error: Not sure what does it mean...whither it's some row in the CSV that it's failing to process or something in the conversion that fails....
... View more