I'm attempting to write to Implala using PutDatabaseRecord. Everything works fine until I hit a null timestamp, and it tries to cast it to a varchar(19) instead of a timestamp. The data input is from an Oracle DB via QueryDatabaseTable. This generates the following avro embedded schema: {"type":"record","name":"BLAH","namespace":"TEST","fields":[{"name":"ID","type":["null","string"]},{"name":"MY_VALUE","type":["null",{"type":"bytes","logicalType":"decimal","precision":15,"scale":4}]},{"name":"TIME_INSERTED","type":["null",{"type":"long","logicalType":"timestamp-millis"}]},{"name":"TIME_UPDATED","type":["null",{"type":"long","logicalType":"timestamp-millis"}]}]} The actual data is then: [ {
"ID" : "71416037",
"MY_VALUE" : 58.75,
"TIME_INSERTED" : "2018-05-11T22:17:44.000Z",
"TIME_UPDATED" : null
}, {
"ID" : "71416525",
"MY_VALUE" : 267.5,
"TIME_INSERTED" : "2018-05-11T22:18:25.000Z",
"TIME_UPDATED" : "2018-05-15T22:09:37.385Z"
} ] Taken in isolation, the second entry with no null values works fine, and the first entry with null works fine, but when trying with both together it fails. Looking at the generated SQL, it appears it's trying to cast the timestamp to a char(19) rather than a timestamp. What's a little confusing is the error talks about the expression null being of type char(19), but there's no cast around the null value. Target table 'test' is incompatible with source expressions.
Expression 'null' (type: CHAR(19)) is not compatible with column 'time_updated' (type: TIMESTAMP)
), Query: INSERT INTO `test`(`id`, `my_value`, `time_inserted`, `time_updated`) VALUES (CAST('71416037' AS CHAR(8)), 58.75, '2018-05-11 18:17:44.0', null), (CAST('71416525' AS CHAR(8)), 267.5, '2018-05-11 18:18:25.0', CAST('2018-05-15 18:09:37' AS CHAR(19))).: Any ideas? It seems strange that either in isolation is fine but both together is not.
... View more
