Reply
Highlighted
New Contributor
Posts: 2
Registered: ‎02-10-2016

Int96 error while trying to read Parquet format generated by Spark using PIG

ERROR 1200: can't convert optional int96 uploadTime

 

Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: Int96 error while trying to read Parquet format generated by Spark using PIG

Int96 support for Pig is currently not present. X-Ref: http://mail-archives.apache.org/mod_mbox/parquet-dev/201503.mbox/%3C54F5E740.2070507@cloudera.com%3E...

The workaround is to use the timestamp datatype in the source data instead of Int96.

See also https://issues.apache.org/jira/browse/PARQUET-195