Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Int96 error while trying to read Parquet format generated by Spark using PIG

Int96 error while trying to read Parquet format generated by Spark using PIG

New Contributor
ERROR 1200: can't convert optional int96 uploadTime

 

1 REPLY 1
Highlighted

Re: Int96 error while trying to read Parquet format generated by Spark using PIG

Master Guru
Int96 support for Pig is currently not present. X-Ref: http://mail-archives.apache.org/mod_mbox/parquet-dev/201503.mbox/%3C54F5E740.2070507@cloudera.com%3E...

The workaround is to use the timestamp datatype in the source data instead of Int96.

See also https://issues.apache.org/jira/browse/PARQUET-195