Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Load parquet file in pig

avatar
Expert Contributor

Hi, I tried to open (LOAD) paruqet file (table created by Impala) in PIG.

The table has several integer columns, string columns (changed to chararray) and timestamp column.

 

The problem is in reading the timestamp columne, the error what we get is this:

 

parsing: Error during parsing. can't convert optional int96 charging_start_time
Failed to parse: can't convert optional int96 charging_start_time
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:198)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1676)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1409)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:342)
at org.apache.pig.PigServer.executeBatch(PigServer.java:367)
at org.apache.pig.PigServer.executeBatch(PigServer.java:353)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:769)

 

I tried to change the definition in LOAD statement to chararray, int, int96, float, but nothing helped.

Any ideas how to overcome this problem?

Who agreed with this topic