Reply
Contributor
Posts: 44
Registered: ‎09-26-2014

Load parquet file in pig

Hi, I tried to open (LOAD) paruqet file (table created by Impala) in PIG.

The table has several integer columns, string columns (changed to chararray) and timestamp column.

 

The problem is in reading the timestamp columne, the error what we get is this:

 

parsing: Error during parsing. can't convert optional int96 charging_start_time
Failed to parse: can't convert optional int96 charging_start_time
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:198)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1676)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1409)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:342)
at org.apache.pig.PigServer.executeBatch(PigServer.java:367)
at org.apache.pig.PigServer.executeBatch(PigServer.java:353)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:769)

 

I tried to change the definition in LOAD statement to chararray, int, int96, float, but nothing helped.

Any ideas how to overcome this problem?

New Contributor
Posts: 2
Registered: ‎02-10-2016

Re: Load parquet file in pig

did this issue get resolved ....if so can you share your solution ?

Announcements