28787
DISCUSSIONS
102048
MEMBERS
3161
ARTICLES
Created 02-13-2015 03:37 AM
Hi, I tried to open (LOAD) paruqet file (table created by Impala) in PIG.
The table has several integer columns, string columns (changed to chararray) and timestamp column.
The problem is in reading the timestamp columne, the error what we get is this:
parsing: Error during parsing. can't convert optional int96 charging_start_time
Failed to parse: can't convert optional int96 charging_start_time
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:198)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1676)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1409)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:342)
at org.apache.pig.PigServer.executeBatch(PigServer.java:367)
at org.apache.pig.PigServer.executeBatch(PigServer.java:353)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:769)
I tried to change the definition in LOAD statement to chararray, int, int96, float, but nothing helped.
Any ideas how to overcome this problem?