Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Load parquet file in pig

Highlighted

Load parquet file in pig

Rising Star

Hi, I tried to open (LOAD) paruqet file (table created by Impala) in PIG.

The table has several integer columns, string columns (changed to chararray) and timestamp column.

 

The problem is in reading the timestamp columne, the error what we get is this:

 

parsing: Error during parsing. can't convert optional int96 charging_start_time
Failed to parse: can't convert optional int96 charging_start_time
at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:198)
at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1676)
at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1409)
at org.apache.pig.PigServer.parseAndBuild(PigServer.java:342)
at org.apache.pig.PigServer.executeBatch(PigServer.java:367)
at org.apache.pig.PigServer.executeBatch(PigServer.java:353)
at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:140)
at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:769)

 

I tried to change the definition in LOAD statement to chararray, int, int96, float, but nothing helped.

Any ideas how to overcome this problem?

1 REPLY 1

Re: Load parquet file in pig

New Contributor

did this issue get resolved ....if so can you share your solution ?

Don't have an account?
Coming from Hortonworks? Activate your account here