Member since
07-03-2017
1
Post
0
Kudos Received
0
Solutions
07-05-2017
12:21 PM
I have similar query but it is about reading data from HIVE tables which are stored as parquet format.Getting below error on table data read using spark-SQL. java.lang.ArrayIndexOutOfBoundsException: 7
at org.apache.parquet.bytes.BytesUtils.bytesToLong(BytesUtils.java:250)
at org.apache.parquet.column.statistics.LongStatistics.setMinMaxFromBytes(LongStatistics.java:50)
at org.apache.parquet.format.converter.ParquetMetadataConverter.fromParquetStatistics(ParquetMetadataConverter.java:255) ,
I have a similar requirement to read data from a HIVE table which is stored in parquet format. Getting the below exception. WARN TaskSetManager: Lost task 0.0 in stage 1.0 (TID 2,...........) java.lang.ArrayIndexOutOfBoundsException: 7
at org.apache.parquet.bytes.BytesUtils.bytesToLong(BytesUtils.java:250)
at org.apache.parquet.column.statistics.LongStatistics.setMinMaxFromBytes(LongStatistics.java:50)
at org.apache.parquet.format.converter.ParquetMetadataConverter.fromParquetStatistics(ParquetMetadataConverter.java:255)
... View more