https://community.cloudera.com/t5/Support-Questions/Spark-1-6-1-how-to-skip-corrupted-parquet-blocks/m-p/103537#M66454 <P>can you copy that file elsewhere and then delete it. You can rebuild the parquet directory?</P><P>did you run fsck on that directory?</P><P><A href="https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html#fsck">https://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html#fsck</A></P><P>see here: <A href="https://dzone.com/articles/hdfs-cheat-sheet">https://dzone.com/articles/hdfs-cheat-sheet</A></P><P>I wonder if it's because you are trying to read files and not the entire directory.</P><P>can you read the entire directory (or copy to another directory) /data/tempparquetdata</P><P><A href="https://issues.apache.org/jira/browse/SPARK-3138">https://issues.apache.org/jira/browse/SPARK-3138</A></P> Fri, 30 Dec 2016 11:23:52 GMT TimothySpann 2016-12-30T11:23:52Z