Cloudera Community
Announcements
Celebrating as our community reaches 100,000 members! Thank you!
CloudGame
user rank
New Contributor

Re: Hive fails due to not have enough number of re...

by New Contributor in Support Questions
‎06-07-2017 08:53 AM
‎06-07-2017 08:53 AM
It seems like if we are not confident that changing those configuration will solve the HDFS IO Exception (in our Hive application) its better to not mess around with them.  Do you have any suggestion about the root couse of our exception?  ... View more

Hive fails due to not have enough number of replic...

by New Contributor in Support Questions
‎06-06-2017 01:37 PM
‎06-06-2017 01:37 PM
Our Hive application is failing with the following error:    [HiveServer2-Handler-Pool: Thread-3522853]: Job Submission failed with exception 'java.io.IOException(Unable to close file because the last block does not have enough number of replicas.)' java.io.IOException: Unable to close file because the last block does not have enough number of replicas. at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:2600) at org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:2562)    We decided to try different suggestions like increasing the following settings but CM doesn't have the option to do so.   dfs.client.block.write.locateFollowingBlock.retries dfs.client.retry.interval-ms.get-last-block-length dfs.blockreport.incremental.intervalMsec Any suggestion?  ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎06-19-2017 04:22 PM
Community Statistics
Member Since ‎06-06-2017 11:29 AM
Last Visited ‎06-19-2017 04:22 PM
Posts 2