Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

Hive fails due to not have enough number of replicas in HDFS

Labels:
avatar
author-rank CloudGame
New Contributor

Created on ‎06-06-2017 01:37 PM - edited ‎09-16-2022 04:42 AM

Our Hive application is failing with the following error: 

 

[HiveServer2-Handler-Pool: Thread-3522853]: Job Submission failed with exception 'java.io.IOException(Unable to close file because the last block does not have enough number of replicas.)'
java.io.IOException: Unable to close file because the last block does not have enough number of replicas.
	at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:2600)
	at org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:2562)

 

 We decided to try different suggestions like increasing the following settings but CM doesn't have the option to do so.

 

dfs.client.block.write.locateFollowingBlock.retries
dfs.client.retry.interval-ms.get-last-block-length
dfs.blockreport.incremental.intervalMsec

Any suggestion? 

7,950
0 Kudos
2
Who agreed with this topic