question Re: How to handle: Unable to close file because the last block does not have enough number of replicas in Archives of Support Questions (Read Only)

How to handle: Unable to close file because the last block does not have enough number of replicas

kc7bfi — Fri, 03 Nov 2017 18:49:38 GMT

I have a Java application that is appending recorded video into an HDFS file. Occasionally, after writing a batch of video frames, when I try to close the FSDataOutputStream I get the following error:

Unable to close file because the last block does not have enough number of replicas

In this case, I sleep for 100ms and try again and the close succeeds. However, the next time I try and open the file I get the following error:

Failed to APPEND_FILE /PSG/20171102.idx for DFSClient_NONMAPREDUCE_1265824578_479 on 192.168.3.224 because DFSClient_NONMAPREDUCE_1265824578_479 is already the current lease holder.

What is the proper way of handling a failed close attempt? Any ideas on how to handle such situations? Thanks, David

Re: How to handle: Unable to close file because the last block does not have enough number of replicas

sze — Tue, 28 Nov 2017 06:51:40 GMT

"Sleep and retry" is good way to handle the "not have enough number of replicas" problem.

For the "already the current lease holder" problem, you may call DistributedFileSystem.recoverLease(Path) to force lease recovery.

Hope it helps.

Re: How to handle: Unable to close file because the last block does not have enough number of replicas

sze — Tue, 28 Nov 2017 08:25:31 GMT

For recoverLease using CLI, see https://community.hortonworks.com/questions/146012/force-closing-a-hdfs-file-still-open-because-uncor.html?childToView=146021#answer-146021