Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s)...

File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s)...

New Contributor

Hello

I try to write a File write INFORMATICA into the Cluster and I got this error from the Informatics Developer !

and i get this error:

could not be closed because of the following error: [org.apache.hadoop.ipc.RemoteException(java.io.IOException): File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s) are excluded in this operation. at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.chooseTarget4NewBlock(BlockManager.java:1641)

I think the Connection is ok but the File is created on the cluster but with no data inside

I fond in a other Ticket this hint an I think I got a configuration problem in my Cluster

Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s)

and 0 decommissioning replica(s).

Or is this ok

THX

[root@sandbox /]# hdfs fsck /

Connecting to namenode via http://sandbox.hortonworks.com:50070/fsck?ugi=root&path=%2F

FSCK started by root (auth:SIMPLE) from /172.17.0.2 for path / at Thu Jan 19 13:33:11 UTC 2017

....................................................................................................

..................................

/user/admin/hive/jobs/hive-job-1-2017-01-05_03-35/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742644_1841. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

.

/user/admin/hive/jobs/hive-job-2-2017-01-05_03-36/logs: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742655_1852. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s)

and 0 decommissioning replica(s).

.

/user/admin/hive/jobs/hive-job-2-2017-01-05_03-36/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742645_1842. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-3-2017-01-17_12-17/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742692_1891. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-4-2017-01-17_12-19/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742693_1892. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-5-2017-01-17_12-20/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742694_1893. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-6-2017-01-17_12-20/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742696_1895. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-7-2017-01-17_12-20/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742699_1898. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-8-2017-01-17_12-21/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742700_1899. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/admin/hive/jobs/hive-job-9-2017-01-17_12-33/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742702_1901. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned repli

ca(s) and 0 decommissioning replica(s).

..

/user/maria_dev/data/PSP.json: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742641_1838. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning re

plica(s).

..

/user/maria_dev/hive/jobs/hive-job-10-2017-01-17_02-07/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742714_1913. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned

replica(s) and 0 decommissioning replica(s).

..

/user/maria_dev/hive/jobs/hive-job-11-2017-01-17_02-11/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742715_1914. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned

replica(s) and 0 decommissioning replica(s).

..

/user/maria_dev/hive/jobs/hive-job-12-2017-01-17_02-26/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742717_1916. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned

replica(s) and 0 decommissioning replica(s).

..........................................

....................................................................................................

....................................................................................................

....................................................................................................

....................................................................................................

....................................................................................................

....................................................................................................

..........................

/user/raj_ops/hive/jobs/hive-job-13-2017-01-17_02-27/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742718_1917. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

..

/user/raj_ops/hive/jobs/hive-job-14-2017-01-17_02-33/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742719_1918. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

..

/user/raj_ops/hive/jobs/hive-job-15-2017-01-17_02-34/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742720_1919. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

..

/user/raj_ops/hive/jobs/hive-job-16-2017-01-17_04-39/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742737_1936. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

..

/user/raj_ops/hive/jobs/hive-job-17-2017-01-17_04-39/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742738_1937. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

..

/user/raj_ops/hive/jobs/hive-job-18-2017-01-17_04-40/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742739_1938. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

..

/user/raj_ops/hive/jobs/hive-job-19-2017-01-17_04-40/query.hql: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742740_1939. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned re

plica(s) and 0 decommissioning replica(s).

.

/usr/PSP.json: Under replicated BP-1464254149-172.17.0.2-1477381671113:blk_1073742790_1991. Target Replicas is 3 but found 1 live replica(s), 0 decommissioned replica(s) and 0 decommissioning replica(s).

Status: HEALTHY

Total size: 2027224349 B

Total dirs: 297

Total files: 839

Total symlinks: 0 (Files currently being written: 10)

Total blocks (validated): 814 (avg. block size 2490447 B) (Total open file blocks (not validated): 2)

Minimally replicated blocks: 814 (100.0 %)

Over-replicated blocks: 0 (0.0 %)

Under-replicated blocks: 22 (2.7027028 %)

Mis-replicated blocks: 0 (0.0 %)

Default replication factor: 1

Average block replication: 1.0

Corrupt blocks: 0

Missing replicas: 44 (5.1282053 %)

Number of data-nodes: 1

Number of racks: 1

FSCK ended at Thu Jan 19 13:33:12 UTC 2017 in 1109 milliseconds

The filesystem under path '/' is HEALTHY

4 REPLIES 4

Re: File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s)...

Super Guru
@bob human

It looks like your Datanodes are not healthy and unavailable. Can you please check that?

You may want to run below command and check status of your Datanodes.

sudo -u hdfs dfsadmin -report

Re: File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s)...

New Contributor

@ Kuldeep Kulkarni

it did not work!

[root@sandbox /]# sudo -u hdfs dfsadmin -report                                                                          
sudo: dfsadmin: command not found  

Re: File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s)...

Super Guru

@bob human

Please try below command

sudo -u hdfs hadoop dfsadmin -report

Re: File /usr/Artikel.csv could only be replicated to 0 nodes instead of minReplication (=1). There are 1 datanode(s) running and 1 node(s)...

New Contributor

@ Kuldeep Kulkarni

That works and give me that result!

It seems to be that only 1 data node is running.

How can I start the other so that I had 3 active data nodes?

Configured Capacity: 45103345664 (42.01 GB)
Present Capacity: 19983088640 (18.61 GB) 
DFS Remaining: 17852124160 (16.63 GB)
DFS Used: 2130964480 (1.98 GB)
DFS Used%: 10.66% 
Under replicated blocks: 22 
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0                                                                                                                                                                 
-------------------------------------------------                                                                                                             
Live datanodes (1): 
Name: 172.17.0.2:50010 (sandbox.hortonworks.com)                                                       
Hostname: sandbox.hortonworks.com 
Decommission Status : Normal  
Configured Capacity: 45103345664 (42.01 GB) 
DFS Used: 2130964480 (1.98 GB)  
Non DFS Used: 25120261120 (23.40 GB)
DFS Remaining: 17852120064 (16.63 GB)                                      
DFS Used%: 4.72%                                                                                      
DFS Remaining%: 39.58%                                                                                
Configured Cache Capacity: 0 (0 B)                                                                    
Cache Used: 0 (0 B)                                                                                    
Cache Remaining: 0 (0 B)                                                                              
Cache Used%: 100.00%                                                                       
Cache Remaining%: 0.00%                                                                               
Xceivers: 6                                                                                            
Last contact: Tue Jan 24 12:35:00 UTC 2017