Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Failed to place enough replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK]

Failed to place enough replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK]

Contributor

Hi,

I'm running a distcopy from one cluster to another and getting below error in the destination namenode log file.

2016-10-13 12:48:09,260 WARN 
blockmanagement.BlockPlacementPolicy
(BlockPlacementPolicyDefault.java:chooseTarget(385)) - Failed to place enough
replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK],
storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All
required storage types are unavailable: 
unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7,
storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]} 

In the destination cluster, I'm able to write to hdfs. Cluster health is green.

I also see these .distcp.tmp* file in the destination cluster:

hdfs dfs -ls /mstr/f_opt_wifi_ap_mth_chc/
Found 24 items
-rw-r-----   3 hdfs    hdfs          0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000000_0
-rw-r-----   3 hdfs    hdfs          0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000001_0
-rw-r-----   3 hdfs    hdfs          0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000002_0
2 REPLIES 2
Highlighted

Re: Failed to place enough replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK]

New Contributor

Did you figure out the issue? I have the same problem @P D

Re: Failed to place enough replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK]

New Contributor