Created 10-13-2016 06:03 PM
Hi,
I'm running a distcopy from one cluster to another and getting below error in the destination namenode log file.
2016-10-13 12:48:09,260 WARN
blockmanagement.BlockPlacementPolicy
(BlockPlacementPolicyDefault.java:chooseTarget(385)) - Failed to place enough
replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK],
storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK],
creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All
required storage types are unavailable:
unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7,
storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]} In the destination cluster, I'm able to write to hdfs. Cluster health is green.
I also see these .distcp.tmp* file in the destination cluster:
hdfs dfs -ls /mstr/f_opt_wifi_ap_mth_chc/ Found 24 items -rw-r----- 3 hdfs hdfs 0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000000_0 -rw-r----- 3 hdfs hdfs 0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000001_0 -rw-r----- 3 hdfs hdfs 0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000002_0
Created 03-10-2018 05:05 PM
Did you figure out the issue? I have the same problem @P D
Created 03-10-2018 05:39 PM