Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Failed to place enough replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK]
Labels:
- Labels:
-
Apache Hadoop
Expert Contributor
Created 10-13-2016 06:03 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
I'm running a distcopy from one cluster to another and getting below error in the destination namenode log file.
2016-10-13 12:48:09,260 WARN blockmanagement.BlockPlacementPolicy (BlockPlacementPolicyDefault.java:chooseTarget(385)) - Failed to place enough replicas, still in need of 1 to reach 2 (unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}, newBlock=true) All required storage types are unavailable: unavailableStorages=[DISK], storagePolicy=BlockStoragePolicy{HOT:7, storageTypes=[DISK], creationFallbacks=[], replicationFallbacks=[ARCHIVE]}
In the destination cluster, I'm able to write to hdfs. Cluster health is green.
I also see these .distcp.tmp* file in the destination cluster:
hdfs dfs -ls /mstr/f_opt_wifi_ap_mth_chc/ Found 24 items -rw-r----- 3 hdfs hdfs 0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000000_0 -rw-r----- 3 hdfs hdfs 0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000001_0 -rw-r----- 3 hdfs hdfs 0 2016-10-13 11:00 /mstr/f_opt_wifi_ap_mth_chc/.distcp.tmp.attempt_1476280811282_0259_m_000002_0
2 REPLIES 2
Explorer
Created 03-10-2018 05:05 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Did you figure out the issue? I have the same problem @P D
Explorer
Created 03-10-2018 05:39 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
