Member since
04-15-2021
23
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3448 | 04-20-2021 06:26 AM |
03-11-2024
07:25 AM
Hi @Chetankumar , the mentioned configs are related to user group mapping in HDFS. May I know if yo have enabled these? Also do you want to change the bind user or only the searchbase?
... View more
09-23-2021
07:51 AM
1 Kudo
HDFS data might not always be distributed uniformly across DataNodes. One common reason is addition of new DataNodes to an existing cluster. HDFS provides a balancer utility that analyzes block placement and balances data across the DataNodes. The balancer moves blocks until the cluster is deemed to be balanced, which means that the utilization of every DataNode (ratio of used space on the node to total capacity of the node) differs from the utilization of the cluster (ratio of used space on the cluster to total capacity of the cluster) by no more than a given threshold percentage. The balancer does not balance between individual volumes on a single DataNode. To free up the spaces in particular datanodes. You can use a block distribution application to pin its block replicas to particular datanodes so that the pinned replicas are not moved for cluster balancing. https://docs.cloudera.com/HDPDocuments/HDP2/HDP-2.6.0/bk_hdfs-administration/content/overview_hdfs_balancer.html
... View more
04-20-2021
06:26 AM
Hi @kingpin Thanks for your reply. Yes this solution worked and now we are able to remove the old disk and after rebalance new disks are in use. We will continue to remove the disk from each node after the rebalance complete after each attempt.
... View more