Skip to main content
irshan
irshan
Silver ⭐️
January 31, 2024
Question

hdfs balancer is not working

Hi Team,

We have 2 nodes cluster, second node we added recently, now we ran hdfs balancer but output is showing the cluster is already balanced but in actual the data is not balanced. Please suggest here..

 

Thanks

Irshankhan

    5 replies

    VidyaSargur
    Community Manager
    VidyaSargur
    Community Manager
    January 31, 2024

    @irshan Welcome to our community! To help you get the best possible answer, I have tagged our HDFS experts @Asok @rki_  who may be able to assist you further.

    Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

    Translate
    Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.
      9een
      Gold ⭐️
      9een
      Gold ⭐️
      February 4, 2024

      Kindly check if the new Datanode and existing DN node part of same rack

       

      Share below command output 

      1. HDFS dfsadmin -report 

      2. HDFS dfsadmin -printTopology

      Translate
        mike_bronson7
        mike_bronson7
        Gold ⭐️⭐️⭐️
        February 4, 2024

        you can balance the data-node disks usage by decommission and recommission , but if you have only 2 data-nodes then its a problem  better to do it at least 3 data-nodes in cluster 

        Translate
        Michael-Bronson
          irshan
          irshanAuthor
          Silver ⭐️
          February 7, 2024

          hi,
          when we add balancer role then in instance tab its showing N/A. I think its not starting as expected. We are using cloudera express version. its a production cluster. 

          Translate
            sathishkr
            Silver ⭐️⭐️⭐️
            sathishkr
            Silver ⭐️⭐️⭐️
            December 12, 2024

            @irshan When you add balancer as a role in the HDFS cluster, it indeed will show as not started. So its an expected one. Coming to your main query, it could be possible that when you run the balancer, the balancer threshold could be with in the default percentage of 10, so it won't move the blocks. You may have to reduce the balance threshold and try again.

            Translate
              Terms & ConditionsAccessibility statement