Can I still use HDFS like normal when HDFS Balancer is running?

quangbilly79 — Thu, 07 Aug 2025 05:01:15 GMT

Just add a new node into the current cluster, and now I'm running the Balancer command to balance disk space into the new node.

But the Balancer runs for so long, we're still waiting for it to complete before doing anything. We fear that reading/writing to HDFS while the Balancer is running will cause corrupted data files.

Should we wait, or just work like normal

Re: Can I still use HDFS like normal when HDFS Balancer is running?

RAGHUY — Tue, 19 Aug 2025 08:50:18 GMT

Hi, @quangbilly79

Yes, you can continue to use HDFS normally while the Balancer is running. The Balancer only moves replicated block copies between DataNodes to even out disk usage; it does not modify the actual data files. Reads and writes are fully supported in parallel with balancing, and HDFS ensures data integrity through replication and checksums. The process may add some extra network and disk load, so you might see reduced performance during heavy balancing. There is no risk of data corruption caused by the Balancer. You don’t need to wait — it’s safe to continue your normal operations.

question Can I still use HDFS like normal when HDFS Balancer is running? in Support Questions

Can I still use HDFS like normal when HDFS Balancer is running?

Re: Can I still use HDFS like normal when HDFS Balancer is running?