Support Questions

Find answers, ask questions, and share your expertise

How to refresh HDFS rack topology changes without restarting namenodes

avatar
New Contributor

After adding new datanodes to the existing cluster and updating topology file. I am not able to refresh the namenode to pick up rack of the new node. It puts under `/default-rack`.

 

Anyway to refresh the rack topology changes without restarting namenodes? 

1 ACCEPTED SOLUTION

avatar

@rda3mon Currently the feature you are looking for is not available, but for future version there is a jira in place - https://issues.apache.org/jira/browse/HDFS-11242

View solution in original post

4 REPLIES 4

avatar

@rda3mon Currently the feature you are looking for is not available, but for future version there is a jira in place - https://issues.apache.org/jira/browse/HDFS-11242

avatar
New Contributor

Thanks for pointing me to the patch. 

avatar
New Contributor

For those who are looking for hdfs behind hbase solution. You can use Hbase favored node rack awareness, which depends on hdfs "net.topology.script.file.name" and more importantly refreshes dynamically. That worked for me perfectly. 

avatar
Explorer

The correct process for adding a new node with the correct mapping is:

1. Update the topology file of the new DN.
2. Issue dfadmin-refreshnodes to update the new topology map in the NN.
3. Start DN only after (2) so that it picks up the correct mapping and the default mapping is not cached.