Reply
Highlighted
Contributor
Posts: 47
Registered: ‎07-27-2015

There are not same file size of dfs.namenode.name.dir, is it a normal behavior?

[ Edited ]

Hello, 

        There are not same file size of ten dfs.namenode.name.dir,  e.g.

       

$ sudo du -sb /data1/dfs/nn/
1369355141 /data1/dfs/nn/


$ sudo du -sb /data2/dfs/nn/
1369351045 /data2/dfs/nn/


$ sudo du -sb /data3/dfs/nn/
1369359237 /data3/dfs/nn/


$ sudo du -sb /data4/dfs/nn/
1369359237 /data4/dfs/nn/


$ sudo du -sb /data5/dfs/nn/
1369367429 /data5/dfs/nn/


$ sudo du -sb /data6/dfs/nn/
1369342853 /data6/dfs/nn/


$ sudo du -sb /data7/dfs/nn/
1369355141 /data7/dfs/nn/


$ sudo du -sb /data8/dfs/nn/
1369359237 /data8/dfs/nn/


$ sudo du -sb /data9/dfs/nn/
1369351045 /data9/dfs/nn/


$ sudo du -sb /data10/dfs/nn/
1369342853 /data10/dfs/nn/

 

I find there are some folders have different size. Is this a normal behavior?

This behavior seems impact our cluster run stable. The standby namenode crashed at some time.

Another, could we need change the ten folder to three folders for storing the hdfs metadata?

while I restart the namenode, it would like to choose which folder of ten folder to rebuild the hdfs file image? 

 

 

 

Thank you

 

Announcements