HDFS - Different Storage Configurations on Servers

[#1]

Hi,

I currently have a 20 node cluster set up with mount points (/grid01, /grid02,..../grid10) on each of my data nodes. Currently all mounts are available to HDFS. However I would like to reconfigure 3 of the data nodes so that grid points - /grid01, /grid02, /grid03 - are no longer used for HDFS (they will be used for kafka and other non HDFS processes).

How best do I go about reconfiguring the datanodes in Ambari ?

[#2 · Accepted solution]

Hi @Andrew Watson,

Please refer the following community question for the same :

https://community.hortonworks.com/questions/49340/how-do-i-change-namenode-and-datanode-dir-for-an-e.... This has a certified approved answer.

You can also check :

https://community.hortonworks.com/articles/2308/how-to-move-or-change-the-hdfs-datanode-directorie.h...

Hope this helps!

[#3]

you can update mount points by overriding in a new Ambari Config Group (then restart those nodes, of course, but you'll be notified)

since HDFS will recreate the missing blocks on those 3 disks per node, you shouldn't have any loss