question Re: HDFS - Different Storage Configurations on Servers in Archives of Support Questions (Read Only)

HDFS - Different Storage Configurations on Servers

awatson — Tue, 20 Sep 2016 23:30:06 GMT

Hi,

I currently have a 20 node cluster set up with mount points (/grid01, /grid02,..../grid10) on each of my data nodes. Currently all mounts are available to HDFS. However I would like to reconfigure 3 of the data nodes so that grid points - /grid01, /grid02, /grid03 - are no longer used for HDFS (they will be used for kafka and other non HDFS processes).

How best do I go about reconfiguring the datanodes in Ambari ?

Re: HDFS - Different Storage Configurations on Servers

sbhat — Tue, 20 Sep 2016 23:34:35 GMT

Hi @Andrew Watson,

Please refer the following community question for the same :

https://community.hortonworks.com/questions/49340/how-do-i-change-namenode-and-datanode-dir-for-an-e.html#comment-49804. This has a certified approved answer.

You can also check :

https://community.hortonworks.com/articles/2308/how-to-move-or-change-the-hdfs-datanode-directorie.html

Hope this helps!

Re: HDFS - Different Storage Configurations on Servers

ledel — Wed, 21 Sep 2016 00:00:04 GMT

you can update mount points by overriding in a new Ambari Config Group (then restart those nodes, of course, but you'll be notified)

since HDFS will recreate the missing blocks on those 3 disks per node, you shouldn't have any loss