question How to add more disks to HDFS? in Archives of Support Questions (Read Only)

How to add more disks to HDFS?

vijayainturi — Thu, 14 Jan 2016 03:24:58 GMT

Re: How to add more disks to HDFS?

aervits — Thu, 14 Jan 2016 03:36:23 GMT

you add more disks by adding new nodes called datanodes. If you want to add disk to existing nodes, you will need to change the property in ambari for datanode dir to include the newly created directories. @vijaya inturi

Re: How to add more disks to HDFS?

jstraub — Thu, 14 Jan 2016 03:44:20 GMT

Add the disks to the datanodes/server and mount them.

Afterwards you should shutdown the datanode, add the new mountpoints to dfs.datanode.data.dir (e.g. /grid/hadoop/hdfs/dn /grid1/hadoop/hdfs/dn / grid2/hadoop/hdfs/dn,...) and restart the datanode.

Re: How to add more disks to HDFS?

aervits — Wed, 03 Feb 2016 03:40:43 GMT

@vijaya inturi are you still having issues with this? Can you accept best answer or provide your own solution?