question Re: How to increase space allocated to HDFS in Archives of Support Questions (Read Only)

How to increase space allocated to HDFS

anki — Fri, 16 Sep 2022 10:09:36 GMT

Hi,

I uesd cloudera-manager for my installation and used core-hadoop as my option to install hadoop stuff.Now that cluster with 5nodes is up and working properly.By default it took 200GiB space for HDFS.But my disks having far more than that spcae avaliable I need to use that because I am doing benchamarking stuff where need to generate 1TB data and then sort it and validate it.

Can anybody tell me how can I increase the HDFS space.??

Re: How to increase space allocated to HDFS

chennuri_gouris — Thu, 17 Mar 2016 13:12:52 GMT

Add more volumes/disks to the dfs.datanode.data.dir in hdfs-site.xml in cloudera manager to increase the HDFS capacity.

Re: How to increase space allocated to HDFS

anki — Thu, 17 Mar 2016 13:44:51 GMT

Yeah...Thanks for the reply..few hours before I relaized that could be done...

Thank you !!!

@chennuri_gouris wrote:
Add more volumes/disks to the dfs.datanode.data.dir in hdfs-site.xml in cloudera manager to increase the HDFS capacity.