question Re: add disk and storage to hdp sandbox vm in Archives of Support Questions (Read Only)

add disk and storage to hdp sandbox vm

moapurva — Sat, 11 Jun 2016 04:41:49 GMT

I am running HDP Sandbox in an Azure VM. I can successfully add a disk to the VM and format / mount it. I would like to add it to HDFS to extend my storage. I am performing the following steps to get it recognized:

Create directory on the volume: i.e. mkdir /data/hdfs/data
Change perms: sudo chmod -R 755 /data/hdfs/data
Change ownership: sudo chown -R hadoop:hdfs /data/hdfs/data
Stop datanode through Ambari
Change dfs.data.dir property in /etc/hadoop/conf/hdfs-site.xml, add directory comma delimited
Restart datanode

Unfortunately, everytime I restart the datanode, the dfs.data.dir property reverts back to default. What am I doing wrong?

Re: add disk and storage to hdp sandbox vm

zblanco — Sat, 11 Jun 2016 04:48:34 GMT

Have you tried changing the setting through the HDFS service in Ambari?

Re: add disk and storage to hdp sandbox vm

zblanco — Mon, 19 Aug 2019 09:12:48 GMT

It looks like you should be able to add a directory

Re: add disk and storage to hdp sandbox vm

moapurva — Mon, 19 Aug 2019 09:12:40 GMT

I get the following error adding it there:

Re: add disk and storage to hdp sandbox vm

zblanco — Mon, 19 Aug 2019 09:12:32 GMT

Interesting. So it seems I actually got it to add another directory. These were the steps I followed:

I ran your commands above

mkdir /data/hdfs/data
chmod -R 755 /data/hdfs/data
sudo chown -R hdfs /data/hdfs/data

After running those commands I moved to Ambari. Moved to the HDFS service. From there instead of using a comma to separate the two, I just put the new directory on a separate line underneath so it looked like:

/hadoop/hdfs/data
/data/hdfs/data

After this I Ambari asked me to restart a few of the components. (It was taking a while so I ended up rebooting the Sandbox)

After rebooting the Sandbox I went back to the Ambari config and the new directory I added earlier was still present.

EDIT: Try removing the space after the comma. Ambari gave me an error when there was a space after the comma.

Re: add disk and storage to hdp sandbox vm

moapurva — Tue, 28 Jun 2016 08:38:43 GMT

Thanks @zblanco! Removing the comma did the trick.