Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Increase size of HDFS.

avatar
Explorer

I am running Hortonworks Sandbox HDP 2.6.5 on VirtualBox. I have increased the size of my virtual hard disk (.vdi) to 500 GB. However, when I login to Ambari and view the size of my disk, it shows 106 GB only. What should I do to increase the HDFS capacity from 106 GB to 500 GB?

1 ACCEPTED SOLUTION

avatar
Explorer

Since the solution is scattered across many posts, I'm posting a short summary of what I did.

I am running HDP 2.6.5 image on VirtualBox.

  1. Increased my virtual hard disk through Virtual Media Manager
  2. In the guest OS, 
    1. Partitioned the unused space
    2. Formatted the new partition as an ext4 file system
    3. Mounted the file system
    4. Update the /etc/fstab (I couldn't do it, as I did not find that file
  3. In Ambari, under DataNode directory config, added the newly mounted file system as a comma separated value
  4. Restarted HDFS (my cluster did not have any files, therefore I did not run the below)

Thanks to @Shelton for his guidance.

 

sudo -u hdfs hdfs balancer
​

 

 

 

View solution in original post

11 REPLIES 11

avatar
Master Mentor

@focal_fossa 

 

Great to hear happy hadooping!
Maybe to help other mark the best answer that helped you resolve your problem so other searching for similar solution would use it to resolve similar issues.

avatar
Explorer

Since the solution is scattered across many posts, I'm posting a short summary of what I did.

I am running HDP 2.6.5 image on VirtualBox.

  1. Increased my virtual hard disk through Virtual Media Manager
  2. In the guest OS, 
    1. Partitioned the unused space
    2. Formatted the new partition as an ext4 file system
    3. Mounted the file system
    4. Update the /etc/fstab (I couldn't do it, as I did not find that file
  3. In Ambari, under DataNode directory config, added the newly mounted file system as a comma separated value
  4. Restarted HDFS (my cluster did not have any files, therefore I did not run the below)

Thanks to @Shelton for his guidance.

 

sudo -u hdfs hdfs balancer
​