Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Increase size of HDFS.

avatar
Explorer

I am running Hortonworks Sandbox HDP 2.6.5 on VirtualBox. I have increased the size of my virtual hard disk (.vdi) to 500 GB. However, when I login to Ambari and view the size of my disk, it shows 106 GB only. What should I do to increase the HDFS capacity from 106 GB to 500 GB?

1 ACCEPTED SOLUTION

avatar
Explorer

Since the solution is scattered across many posts, I'm posting a short summary of what I did.

I am running HDP 2.6.5 image on VirtualBox.

  1. Increased my virtual hard disk through Virtual Media Manager
  2. In the guest OS, 
    1. Partitioned the unused space
    2. Formatted the new partition as an ext4 file system
    3. Mounted the file system
    4. Update the /etc/fstab (I couldn't do it, as I did not find that file
  3. In Ambari, under DataNode directory config, added the newly mounted file system as a comma separated value
  4. Restarted HDFS (my cluster did not have any files, therefore I did not run the below)

Thanks to @Shelton for his guidance.

 

sudo -u hdfs hdfs balancer
​

 

 

 

View solution in original post

11 REPLIES 11

avatar
Master Mentor

@focal_fossa 

 

Great to hear happy hadooping!
Maybe to help other mark the best answer that helped you resolve your problem so other searching for similar solution would use it to resolve similar issues.

avatar
Explorer

Since the solution is scattered across many posts, I'm posting a short summary of what I did.

I am running HDP 2.6.5 image on VirtualBox.

  1. Increased my virtual hard disk through Virtual Media Manager
  2. In the guest OS, 
    1. Partitioned the unused space
    2. Formatted the new partition as an ext4 file system
    3. Mounted the file system
    4. Update the /etc/fstab (I couldn't do it, as I did not find that file
  3. In Ambari, under DataNode directory config, added the newly mounted file system as a comma separated value
  4. Restarted HDFS (my cluster did not have any files, therefore I did not run the below)

Thanks to @Shelton for his guidance.

 

sudo -u hdfs hdfs balancer
​