Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Why do we allocate 32 GB (recommended) for /dev partition to the Hadoop master node

avatar

Hi All,

We have 2* 80 GB 6G SATA SSD RAID-1 Hard-drive for Master node, According to Hortonworks recommendation in one of the blog-post, it suggests 32 GB for /dev partition. Our client is not interested in providing 32 GB for /dev partition, since the maximum disk capacity is 2*80 GB.

Full Master configuration details:

2x E5-2670V2 2.5GHz-25MB 10C CPU

448GB PC3-14900L RAM

2x 80GB 6G SATA SSD RAID 1

I would like to ask why we need 32 GB for /dev partition for Hadoop master nodes, also please suggest the recommended partition by considering the above hard-drive limits.

Thanks !

1 ACCEPTED SOLUTION

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
3 REPLIES 3

avatar
Super Collaborator

Hi @Uday Vakalapudi,

HDP do not require any special sizing for /dev as long as we follow the OS recommendations. The "baseline" we present includes general Linux requirements for system partitions. So in this case I recommend to follow the requirements for /dev issued by the operating system vendor.

avatar

Hi @Mats Johansson,

Thanks for your reply!

Yes, /dev directory contains the special device files for all the devices that's it. However, do we need to explicitly mention any sizing numbers for the partitions /dev/sda1, /dev/sda2 ..etc. What kind of information will store under those /dev partitions w.r.t HDP configuration setup.

Thanks!

avatar
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login