Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

HDFS Distribution by adding HDD's to a SSD-only cluster without storage policies

avatar
Explorer

Hey together, 

we're running a CDP Private Cloud Base Cluster with actually 6 Nodes. All 6 Nodes running fully on SSD storage. I found out that HDFS thinks the SSDs are normal disk, because it is not configured as SSD storage like this --> "[SSD]/grid/n/dn", actually its "/grid/n/dn". Now we're planning to add four other servers from an older cluster with normal disks.

 

My action plan is as follows: 

1. configure existing storage/server to SSD -> "[SSD]/grid/n/dn"
2. add the other four server an configure it -> "[DISK]/grid/n/dn"

3. restart recommended services

 

I've got the following questions: 

- Will HDFS distribute the blocks across all nodes (SSD and disk?) without any storage policy configured? So that we have a homogeneous storage. 

- How will services react to this changes in storage, for example HBase?

- If we configure a homogeneous storage, as i described: does reconfiguring the storage paths of the Datanodes to SSDs add any value/benefit at all?

Thanks for your help!

 

Regards, 

Timo

1 ACCEPTED SOLUTION

avatar
Explorer

We added the new machines and configured it to all Disk. Working fine so far. 

View solution in original post

1 REPLY 1

avatar
Explorer

We added the new machines and configured it to all Disk. Working fine so far.