Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Node Label Support in CDP

avatar
Expert Contributor

Will Node labels be supported in the new CDP ?

1 ACCEPTED SOLUTION

avatar
Master Collaborator

Hi @anshuman 

Yes, we have Node labels support in the new CDP. For more details, you can check CDP documentations.

https://docs.cloudera.com/ -> Cloudera Data Platform -> Runtime -> Cloudera Runtime 

https://docs.cloudera.com/runtime/7.0.2/yarn-allocate-resources/topics/yarn-configuring-node-labels....

 

FYI. Cloudera Runtime is the core open-source software distribution within Cloudera Data Platform (CDP) that is maintained, supported, versioned, and packaged as a single entity by Cloudera. Cloudera Runtime includes approximately 50 open source projects that comprise the core distribution of data management tools within CDP, including Cloudera Manager, which is used to configure and monitor clusters managed in CDP.

View solution in original post

3 REPLIES 3

avatar
Expert Contributor

@anshuman  Currently Node labels are not yet available for FairScheduler in CDH.

From the latest jira update on Sep19, upstream -

https://issues.apache.org/jira/browse/YARN-2497

 

Node labels are still not included in CDH. However i see it might come with HDP3.x/CDH6.X version as per link -

 

https://archive.cloudera.com/cdh6/6.0.0/docs/hadoop-3.0.0-cdh6.0.0/hadoop-yarn/hadoop-yarn-site/Node...

avatar
Expert Contributor

@sagarshimpi  HDP already supported Node Labels.

However CDH thought that it was not production ready.

https://community.cloudera.com/t5/Support-Questions/Node-Labels/m-p/37275/highlight/true#

 

The question is whether node lable support is in the roadmap for CDP as CDH and HDP have joined.

It does open up interesting use-cases for mixed cluster use.

 

avatar
Master Collaborator

Hi @anshuman 

Yes, we have Node labels support in the new CDP. For more details, you can check CDP documentations.

https://docs.cloudera.com/ -> Cloudera Data Platform -> Runtime -> Cloudera Runtime 

https://docs.cloudera.com/runtime/7.0.2/yarn-allocate-resources/topics/yarn-configuring-node-labels....

 

FYI. Cloudera Runtime is the core open-source software distribution within Cloudera Data Platform (CDP) that is maintained, supported, versioned, and packaged as a single entity by Cloudera. Cloudera Runtime includes approximately 50 open source projects that comprise the core distribution of data management tools within CDP, including Cloudera Manager, which is used to configure and monitor clusters managed in CDP.