Skip to main content
anshuman
anshuman
Gold ⭐️
November 20, 2019
Solved

Node Label Support in CDP

Will Node labels be supported in the new CDP ?

jagadeesan
jagadeesanAnswer
Platinum ⭐️
November 25, 2019

Hi @anshuman 

Yes, we have Node labels support in the new CDP. For more details, you can check CDP documentations.

https://docs.cloudera.com/ -> Cloudera Data Platform -> Runtime -> Cloudera Runtime 

https://docs.cloudera.com/runtime/7.0.2/yarn-allocate-resources/topics/yarn-configuring-node-labels.html

 

FYI. Cloudera Runtime is the core open-source software distribution within Cloudera Data Platform (CDP) that is maintained, supported, versioned, and packaged as a single entity by Cloudera. Cloudera Runtime includes approximately 50 open source projects that comprise the core distribution of data management tools within CDP, including Cloudera Manager, which is used to configure and monitor clusters managed in CDP.

View in thread

3 replies

sagarshimpi
sagarshimpi
Gold ⭐️
November 20, 2019

@anshuman  Currently Node labels are not yet available for FairScheduler in CDH.

From the latest jira update on Sep19, upstream -

https://issues.apache.org/jira/browse/YARN-2497

 

Node labels are still not included in CDH. However i see it might come with HDP3.x/CDH6.X version as per link -

 

https://archive.cloudera.com/cdh6/6.0.0/docs/hadoop-3.0.0-cdh6.0.0/hadoop-yarn/hadoop-yarn-site/NodeLabel.html

Translate
anshuman
anshumanAuthor
Gold ⭐️
November 21, 2019

@sagarshimpi  HDP already supported Node Labels.

However CDH thought that it was not production ready.

https://community.cloudera.com/t5/Support-Questions/Node-Labels/m-p/37275/highlight/true#

 

The question is whether node lable support is in the roadmap for CDP as CDH and HDP have joined.

It does open up interesting use-cases for mixed cluster use.

 

Translate
    jagadeesan
    Platinum ⭐️
    jagadeesanAnswer
    Platinum ⭐️
    November 25, 2019

    Hi @anshuman 

    Yes, we have Node labels support in the new CDP. For more details, you can check CDP documentations.

    https://docs.cloudera.com/ -> Cloudera Data Platform -> Runtime -> Cloudera Runtime 

    https://docs.cloudera.com/runtime/7.0.2/yarn-allocate-resources/topics/yarn-configuring-node-labels.html

     

    FYI. Cloudera Runtime is the core open-source software distribution within Cloudera Data Platform (CDP) that is maintained, supported, versioned, and packaged as a single entity by Cloudera. Cloudera Runtime includes approximately 50 open source projects that comprise the core distribution of data management tools within CDP, including Cloudera Manager, which is used to configure and monitor clusters managed in CDP.

    Translate
    Terms & ConditionsAccessibility statement