Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Curious to know why majority of the people are not enabiling Yarn Node Labels on production clusters ? Any potential issues ? or Not aware of the option?

avatar
New Member
 
1 ACCEPTED SOLUTION

avatar
Guru

Use cases that I have run into for node labels are specialized hardware and licensing requirements for 3rd party libraries. I have seen node labels used in production for some of these use cases.

Most likely reason why it is still not 'majority of people' is because these use cases themselves are not very common.

View solution in original post

3 REPLIES 3

avatar
Guru

Each use case may have different requirements. I know of several organizations using Hadoop that simply have not encountered a need for Yarn Node labels yet, but are all using the queues and the capacity scheduler heavily.

avatar
Guru

Use cases that I have run into for node labels are specialized hardware and licensing requirements for 3rd party libraries. I have seen node labels used in production for some of these use cases.

Most likely reason why it is still not 'majority of people' is because these use cases themselves are not very common.

avatar

@Sankar T

Please read Wangda's blog if you are planning to setup yarn node labels - https://wangda.live/2016/04/16/suggestions-about-how-to-better-use-yarn-node-label/