Support Questions

Find answers, ask questions, and share your expertise

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

Guru

Hortonworks documentation (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/enabling_cgroups.html) says using CGroups requires HDP running in secure mode with kerberos. However, there is no such requirement according to apache documentation. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html

Apache documentation calls out for settings for running Cgroups without kerberos and settings required. Which documentation is incorrect? Do we support running LCE and CGroups without kerberos?

1 ACCEPTED SOLUTION

Explorer

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

View solution in original post

3 REPLIES 3

Explorer

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

@Ravi - You can set the CPU scheduling in Yarn via Ambari. I had tested this with Hive PM, but the queries had issues.

,

how can i access the jira

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.