Support Questions

Find answers, ask questions, and share your expertise
Announcements
Welcome to the upgraded Community! Read this blog to see What’s New!

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

avatar
Guru

Hortonworks documentation (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/enabling_cgroups.html) says using CGroups requires HDP running in secure mode with kerberos. However, there is no such requirement according to apache documentation. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html

Apache documentation calls out for settings for running Cgroups without kerberos and settings required. Which documentation is incorrect? Do we support running LCE and CGroups without kerberos?

1 ACCEPTED SOLUTION

avatar
Explorer

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

View solution in original post

3 REPLIES 3

avatar
Explorer

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

avatar

@Ravi - You can set the CPU scheduling in Yarn via Ambari. I had tested this with Hive PM, but the queries had issues.

avatar
,

how can i access the jira

Labels