Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

Solved Go to solution

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

Guru

Hortonworks documentation (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/enabling_cgroups.html) says using CGroups requires HDP running in secure mode with kerberos. However, there is no such requirement according to apache documentation. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html

Apache documentation calls out for settings for running Cgroups without kerberos and settings required. Which documentation is incorrect? Do we support running LCE and CGroups without kerberos?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

Explorer

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

View solution in original post

3 REPLIES 3
Highlighted

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

Explorer

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

View solution in original post

Highlighted

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

@Ravi - You can set the CPU scheduling in Yarn via Ambari. I had tested this with Hive PM, but the queries had issues.

Highlighted

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

,

how can i access the jira

Don't have an account?
Coming from Hortonworks? Activate your account here