Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

SOLVED Go to solution
Highlighted

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

Guru

Hortonworks documentation (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/enabling_cgroups.html) says using CGroups requires HDP running in secure mode with kerberos. However, there is no such requirement according to apache documentation. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html

Apache documentation calls out for settings for running Cgroups without kerberos and settings required. Which documentation is incorrect? Do we support running LCE and CGroups without kerberos?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

New Contributor

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

3 REPLIES 3

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

New Contributor

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

@Ravi - You can set the CPU scheduling in Yarn via Ambari. I had tested this with Hive PM, but the queries had issues.

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

New Contributor
,

how can i access the jira