question Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos? in Archives of Support Questions (Read Only)

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

ravi1 — Thu, 05 Nov 2015 05:30:58 GMT

Hortonworks documentation (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/enabling_cgroups.html) says using CGroups requires HDP running in secure mode with kerberos. However, there is no such requirement according to apache documentation. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html

Apache documentation calls out for settings for running Cgroups without kerberos and settings required. Which documentation is incorrect? Do we support running LCE and CGroups without kerberos?

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

dhoyle — Thu, 05 Nov 2015 07:35:27 GMT

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

sdutta — Wed, 18 Nov 2015 01:30:07 GMT

@Ravi - You can set the CPU scheduling in Yarn via Ambari. I had tested this with Hive PM, but the queries had issues.

Re: Does using CGroups with LinuxContainerExecutor require enabling kerberos?

zangyongzhen — Thu, 15 Dec 2016 01:53:07 GMT

how can i access the jira