Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Does using CGroups with LinuxContainerExecutor require enabling kerberos?

avatar
Guru

Hortonworks documentation (http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_yarn_resource_mgt/content/enabling_cgroups.html) says using CGroups requires HDP running in secure mode with kerberos. However, there is no such requirement according to apache documentation. https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/NodeManagerCgroups.html

Apache documentation calls out for settings for running Cgroups without kerberos and settings required. Which documentation is incorrect? Do we support running LCE and CGroups without kerberos?

1 ACCEPTED SOLUTION

avatar
Contributor

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

View solution in original post

3 REPLIES 3

avatar
Contributor

@ravi@hortonworks.com, Rohit (former YARN PM) specifically asked us to add this in BUG-35240 (https://hortonworks.jira.com/browse/BUG-35240).

RMP-3633 (https://hortonworks.jira.com/browse/RMP-3633) also seems to confirm that we only support CGroups/LCE on secure clusters.

avatar

@Ravi - You can set the CPU scheduling in Yarn via Ambari. I had tested this with Hive PM, but the queries had issues.

avatar
Contributor
,

how can i access the jira