question HDP 2.3.4 min_user_id in container-executor.cfg does not take effect in Archives of Support Questions (Read Only)

HDP 2.3.4 min_user_id in container-executor.cfg does not take effect

aervits — Wed, 04 May 2016 03:59:35 GMT

According to our documentation any user ID with UID 1000 and up can execute jobs on YARN. In my tests, having a user below the UID min number defined for a cluster still executes a job and I cannot prevent it from executing jobs. Can someone confirm it works with HDP 2.3.4, also does it only take effect in a secure cluster?

Re: HDP 2.3.4 min_user_id in container-executor.cfg does not take effect

ravi1 — Wed, 04 May 2016 11:20:48 GMT

It will only take effect on secure clusters.

Re: HDP 2.3.4 min_user_id in container-executor.cfg does not take effect

aervits — Wed, 04 May 2016 15:01:43 GMT

Not quite, I was able to make it work using https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/SecureContainer.html tested on standard sandbox

Re: HDP 2.3.4 min_user_id in container-executor.cfg does not take effect

pminovic — Wed, 04 May 2016 15:59:54 GMT

Hi Artem, as we discussed, min.user.id (min_user_id is used only in Ambari) and container-executor.cfg are only referenced by LinuxContainerExecutor (LCE). By default, DefaultContainerExecutor is used. More details here (the doc is about Hadoop-2.7.2 but this part applies to 2.7.1 as well). Besides secure clusters LCE can also be used in non-secure ones to enable CGroups.