Member since
11-07-2017
13
Posts
4
Kudos Received
3
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2001 | 01-17-2019 03:05 PM | |
| 4411 | 01-14-2019 08:37 PM |
01-17-2019
03:05 PM
@takuma what version of hdp are you in ? docker support for yarn is added in HDP 3.0 below are the links with steps to configure the same. https://hortonworks.com/blog/part-5-of-data-lake-3-0-yarn-and-containerization-supporting-docker-and-beyond/ https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/data-operating-system/content/run_docker_containers_on_yarn.html https://community.hortonworks.com/content/kbentry/226331/dockerized-yarn-services-quickstart.html Cheers, Naveen
... View more
01-14-2019
08:37 PM
1 Kudo
@Fernando Lopez Bello Based on the above configuration file for queue Zeppelin although user A submits a job first utilizes all the resources as the Queue's minimum-user-limit-percent is set to 20 the queue resources will be shared among subsequent users below is the link which explains with an example. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_yarn-resource-management/content/setting_user_limits.html But if you don't want all the resources to shared by user A even if there no other users then you can use user-limit-factor below is the link to a nice article about it. I can see user limit factor is 3 for Zeppelin Queue which means each user can utilize 3 times of queue capacity if resources are available & elasticity permits. https://community.hortonworks.com/content/supportkb/49640/what-does-the-user-limit-factor-do-when-used-in-ya.html In a nutshell minimum-user-limit-percent is a soft limit & user-limit-factor is a hard limit.
... View more