Can I limit the number of containers allocated by Tez?

[#1]

I found sometime, in our cluster, only one query from Tez can used up all resources. Can I limit the containers for Tez query so that there are free resource kept for other sessions?

[#2 · Accepted solution]

@Huahua Wei

Please check your capacity schedule configuration, on the queue where TEZ container is occupying all the capacity. Also if you are using only default queue then please check size of your tez container, modify it accordingly. If you are using default queue then I would recommend you to configure multiple queues.

Please refer below doc for more details

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/ref-475...

[#3]

scheduler-config-1477964292460.xmlKuldeep, Thanks for your quick response.

Firstly, tez used default queue, Now I created new which named squeue, but I don't know how to set the value for "User Limit Factor" and "MInimum User Limit" .

[#4]

You can set hive/tez to use a specified queue. For tez, the configuration is 'tez.queu.name'. Regarding to queue capacity settings, please refer to this link.