Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Can I limit the number of containers allocated by Tez?

avatar
Expert Contributor

I found sometime, in our cluster, only one query from Tez can used up all resources. Can I limit the containers for Tez query so that there are free resource kept for other sessions?

1 ACCEPTED SOLUTION

avatar
Master Guru

@Huahua Wei

Please check your capacity schedule configuration, on the queue where TEZ container is occupying all the capacity. Also if you are using only default queue then please check size of your tez container, modify it accordingly. If you are using default queue then I would recommend you to configure multiple queues.

Please refer below doc for more details

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/ref-475...

View solution in original post

3 REPLIES 3

avatar
Master Guru

@Huahua Wei

Please check your capacity schedule configuration, on the queue where TEZ container is occupying all the capacity. Also if you are using only default queue then please check size of your tez container, modify it accordingly. If you are using default queue then I would recommend you to configure multiple queues.

Please refer below doc for more details

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/ref-475...

avatar
Expert Contributor

scheduler-config-1477964292460.xmlKuldeep, Thanks for your quick response.

Firstly, tez used default queue, Now I created new which named squeue, but I don't know how to set the value for "User Limit Factor" and "MInimum User Limit" .

avatar
Contributor

You can set hive/tez to use a specified queue. For tez, the configuration is 'tez.queu.name'. Regarding to queue capacity settings, please refer to this link.