Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can I limit the number of containers allocated by Tez?

Solved Go to solution
Highlighted

Can I limit the number of containers allocated by Tez?

Rising Star

I found sometime, in our cluster, only one query from Tez can used up all resources. Can I limit the containers for Tez query so that there are free resource kept for other sessions?

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Can I limit the number of containers allocated by Tez?

Super Guru

@Huahua Wei

Please check your capacity schedule configuration, on the queue where TEZ container is occupying all the capacity. Also if you are using only default queue then please check size of your tez container, modify it accordingly. If you are using default queue then I would recommend you to configure multiple queues.

Please refer below doc for more details

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/ref-475...

View solution in original post

3 REPLIES 3
Highlighted

Re: Can I limit the number of containers allocated by Tez?

Super Guru

@Huahua Wei

Please check your capacity schedule configuration, on the queue where TEZ container is occupying all the capacity. Also if you are using only default queue then please check size of your tez container, modify it accordingly. If you are using default queue then I would recommend you to configure multiple queues.

Please refer below doc for more details

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.3/bk_installing_manually_book/content/ref-475...

View solution in original post

Highlighted

Re: Can I limit the number of containers allocated by Tez?

Rising Star

scheduler-config-1477964292460.xmlKuldeep, Thanks for your quick response.

Firstly, tez used default queue, Now I created new which named squeue, but I don't know how to set the value for "User Limit Factor" and "MInimum User Limit" .

Re: Can I limit the number of containers allocated by Tez?

Explorer

You can set hive/tez to use a specified queue. For tez, the configuration is 'tez.queu.name'. Regarding to queue capacity settings, please refer to this link.

Don't have an account?
Coming from Hortonworks? Activate your account here