Setting within script hive.tez.container.size

[#1]

Ive always been under the impression that I can modify hive.tez.container.size for different queries within a hive script. For example: I set the container size to 2GB for small queries but increase it to 4GB for larger queries and then reset it back to 2GB for smaller queries.

Is this how it works? It appears that I can definitely change this value to increase the container size at different time but does reseting the value to a lower number actually cause smaller containers from that point in the script?

How can I tell what the container size for task was?

[#2 · Accepted solution]

hi @nfleming

The property can be set on a per session basis I believe. The Ambari Tez View shows the query run, and if you click on the config tab, you can see the Tez properties for that query.

[#3]

Thanks for the response. Are you claiming that all properties can only be set once per session? What Im wondering is if the container size can be reduced after it has been increased within the SAME session. I know that I can increase it within the session but looking at the resource manager Im not sure if the subsequent decrease in container size occurs within the same session.

[#4]

hi @nfleming

No I am not claiming that. You can change the property within the same session as you see fit.