How can we default all hive server 2 connections to go to a separate Yarn Queue?
So now that you have a pool of AM's running, for possibly multiple queue's, who do you get your JDBC session into HS2 to use the desired queue? You need to specify the queue you want in your JDBC session with:
Specify Queue in Script
Specify a Queue in the JDBC Connection String
On the server that's running Hive Server2, modify hive-site.xml the include the following:
I have seen this before.
Ambari does not allow you to do this?
Tried in sandbox
Couple of other side affects
a) If I set tez.queue.name explicitly
Performance of queries of demo 2 is much slower
b) Both the queues have 50% of the queue capacity
@Shivaji You can define multiple queues. I know , its a lot to read http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_performance_tuning/content/hive_perf_best...
You have to define the queue in your code or connection.
I have a similar question.
In my case, I need to connect to Hive using a Sas tool that only provides me with the following fields:
And then there is a tool to add "server side properties", which creates a list of key/value pairs.
Can anyone tell me what server side properties I can use to force this connection to always use a specific queue?
Or, a way to associate this connection with a user and associate that user with a key/value pair?
Capacity scheduler view is in sandbox, you can setup those queues using the capacity scheduler view our manually using scheduler section of yarn configs. This page http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_performance_tuning/content/section_create...