Support Questions

Find answers, ask questions, and share your expertise

How to prevent that hive creates RM queue of arbitrary name?

Explorer

My cluster uses capacity queue, and completed setting of allocation resources each queue.

But, when some users apply job with options "set tez.queue.name=abc" or "set mapreduce.queue.name=def", then queue name "abc" and "def" are automatically created in ResourceManager.

That queue can allocate from zero-memory, zero-vcore up to maximum-memory, maximum-vcore in my cluster resources.

I do not want that.

How can i prevent automatically creation of queue by hive?

1 REPLY 1

Master Collaborator

Can you check the following property settings on your cluster?

<property>
    <name>yarn.scheduler.capacity.queue-mappings-override.enable</name>
    <value>false</value>
    <description>
      If a queue mapping is present and override is set to true, it will override the queue value specified
      by the user. This can be used by administrators to place jobs in queues
      that are different than the one specified by the user.
      The default is false - user can specify to a non-default queue.
    </description>
</property>

What you desire is true for this parameter.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.