Hive compactor queue

[#1]

Iv'e recently enabled compaction on Hive and I'm seeing a job appear regularly in the default queue. I'd like to portion off a slither of the cluster to this function by creating a new queue for it but how do I tell it what queue to use to do this rather than it going to default?

[#2]

Hi @Ant Stark

Have you tried adding property hive.compactor.job.queue to Hive configs? This seems to have been added in HIVE-11997

Cheers

[#3]

Hello @uk_travler 

Compaction will not honour hive.compactor.job.queue. Basically compactions works differently for fully acid tables and insert only tables.

For fully acid tables, when you perform a manual/auto compaction, there are two jobs spawned, one MR which is responsible for compaction which will honour compaction queue and another tez job which is responsible for stats analysis and is a tez job submitted to default queue.

For inserts only tables, when you perform a manual/auto compaction, there is tez job spawned which is submitted to default queue.

There is a jira raised raised which is being worked on it. Bug details for your reference.

HIVE-24781

let me know if you have any doubts on the above.