Support Questions

Find answers, ask questions, and share your expertise

how to set the max concurrent compaction number

Expert Contributor

Hi all,

HDP 2.6.3 with Hive 2.

I have enabled the ACID transaction; when run the compaction I have seen max 3 job on YARN queue.

I tried to launch manually more than 3 compaction, but they are execute 3 at a time.

Is there a parameter to set the max concurrent compaction jobs?

Thancks in advance


Rising Star

try to set up the property hive.compactor.worker.threads for each metastore you have

Expert Contributor

Yes, it works. Thanks