Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to set the max concurrent compaction number

how to set the max concurrent compaction number

Rising Star

Hi all,

HDP 2.6.3 with Hive 2.

I have enabled the ACID transaction; when run the compaction I have seen max 3 job on YARN queue.

I tried to launch manually more than 3 compaction, but they are execute 3 at a time.

Is there a parameter to set the max concurrent compaction jobs?

Thancks in advance

2 REPLIES 2
Highlighted

Re: how to set the max concurrent compaction number

Rising Star

try to set up the property hive.compactor.worker.threads for each metastore you have

Highlighted

Re: how to set the max concurrent compaction number

Rising Star

Yes, it works. Thanks

Don't have an account?
Coming from Hortonworks? Activate your account here