question Does Impala uses fair scheduler? and YARN for execution of query? in Support Questions

Does Impala uses fair scheduler? and YARN for execution of query?

PranayMunshi — Fri, 16 Sep 2022 14:19:05 GMT

Hi Friends,
I have little doubt about Impala using fair schedulre for launching job.
I am reading about Impala since 3 months but I never come across about Impala using fair scheduler instead it has its own mechanism for resource allocation.
Is there any situation where Impala uses fair scheduler during execution of query?

I have one more doubt about IMPALA using YARN.
I want to the scenario/condition when we have to use YARN with IMPALA, becuase IMPALA has its own execution engine. When we have to use YARN with IMPALA?

I think Llama is meant for that only.

Re: Does Impala uses fair scheduler? and YARN for execution of query?

Tim Armstrong — Wed, 17 Apr 2019 18:04:48 GMT

I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.

There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.

Re: Does Impala uses fair scheduler? and YARN for execution of query?

PranayMunshi — Thu, 18 Apr 2019 05:28:31 GMT

Thank you very much Tim.
Provided link has clarified my doubt.