Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Does Impala uses fair scheduler? and YARN for execution of query?

Solved Go to solution
Highlighted

Does Impala uses fair scheduler? and YARN for execution of query?

Hi Friends,
I have little doubt about Impala using fair schedulre for launching job. 
I am reading about Impala since 3 months but I never come across about Impala using fair scheduler instead it has its own mechanism for resource allocation. 
Is there any situation where Impala uses fair scheduler during execution of query?

I have one more doubt about IMPALA using YARN. 
I want to the scenario/condition when we have to use YARN with IMPALA, becuase IMPALA has its own execution engine. When we have to use YARN with IMPALA? 

I think Llama is meant for that only.

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Does Impala uses fair scheduler? and YARN for execution of query?

Master Collaborator

I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.

 

There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.

2 REPLIES 2

Re: Does Impala uses fair scheduler? and YARN for execution of query?

Master Collaborator

I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.

 

There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.

Re: Does Impala uses fair scheduler? and YARN for execution of query?

Thank you very much Tim.
Provided link has clarified my doubt. 

Don't have an account?
Coming from Hortonworks? Activate your account here