Reply
Highlighted
Explorer
Posts: 18
Registered: ‎03-19-2019
Accepted Solution

Does Impala uses fair scheduler? and YARN for execution of query?

[ Edited ]

Hi Friends,
I have little doubt about Impala using fair schedulre for launching job. 
I am reading about Impala since 3 months but I never come across about Impala using fair scheduler instead it has its own mechanism for resource allocation. 
Is there any situation where Impala uses fair scheduler during execution of query?

I have one more doubt about IMPALA using YARN. 
I want to the scenario/condition when we have to use YARN with IMPALA, becuase IMPALA has its own execution engine. When we have to use YARN with IMPALA? 

I think Llama is meant for that only.

Cloudera Employee
Posts: 422
Registered: ‎07-29-2015

Re: Does Impala uses fair scheduler? and YARN for execution of query?

I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.

 

There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.

Explorer
Posts: 18
Registered: ‎03-19-2019

Re: Does Impala uses fair scheduler? and YARN for execution of query?

Thank you very much Tim.
Provided link has clarified my doubt.