Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Support Questions

Find answers, ask questions, and share your expertise
Announcements
Share your experience with Cloudera on G2 and get a $25 Amazon Gift card.
Hi, I'm CLEO! Something exciting is coming to the Community. Stay Tuned!

Does Impala uses fair scheduler? and YARN for execution of query?

avatar

Hi Friends,
I have little doubt about Impala using fair schedulre for launching job. 
I am reading about Impala since 3 months but I never come across about Impala using fair scheduler instead it has its own mechanism for resource allocation. 
Is there any situation where Impala uses fair scheduler during execution of query?

I have one more doubt about IMPALA using YARN. 
I want to the scenario/condition when we have to use YARN with IMPALA, becuase IMPALA has its own execution engine. When we have to use YARN with IMPALA? 

I think Llama is meant for that only.

1 ACCEPTED SOLUTION

avatar

I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.

 

There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.

View solution in original post

2 REPLIES 2

avatar

I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.

 

There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.

avatar

Thank you very much Tim.
Provided link has clarified my doubt.