Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 04-17-2019 08:49 AM - edited 09-16-2022 07:19 AM
Hi Friends,
I have little doubt about Impala using fair schedulre for launching job.
I am reading about Impala since 3 months but I never come across about Impala using fair scheduler instead it has its own mechanism for resource allocation.
Is there any situation where Impala uses fair scheduler during execution of query?
I have one more doubt about IMPALA using YARN.
I want to the scenario/condition when we have to use YARN with IMPALA, becuase IMPALA has its own execution engine. When we have to use YARN with IMPALA?
I think Llama is meant for that only.
Created 04-17-2019 11:04 AM
I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.
There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.
Created 04-17-2019 11:04 AM
I think https://www.cloudera.com/documentation/enterprise/latest/topics/impala_admission.html#admission_yarn largely answers your question.
There's no supported YARN/Impala integration - they each manage their own resources separately. LLAMA was an integration point but it was deprecated and removed from Impala several years ago.
Created 04-17-2019 10:28 PM
Thank you very much Tim.
Provided link has clarified my doubt.