Created 07-23-2024 04:41 AM
Hi,
I’m experiencing an issue when multiple queries are executed simultaneously. When I run the query by itself, it succeeds. However, when multiple queries run concurrently, I encounter problems.
Does anyone know how I should configure Impala to avoid this issue? I’ve attached the profile of the failed query.
My mem_limit is set to 60GB for 5 workers and 90GB for the other 8.
Thanks,
Created on 07-24-2024 12:19 AM - edited 07-24-2024 12:26 AM
Created 07-23-2024 11:19 AM
@Edu7478 Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our Impala experts @ChethanYM @Chella @mszurap who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Created 07-23-2024 12:21 PM
Hello @Edu7478
This seems to be a common issue faced during high concurrency when there is no control on how much memory a query can utilise.
You can check below :
- all tables has updated stats
- configure / fine tume Impala Admission Control
Created 07-24-2024 12:16 AM
Hello @Saurabhatiyal,
Is there a guide or some tips we can follow to tune Impala Admision Control?
Thanks in advance,
Created on 07-24-2024 12:19 AM - edited 07-24-2024 12:26 AM
Created 07-29-2024 08:15 AM
@Edu7478 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
Regards,
Diana Torres,