- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to monitor resources of impala queue
- Labels:
-
Apache Impala
Created on ‎03-12-2018 02:07 AM - edited ‎09-16-2022 05:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi guys:
After configured admission control of impala, I met some difficulties.
I tried to monitor the resource usage of the impala queue, but I can't find how to monitor it. Is there any way to monitor the queue of impala like yarn?
After all , impala use fair-scheduler.xml to configure admission control .
Created ‎03-14-2018 02:18 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
By default each time a query is admitted we log these stats for the query's pool.
If the default log level doesn't provide enough info, there's additional info that gets logged at higher levels, though of course keep in mind that more logging may slow queries down.
Created ‎03-13-2018 03:03 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
In particular, the /queries page will display a list of running or recent queries along with the resource pool they were assigned to
Created ‎03-13-2018 06:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks,
I find that page , but these queries do not show the queue they are on and how much resources are used. I also want to monitor the use of queues, such as how much resources have been used and how much resources are left. Do you have any good way to do this?
Created ‎03-14-2018 02:18 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
By default each time a query is admitted we log these stats for the query's pool.
If the default log level doesn't provide enough info, there's additional info that gets logged at higher levels, though of course keep in mind that more logging may slow queries down.
Created ‎03-20-2018 08:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
