Reply
Explorer
Posts: 12
Registered: ‎03-12-2018
Accepted Solution

How to monitor resources of impala queue

Hi guys:

        After configured admission control of impala, I met some difficulties.

        I tried to monitor the resource usage of the impala queue, but I can't find how to monitor it. Is there any way to monitor the queue of impala like yarn?

        After all , impala use fair-scheduler.xml to configure admission control .

Cloudera Employee
Posts: 6
Registered: ‎06-02-2017

Re: How to monitor resources of impala queue

Impala has a webui, by default run on port 25000 of each impalad node, that you may find useful.

In particular, the /queries page will display a list of running or recent queries along with the resource pool they were assigned to
Explorer
Posts: 12
Registered: ‎03-12-2018

Re: How to monitor resources of impala queue

Thanks,

    I find that page , but these queries do not show the queue they are on and how much resources are used. I also want to monitor the use of queues, such as how much resources have been used and how much resources are left. Do you have any good way to do this?

Cloudera Employee
Posts: 6
Registered: ‎06-02-2017

Re: How to monitor resources of impala queue

You can see the number of queued/admitted queries and mem used per pool by inspecting the logs, eg. impalad.INFO. Look for lines that come from admission-controller.cc

By default each time a query is admitted we log these stats for the query's pool.

If the default log level doesn't provide enough info, there's additional info that gets logged at higher levels, though of course keep in mind that more logging may slow queries down.
Explorer
Posts: 12
Registered: ‎03-12-2018

Re: How to monitor resources of impala queue

Thanks ! And I find the /metrics page can also show these information which in logs.
Announcements