Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

impala query history

impala query history

New Contributor

If I go to Cloudera Manager, I can click on Impala, then Queries to see the impala query history.

 

I would like to extract all available query history and dump it into my own database for analysis. Is the query history stored in CM database (we use mysql)?

4 REPLIES 4

Re: impala query history

Master Guru
CM DB is not for direct use as it is not a user/dev facing element (no compatibility guarantees).

CM instead offers an API that can be used for almost any/every action you otherwise do over the UI: http://cloudera.github.io/cm_api/

For Impala queries, use this API end-point: http://cloudera.github.io/cm_api/apidocs/v11/path__clusters_-clusterName-_services_-serviceName-_imp... You can get the same data that the UI shows (both are powered by the same source)

Re: impala query history

New Contributor

Thanks..actually I've already gone that route. There's a hard limit of 1000 queries being returned, so I had to schedule the job ask for query history within a 1 hour period so as not to exceed that 1000 limit.

 

Thanks!

Highlighted

Re: impala query history

New Contributor

tsusanto, did you get a solution for this ? Querying the Database seems the only option as we see it

 

Thanks,

 

Re: impala query history

Cloudera Employee

@MahendraDevu you can use the cm api's paging feature using the offset parameter to flip through the queries.

 

Thanks,

Shashank