Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

impala query history

impala query history

New Contributor

If I go to Cloudera Manager, I can click on Impala, then Queries to see the impala query history.

 

I would like to extract all available query history and dump it into my own database for analysis. Is the query history stored in CM database (we use mysql)?

4 REPLIES 4

Re: impala query history

Master Guru
CM DB is not for direct use as it is not a user/dev facing element (no compatibility guarantees).

CM instead offers an API that can be used for almost any/every action you otherwise do over the UI: http://cloudera.github.io/cm_api/

For Impala queries, use this API end-point: http://cloudera.github.io/cm_api/apidocs/v11/path__clusters_-clusterName-_services_-serviceName-_imp... You can get the same data that the UI shows (both are powered by the same source)
Highlighted

Re: impala query history

New Contributor

Thanks..actually I've already gone that route. There's a hard limit of 1000 queries being returned, so I had to schedule the job ask for query history within a 1 hour period so as not to exceed that 1000 limit.

 

Thanks!

Re: impala query history

New Contributor

tsusanto, did you get a solution for this ? Querying the Database seems the only option as we see it

 

Thanks,

 

Re: impala query history

Cloudera Employee

@MahendraDevu you can use the cm api's paging feature using the offset parameter to flip through the queries.

 

Thanks,

Shashank

Don't have an account?
Coming from Hortonworks? Activate your account here