Reply
New Contributor
Posts: 5
Registered: ‎03-16-2016

Show full hive query on Resource Manager Web UI?

Hi there.

 

Is there any way to find the full SQL query when getting info about a hive job via the Resource Manager Web UI?

Now I can only see a truncated string of the SQL query.

 

Example: https://db.tt/p64FSTpc

 

 

Regards,

Posts: 1,524
Kudos: 265
Solutions: 232
Registered: ‎07-31-2013

Re: Show full hive query on Resource Manager Web UI

You are perhaps looking for hive.jobname.length, whose default is 50
characters overall (most of which is applied as the truncated limit over
the query string). Increasing it to a higher number should help you see
more parts of the query string, but I do not know if you will be able to
see the whole query for larger queries.

Are you looking for ways to track Hive queries from their jobs? The XMLs of
these jobs should carry a query ID you can then search up on the HS2 (if
that's the central source of your queries).
Backline Customer Operations Engineer
New Contributor
Posts: 5
Registered: ‎03-16-2016

Re: Show full hive query on Resource Manager Web UI

We are trying to find out which query was run for a specific job so we can see stats and logs for a specific query.

 

Sometimes we make small changes to a query and rerun it again. We would like to see stats for multiple runs of similar queries on History Server UI and Resource Manager UI but we can't differenciate the queries because the name is truncated so it is the same for different queries.

 

How can I get a job/query XML from Hive Server 2? Can you point me to a document with instructions?

 

Thanks.

Highlighted
Posts: 1,524
Kudos: 265
Solutions: 232
Registered: ‎07-31-2013

Re: Show full hive query on Resource Manager Web UI

Cloudera Manager's YARN -> Application page already does this for you BTW; Have you read http://www.cloudera.com/documentation/enterprise/latest/topics/cm_dg_yarn_applications.html?

 

Aside of showing you the full query behind a YARN MR2 Application, if the job was from a query, it can also show you all jobs pertaining to a single query instance, AND let you select multiple such jobs across different query instances. The charts tab can further let you compare various stats of the job. Does this not suffice?

 

Sample screenshot:

CM YARN Applications page for a Hive Query RLIKE filter matching anything read from table "test"

Backline Customer Operations Engineer
Announcements