Hive Logs: View counters for "MR" execution engine

[#1]

Hi,

I wanted to get details of the counters for each phase in map-reduce when hive queries are executed via "mr" engine.

For queries executed via TEZ i m able to get the details from yarn timeline server based on the DAG id/app id of the query.http://<ip-addr>:8188/ws/v1/timeline/TEZ_DAG_ID?primaryFilter=applicationId:<app-ID>

Basically I'm interested in number of records returned by the query, I dont even need counters for each map-reduce phase.

[#2 · Accepted solution]

For MR you should be able to get the counters from the Yarn UI for the MR job that ran as a result of the query.

[#3]

hi, thanks @ghagleitner. but i tried navigating yarn ui. but could find the counters. can you please give the navingation path

[#4]

Thanks - I located the counters. Btw, is there an rest api end point to access job tracker/counters information ?