Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Hive Logs: View counters for "MR" execution engine

avatar
Contributor

Hi,

I wanted to get details of the counters for each phase in map-reduce when hive queries are executed via "mr" engine.

For queries executed via TEZ i m able to get the details from yarn timeline server based on the DAG id/app id of the query.http://<ip-addr>:8188/ws/v1/timeline/TEZ_DAG_ID?primaryFilter=applicationId:<app-ID>

Basically I'm interested in number of records returned by the query, I dont even need counters for each map-reduce phase.

1 ACCEPTED SOLUTION

avatar
Contributor

For MR you should be able to get the counters from the Yarn UI for the MR job that ran as a result of the query.

View solution in original post

3 REPLIES 3

avatar
Contributor

For MR you should be able to get the counters from the Yarn UI for the MR job that ran as a result of the query.

avatar
Contributor

hi, thanks @ghagleitner. but i tried navigating yarn ui. but could find the counters. can you please give the navingation path

avatar
Contributor

Thanks - I located the counters. Btw, is there an rest api end point to access job tracker/counters information ?