Can you access Job Metrics via JMX? I would like to see all running jobs and how long they have been running, how many containers were allocated,etc. It looks like the ResourceManager REST API provides what I'm looking for, but was wondering if it was available in JMX.
I have the exact same interest on monitoring all the containers of the job via JMX. However, my question is how to get the list of containers for a job assuming we can turn ON JMX for yarn containers?
Thanks for the info. I can pull daemon JMX for sure since they are running all the time. However, I am more interested on per job based container. How to query YARN restful api to get a list of container for a job?
seems like everything is here:
yarn application -list
get your list of job ids
yarn container -list application_1475786720159_0003