question Re: Access Running Job Metrics via JMX in Archives of Support Questions (Read Only)

Access Running Job Metrics via JMX

mhendricks — Mon, 09 May 2016 19:29:17 GMT

Can you access Job Metrics via JMX? I would like to see all running jobs and how long they have been running, how many containers were allocated,etc. It looks like the ResourceManager REST API provides what I'm looking for, but was wondering if it was available in JMX.

Re: Access Running Job Metrics via JMX

cstanca — Thu, 19 May 2016 02:17:11 GMT

@mhendricksT

Try this: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_hdfs_admin_tools/content/ch07.html

Re: Access Running Job Metrics via JMX

ScipioTheElder — Fri, 14 Oct 2016 21:52:33 GMT

@mhendricks

I have the exact same interest on monitoring all the containers of the job via JMX. However, my question is how to get the list of containers for a job assuming we can turn ON JMX for yarn containers?

Re: Access Running Job Metrics via JMX

TimothySpann — Fri, 14 Oct 2016 22:20:43 GMT

https://community.hortonworks.com/questions/6488/yarn-jmx-access.html

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_hdfs_admin_tools/content/ch07.html

http://www.slideshare.net/Hadoop_Summit/w-525hall1shenv2

Re: Access Running Job Metrics via JMX

ScipioTheElder — Sat, 15 Oct 2016 02:29:43 GMT

@Timothy Spann

Tim,

Thanks for the info. I can pull daemon JMX for sure since they are running all the time. However, I am more interested on per job based container. How to query YARN restful api to get a list of container for a job?

Re: Access Running Job Metrics via JMX

TimothySpann — Sat, 15 Oct 2016 02:53:46 GMT

seems like everything is here:

https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Metrics_API

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.2/bk_yarn_resource_mgt/content/ch_yarn_rest_apis.html

https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/YarnCommands.html#container

command line

yarn application -list

get your list of job ids

yarn container -list application_1475786720159_0003

Re: Access Running Job Metrics via JMX

ScipioTheElder — Mon, 17 Oct 2016 10:45:33 GMT

My problem is how to set different JMX ports on the containers running on the same slave node.

Re: Access Running Job Metrics via JMX

sunile_manjee — Wed, 19 Oct 2016 12:35:46 GMT

Have you looked at this article?

https://community.hortonworks.com/content/kbentry/61188/enable-jmx-metrics-on-hadoop-using-jmxterm.html