Hive query metrics about cpu and memory

[#1]

Hi,

I would like to know if there is a way to get metrics about cpu and memory usage.

For example, I would like to highlight the effect of a skew join on reducers, disk I/O, mapper memory usage during the querying, etc.

I saw really interesting slides about performance comparison (Hortonworks), with some graphes and bars, etc. and I was wondering the method to get those values...

Thanks.

[#2]

@Sebastien F

One approach will be to use hive JMX based approach to collect some of those details like: https://community.hortonworks.com/articles/62211/enabling-jmx-monitoring-for-hiveserver2.html

Grafana also can provide many graphs related to Hive:

https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.2.0/bk_ambari-operations/content/llap_overview....

https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.2.0/bk_ambari-operations/content/grafana_hive_h...

[#3]

Thanks a lot for your reply.

But, through JMX, will I be able to monitor a particular query ? Or just the global activity of the JVM ?