how can we identify a job taking more resources than allocation?

[#1]

@pavan p

If you are using Ambari version earlier than 2.4 you will have new future in Map Reduce and Tez Dashboard in Zeppelin Dashboard Activity Explorer(SmartSense) where it shows "Top N Resource Wasting Jobs".

Links: https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.4.0/bk_user-guide/content/mr_notebook.htm...

https://hortonworks.com/blog/whats-new-smartsense-1-3/

Hope this helps you in further identifying your jobs.