https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170877#M54089 <P>how to find long running hadoop/yarn jobs by using command line.</P> Sat, 11 Feb 2017 20:48:03 GMT Former Member 2017-02-11T20:48:03Z https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170877#M54089 <P>how to find long running hadoop/yarn jobs by using command line.</P> Sat, 11 Feb 2017 20:48:03 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170877#M54089 Former Member 2017-02-11T20:48:03Z https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170878#M54090 <P>Hi <A rel="user nofollow noopener noreferrer" href="#" target="_blank">@kishore sanchina</A></P><P>There is not a straight command to get long running jobs. In Ambari 2.4, they have provided the Zeppelin Dashboard in SmartSense Service(1.3) where we can see all long running jobs and job which has used maximum memory etc., </P><P>Link: <A href="https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_user-guide/content/activity_explorer.html" target="_blank" rel="nofollow noopener noreferrer">https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.3.0/bk_user-guide/content/activity_explorer.html</A></P><P>Example Screenshot:</P><P><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="12305-longrunningjobslist.png" style="width: 456px;"><img src="https://community.cloudera.com/t5/image/serverpage/image-id/20083iC3204937FFB1D3E4/image-size/medium?v=v2&amp;px=400" role="button" title="12305-longrunningjobslist.png" alt="12305-longrunningjobslist.png" /></span></P><P>Option 2:</P><P>Prior to that, I have written a bash script which is a length process. Where I will gather all the information from Resource Manager URL using Resource Manager REST API calls and store that information in a CSV file. Then load that data in a CSV file to HDFS and then create a Hive external table on top of it. Then I use to run insert command and move the required columns to the final table and started running simple hive queries to get the list of all long running jobs.</P><P>Hope this helps you.</P> Sun, 18 Aug 2019 10:42:57 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170878#M54090 bandarusridhar1 2019-08-18T10:42:57Z https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170879#M54091 <P>@Sridhar Reddy,</P><P>Could please share the script if possible??</P> Fri, 18 May 2018 14:55:35 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/how-to-find-long-running-hadoop-yarn-jobs/m-p/170879#M54091 pdilip 2018-05-18T14:55:35Z