Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Yarn application job list not showing completed jobs

Yarn application job list not showing completed jobs

New Contributor

Hi I'm brand new to cloudera.  I've installed a 3 node cdh 5.3 cluster.  I ran the example pi  map reduce job with

 

yarn jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100

 The job runs successfully and during the execution of the job I can see the status in the yarn application list in the Cloudera Manager.  However, when the job is complete, the status disappears and I simply get the message 

 

No YARN applications found. Try expanding the time range or relaxing your filter criteria.

 

Widening the time filters has no effect

 

Can someone give me a little guidance on how to get completed jobs to show up int the job list? Or am I not understanding the functionality of the application list?  Thanks

 

10 REPLIES 10

Re: Yarn application job list not showing completed jobs

New Contributor

I have the same situation. Did anybody could solve this problem?

Re: Yarn application job list not showing completed jobs

Rising Star

Hello @tuckerrogerd @mchia

 

Thanks for posting your query!

 

Do you login as admin user in your Cloudera Cluster ? Also are you able to see the jobs in Resource Manager Web UI or Job History server ?

 

 

Thanks,
Satz

Re: Yarn application job list not showing completed jobs

New Contributor
Hello @satz

Thanks for your quick response!!

Yes I login as admin user and I can see the jobs in both Resource Manager Web UI and Job History server but I can't see them in the Yarn Application list

Re: Yarn application job list not showing completed jobs

Rising Star

@mchia Is your cluster is Kerberos enabled ? And you have configured YARN ACLs on your cluster ?

 

Please check the below from your Cloudera Manager >> YARN configurations

 

a) Search for "Admin Users Applications List Visibility Settings" >> It should be selected as "All"

b) Also you can check "Non-Admin Users Applications List Visibility Settings"  as well

Thanks,
Satz

Re: Yarn application job list not showing completed jobs

New Contributor
@satz is correct my cluster is Kerberos enabled and it is configured with YARN ACLs

a) and b) in both cases are selected as "All"

Regards

Re: Yarn application job list not showing completed jobs

Rising Star

Thanks for your input

 

Please check and share below configuration values from your Cloudera Manager's YARN configurations 

 

yarn.admin.acl 

mapreduce.job.acl-view-job

Thanks,
Satz

Re: Yarn application job list not showing completed jobs

New Contributor
@satz this is my current configuration

yarn.admin.acl:
nobody admin_group

mapreduce.job.acl-view-job:
nobody admin_group

where nobody means we don't have users configured directly in this access and admin_group is an Active Directory group where the admin user belongs

Regards,
mchia

Re: Yarn application job list not showing completed jobs

Rising Star

@mchia Thanks for your update

 

From your input I believe you added a space between the username and Group name (which is correct) 

 

could you please try below setting once and let us know

 

1) Cloudera Manager->Yarn->Configuration > yarn.admin.acls 

yarn,hue <your_admin_group>

Note there is a space between the list of users and the list of groups (in above list)

 

2) Cloudera Manager==>Yarn==>Configuration==>MapReduce Client Advanced Configuration Snippet (Safety Valve) for mapred-site.xml 

<property> 
<name>mapreduce.cluster.acls.enabled</name> 
<value>true</value> 
</property> 

<property> 
<name>mapreduce.cluster.administrators</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

<property> 
<name>mapreduce.job.acl-view-job</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

 

Note there is a space between the list of users and the list of groups (in above list)

 

3) Cloudera Manager==>Yarn==>Configuration==>YARN Service MapReduce Advanced Configuration Snippet (Safety Valve) 

<property> 
<name>mapreduce.cluster.acls.enabled</name> 
<value>true</value> 
</property> 

<property> 
<name>mapreduce.cluster.administrators</name> 
<value>yarn,hue <your_admin_group>s</value> 
</property> 

<property> 
<name>mapreduce.job.acl-view-job</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

 

Please try to add hue user and try executing your job

Thanks,
Satz

Re: Yarn application job list not showing completed jobs

New Contributor
Hi Satz,

I found the same issue but Kerberos is not enabled.
"Admin Users Applications List Visibility Settings" = All , and "Non-Admin Users Applications List Visibility Settings" = All.
Please help.
Thank you.