Yarn application job list not showing completed jobs

[#1]

Hi I'm brand new to cloudera.  I've installed a 3 node cdh 5.3 cluster.  I ran the example pi  map reduce job with

yarn jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100

 The job runs successfully and during the execution of the job I can see the status in the yarn application list in the Cloudera Manager.  However, when the job is complete, the status disappears and I simply get the message 

No YARN applications found. Try expanding the time range or relaxing your filter criteria.

Widening the time filters has no effect

Can someone give me a little guidance on how to get completed jobs to show up int the job list? Or am I not understanding the functionality of the application list?  Thanks

[#2]

I have the same situation. Did anybody could solve this problem?

[#3]

Hello @tuckerrogerd @mchia

Thanks for posting your query!

Do you login as admin user in your Cloudera Cluster ? Also are you able to see the jobs in Resource Manager Web UI or Job History server ?

[#4]

Hello @satz

Thanks for your quick response!!

Yes I login as admin user and I can see the jobs in both Resource Manager Web UI and Job History server but I can't see them in the Yarn Application list

[#5]

@mchia Is your cluster is Kerberos enabled ? And you have configured YARN ACLs on your cluster ?

Please check the below from your Cloudera Manager >> YARN configurations

a) Search for "Admin Users Applications List Visibility Settings" >> It should be selected as "All"

b) Also you can check "Non-Admin Users Applications List Visibility Settings"  as well

[#6]

@satz is correct my cluster is Kerberos enabled and it is configured with YARN ACLs

a) and b) in both cases are selected as "All"

Regards

[#7]

Thanks for your input

Please check and share below configuration values from your Cloudera Manager's YARN configurations 

yarn.admin.acl 

mapreduce.job.acl-view-job

[#8]

@satz this is my current configuration

yarn.admin.acl:
nobody admin_group

mapreduce.job.acl-view-job:
nobody admin_group

where nobody means we don't have users configured directly in this access and admin_group is an Active Directory group where the admin user belongs

Regards,
mchia

[#9]

@mchia Thanks for your update

From your input I believe you added a space between the username and Group name (which is correct) 

could you please try below setting once and let us know

1) Cloudera Manager->Yarn->Configuration > yarn.admin.acls 

yarn,hue <your_admin_group>

Note there is a space between the list of users and the list of groups (in above list)

2) Cloudera Manager==>Yarn==>Configuration==>MapReduce Client Advanced Configuration Snippet (Safety Valve) for mapred-site.xml 

<property> 
<name>mapreduce.cluster.acls.enabled</name> 
<value>true</value> 
</property> 

<property> 
<name>mapreduce.cluster.administrators</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

<property> 
<name>mapreduce.job.acl-view-job</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

Note there is a space between the list of users and the list of groups (in above list)

3) Cloudera Manager==>Yarn==>Configuration==>YARN Service MapReduce Advanced Configuration Snippet (Safety Valve) 

<property> 
<name>mapreduce.cluster.acls.enabled</name> 
<value>true</value> 
</property> 

<property> 
<name>mapreduce.cluster.administrators</name> 
<value>yarn,hue <your_admin_group>s</value> 
</property> 

<property> 
<name>mapreduce.job.acl-view-job</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

Please try to add hue user and try executing your job

[#10]

Hi Satz,

I found the same issue but Kerberos is not enabled.
"Admin Users Applications List Visibility Settings" = All , and "Non-Admin Users Applications List Visibility Settings" = All.
Please help.
Thank you.