Reply
New Contributor
Posts: 4
Registered: ‎02-08-2015

Yarn application job list not showing completed jobs

Hi I'm brand new to cloudera.  I've installed a 3 node cdh 5.3 cluster.  I ran the example pi  map reduce job with

 

yarn jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100

 The job runs successfully and during the execution of the job I can see the status in the yarn application list in the Cloudera Manager.  However, when the job is complete, the status disappears and I simply get the message 

 

No YARN applications found. Try expanding the time range or relaxing your filter criteria.

 

Widening the time filters has no effect

 

Can someone give me a little guidance on how to get completed jobs to show up int the job list? Or am I not understanding the functionality of the application list?  Thanks

 

New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: Yarn application job list not showing completed jobs

I have the same situation. Did anybody could solve this problem?

Posts: 44
Topics: 0
Kudos: 6
Solutions: 4
Registered: ‎05-15-2018

Re: Yarn application job list not showing completed jobs

Hello @tuckerrogerd @mchia

 

Thanks for posting your query!

 

Do you login as admin user in your Cloudera Cluster ? Also are you able to see the jobs in Resource Manager Web UI or Job History server ?

 

 

Thanks,
Satz
New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: Yarn application job list not showing completed jobs

Hello @satz

Thanks for your quick response!!

Yes I login as admin user and I can see the jobs in both Resource Manager Web UI and Job History server but I can't see them in the Yarn Application list
Posts: 44
Topics: 0
Kudos: 6
Solutions: 4
Registered: ‎05-15-2018

Re: Yarn application job list not showing completed jobs

@mchia Is your cluster is Kerberos enabled ? And you have configured YARN ACLs on your cluster ?

 

Please check the below from your Cloudera Manager >> YARN configurations

 

a) Search for "Admin Users Applications List Visibility Settings" >> It should be selected as "All"

b) Also you can check "Non-Admin Users Applications List Visibility Settings"  as well

Thanks,
Satz
New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: Yarn application job list not showing completed jobs

@satz is correct my cluster is Kerberos enabled and it is configured with YARN ACLs

a) and b) in both cases are selected as "All"

Regards
Posts: 44
Topics: 0
Kudos: 6
Solutions: 4
Registered: ‎05-15-2018

Re: Yarn application job list not showing completed jobs

Thanks for your input

 

Please check and share below configuration values from your Cloudera Manager's YARN configurations 

 

yarn.admin.acl 

mapreduce.job.acl-view-job

Thanks,
Satz
New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: Yarn application job list not showing completed jobs

@satz this is my current configuration

yarn.admin.acl:
nobody admin_group

mapreduce.job.acl-view-job:
nobody admin_group

where nobody means we don't have users configured directly in this access and admin_group is an Active Directory group where the admin user belongs

Regards,
mchia
Highlighted
Posts: 44
Topics: 0
Kudos: 6
Solutions: 4
Registered: ‎05-15-2018

Re: Yarn application job list not showing completed jobs

@mchia Thanks for your update

 

From your input I believe you added a space between the username and Group name (which is correct) 

 

could you please try below setting once and let us know

 

1) Cloudera Manager->Yarn->Configuration > yarn.admin.acls 

yarn,hue <your_admin_group>

Note there is a space between the list of users and the list of groups (in above list)

 

2) Cloudera Manager==>Yarn==>Configuration==>MapReduce Client Advanced Configuration Snippet (Safety Valve) for mapred-site.xml 

<property> 
<name>mapreduce.cluster.acls.enabled</name> 
<value>true</value> 
</property> 

<property> 
<name>mapreduce.cluster.administrators</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

<property> 
<name>mapreduce.job.acl-view-job</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

 

Note there is a space between the list of users and the list of groups (in above list)

 

3) Cloudera Manager==>Yarn==>Configuration==>YARN Service MapReduce Advanced Configuration Snippet (Safety Valve) 

<property> 
<name>mapreduce.cluster.acls.enabled</name> 
<value>true</value> 
</property> 

<property> 
<name>mapreduce.cluster.administrators</name> 
<value>yarn,hue <your_admin_group>s</value> 
</property> 

<property> 
<name>mapreduce.job.acl-view-job</name> 
<value>yarn,hue <your_admin_group></value> 
</property> 

 

Please try to add hue user and try executing your job

Thanks,
Satz
Announcements