Running MR job on hadoop cluster and its failing with error - Failed to run job : Failed to renew token: Kind: HDFS_DELEGATION_TOKEN,

[#1]

Below is the stack trace:

6/03/04 13:13:11 INFO impl.TimelineClientImpl: Timeline service address: dcamhdppr1...ws/v1/timeline/
16/03/04 13:13:11 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 0 for ambari-qa on 10.20.37.222:8020
16/03/04 13:13:11 INFO security.TokenCache: Got dt for hdfs://<namenode>:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 10.20.30.111:8020, Ident: (HDFS_DELEGATION_TOKEN token 0 for ambari-qa)
16/03/04 13:13:11 INFO input.FileInputFormat: Total input paths to process : 1
16/03/04 13:13:11 INFO mapreduce.JobSubmitter: number of splits:1
16/03/04 13:13:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1457115085399_0001
16/03/04 13:13:11 INFO mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: 10.20.30.111:8020, Ident: (HDFS_DELEGATION_TOKEN token 0 for ambari-qa)
16/03/04 13:13:13 INFO impl.YarnClientImpl: Submitted application application_1457115085399_0001
16/03/04 13:13:13 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/ambari-qa/.staging/job_1457115085399_0001
java.io.IOException: Failed to run job : Failed to renew token: Kind: HDFS_DELEGATION_TOKEN, Service: 10.20.30.111:8020, Ident: (HDFS_DELEGATION_TOKEN token 0 for ambari-qa)
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:536)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
at java.security.AccessController.doPrivileged(Native Method)

[#2 · Accepted solution]

@sam kale

I was able to fix this issue by restarting Yarn

[#3]

For me also it worked. While running distcp for secured clusters.