Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Running MR job on hadoop cluster and its failing with error - Failed to run job : Failed to renew token: Kind: HDFS_DELEGATION_TOKEN,

avatar
Explorer

Below is the stack trace:

6/03/04 13:13:11 INFO impl.TimelineClientImpl: Timeline service address: dcamhdppr1...ws/v1/timeline/
16/03/04 13:13:11 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 0 for ambari-qa on 10.20.37.222:8020
16/03/04 13:13:11 INFO security.TokenCache: Got dt for hdfs://<namenode>:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 10.20.30.111:8020, Ident: (HDFS_DELEGATION_TOKEN token 0 for ambari-qa)
16/03/04 13:13:11 INFO input.FileInputFormat: Total input paths to process : 1
16/03/04 13:13:11 INFO mapreduce.JobSubmitter: number of splits:1
16/03/04 13:13:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1457115085399_0001
16/03/04 13:13:11 INFO mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: 10.20.30.111:8020, Ident: (HDFS_DELEGATION_TOKEN token 0 for ambari-qa)
16/03/04 13:13:13 INFO impl.YarnClientImpl: Submitted application application_1457115085399_0001
16/03/04 13:13:13 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/ambari-qa/.staging/job_1457115085399_0001
java.io.IOException: Failed to run job : Failed to renew token: Kind: HDFS_DELEGATION_TOKEN, Service: 10.20.30.111:8020, Ident: (HDFS_DELEGATION_TOKEN token 0 for ambari-qa)
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:301)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:536)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
at java.security.AccessController.doPrivileged(Native Method)
1 ACCEPTED SOLUTION

avatar
Master Mentor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
2 REPLIES 2

avatar
Master Mentor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Master Guru

For me also it worked. While running distcp for secured clusters.