Support Questions
Find answers, ask questions, and share your expertise

Using Cloudera Manager to Configure Hadoop Security,the test run error

Using Cloudera Manager to Configure Hadoop Security,the test run error

Contributor

Number of Maps = 10
Samples per Map = 10000
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Starting Job
14/06/22 18:45:47 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
14/06/22 18:45:47 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 20 for mapred on 172.20.0.11:8020
14/06/22 18:45:47 INFO security.TokenCache: Got dt for hdfs://namenode11.yeahmobi.com:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 172.20.0.11:8020, Ident: (HDFS_DELEGATION_TOKEN token 20 for mapred)
14/06/22 18:45:47 INFO mapred.FileInputFormat: Total input paths to process : 10
14/06/22 18:45:48 INFO mapred.JobClient: Running job: job_201406221843_0001
14/06/22 18:45:49 INFO mapred.JobClient: map 0% reduce 0%
14/06/22 18:45:49 INFO mapred.JobClient: Task Id : attempt_201406221843_0001_m_000011_0, Status : FAILED
Error initializing attempt_201406221843_0001_m_000011_0:
java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce/taskcontroller.cfg
Requested user mapred is banned

at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:195)
at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1472)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1447)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1362)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2790)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2754)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.ru

 

I am sure  the value specified for mapred.local.dir is identical in mapred-site.xml and taskcontroller.cfg,and The mapred.local.dir is owned and is writable by the mapred user.help..!!! 

1 REPLY 1

Re: Using Cloudera Manager to Configure Hadoop Security,the test run error

Contributor
..It is my problem.I use the banned user mapred to run the job.