Reply
Contributor
Posts: 78
Registered: ‎06-19-2014

Using Cloudera Manager to Configure Hadoop Security,the test run error

[ Edited ]

Number of Maps = 10
Samples per Map = 10000
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Starting Job
14/06/22 18:45:47 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
14/06/22 18:45:47 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 20 for mapred on 172.20.0.11:8020
14/06/22 18:45:47 INFO security.TokenCache: Got dt for hdfs://namenode11.yeahmobi.com:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 172.20.0.11:8020, Ident: (HDFS_DELEGATION_TOKEN token 20 for mapred)
14/06/22 18:45:47 INFO mapred.FileInputFormat: Total input paths to process : 10
14/06/22 18:45:48 INFO mapred.JobClient: Running job: job_201406221843_0001
14/06/22 18:45:49 INFO mapred.JobClient: map 0% reduce 0%
14/06/22 18:45:49 INFO mapred.JobClient: Task Id : attempt_201406221843_0001_m_000011_0, Status : FAILED
Error initializing attempt_201406221843_0001_m_000011_0:
java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce/taskcontroller.cfg
Requested user mapred is banned

at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:195)
at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1472)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1447)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1362)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2790)
at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2754)
Caused by: org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.ru

 

I am sure  the value specified for mapred.local.dir is identical in mapred-site.xml and taskcontroller.cfg,and The mapred.local.dir is owned and is writable by the mapred user.help..!!! 

Contributor
Posts: 78
Registered: ‎06-19-2014

Re: Using Cloudera Manager to Configure Hadoop Security,the test run error

..It is my problem.I use the banned user mapred to run the job.
Announcements