@rbalam, third steps should be check the permission of that user to read the classpath directory and hdfs folder ... View more

@rbalam, if above solution not work then check the yarn-site.xml is set yarn.application.classpath properly. (required lib directory should be exists. ... View more

@rbalam, First check the java version and java version path env variable if not the same ten create soft link $JAVA_HOM/bin/java to /usr/bin/java #java -version Cross check steps for reference: [root@sandbox ~]# which java /usr/lib/jvm/java-1.7.0-openjdk.x86_64/bin/java [root@sandbox ~]# ls -l /usr/bin/java lrwxrwxrwx 1 root root 22 2014-12-16 18:25 /usr/bin/java -> /etc/alternatives/java [root@sandbox ~]# ls -l /etc/alternatives/java lrwxrwxrwx 1 root root 46 2014-12-16 18:25 /etc/alternatives/java -> /usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java Check the java home path is set properly vi /etc/hadoop/conf/hadoop-env.sh Run the simple pi mapreduce job #yarn jar /usr/hdp/2.3.2.0-2950/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 1 1 ... View more

@rbalam, your previous problem is resolved "User xxxxx not found Failing this attempt". here the containers are not launching but it should show a reason why, so you have debug yarn log. Usually this problems comes when you have different JAVA versions, classpath is not properly set or directory permission. ... View more

@rbalam, yes I am sure, its will get resolve after adding user on other nodes also. Now first you have to resolve this issue then we can think on other problems. First time you can try with one user which is exists on every node and see the output of mapreduce job. You have to use centralized LDAP/Directory along with Kerberos server for user management to reduce maintenance head-ache. ... View more

I think in your case your client system from where you execute the query its not able to communicate with namenode and datanode systems using kerberos authentication. For debugging check kerberos log file so you can find out from which user query get executed with fqdn system names and reason of failure job. ... View more

@rbalam when your hadoop cluster integrated with Kerberos security then authenticated user must exist in the every node where the task runs. Refer link which already shared by "rahul pathak" ... View more

hi @ARUNKUMAR RAMASAMY, @Sagar Shimpi I verified with removing user "vgadade" from datanode, please find below output on secure hadoop cluster Here is sample job output.. 16/02/17 01:47:24 INFO mapreduce.Job: Job job_1455179809801_0007 running in uber mode : false 16/02/17 01:47:24 INFO mapreduce.Job: map 0% reduce 0% 16/02/17 01:47:26 INFO mapreduce.Job: Task Id : attempt_1455179809801_0007_m_000001_0, Status : FAILED Application application_1455179809801_0007 initialization failed (exitCode=255) with output: main : command provided 0 main : run as user is vgadade main : requested yarn user is vgadade User vgadade not found 16/02/17 01:47:29 INFO mapreduce.Job: Task Id : attempt_1455179809801_0007_m_000001_1, Status : FAILED Application application_1455179809801_0007 initialization failed (exitCode=255) with output: main : command provided 0 main : run as user is vgadade main : requested yarn user is vgadade User vgadade not found 16/02/17 01:47:30 INFO mapreduce.Job: map 50% reduce 0% 16/02/17 01:47:32 INFO mapreduce.Job: Task Id : attempt_1455179809801_0007_m_000001_2, Status : FAILED Application application_1455179809801_0007 initialization failed (exitCode=255) with output: main : command provided 0 main : run as user is vgadade main : requested yarn user is vgadade User vgadade not found 16/02/17 01:47:37 INFO mapreduce.Job: map 100% reduce 0% 16/02/17 01:47:43 INFO mapreduce.Job: map 100% reduce 100% 16/02/17 01:47:44 INFO mapreduce.Job: Job job_1455179809801_0007 completed successfully Job Counters Failed map tasks=3 Launched map tasks=5 Launched reduce tasks=1 Other local map tasks=3 Data-local map tasks=1 Rack-local map tasks=1 Job Finished in 28.409 seconds Nodemanager log out file ouput 2016-02-17 01:47:24,944 WARN org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor: Exit code from container container_e21_1455179809801_0007_01_000002 startLocalizer is : 255 java.io.IOException: Application application_1455179809801_0007 initialization failed (exitCode=255) with output: main : command provided 0 main : run as user is vgadade main : requested yarn user is vgadade User vgadade not found at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.startLocalizer(LinuxContainerExecutor.java:262) 2016-02-17 01:47:24,946 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.Container: Container container_e21_1455179809801_0007_01_000002 transitioned from LOCALIZING to LOCALIZATION_FAILED vgadade user added again on datanode and executed job ( container is successfully launched on previous Data node) Here is sample job output.. 16/02/17 01:55:46 INFO mapreduce.Job: Running job: job_1455179809801_0008 16/02/17 01:55:52 INFO mapreduce.Job: Job job_1455179809801_0008 running in uber mode : false 16/02/17 01:55:52 INFO mapreduce.Job: map 0% reduce 0% 16/02/17 01:55:58 INFO mapreduce.Job: map 100% reduce 0% 16/02/17 01:56:04 INFO mapreduce.Job: map 100% reduce 100% 16/02/17 01:56:04 INFO mapreduce.Job: Job job_1455179809801_0008 completed successfully 16/02/17 01:56:05 INFO mapreduce.Job: Counters: 50 Job Counters Launched map tasks=2 Launched reduce tasks=1 Data-local map tasks=1 Rack-local map tasks=1 Job Finished in 20.333 seconds ... View more