Support Questions

Find answers, ask questions, and share your expertise

Way to debug DataNode adding to Hadoop cluster

avatar
Explorer

Hello Team,

 

I  have installed hadoop -1.2.1 in oracle virtual box and working fine without any issue.

 

Additionally, i have added one datanode also but it's not showing in hadoop cluster.

 

When i start services in masternode, below message was showing

 

/*

student@master:~/Installations/hadoop-1.2.1/bin$ ./start-all.sh
starting namenode, logging to /home/student/Installations/hadoop-1.2.1/libexec/../logs/hadoop-student-namenode-master.out
node2: bash: line 0: cd: /home/student/Installations/hadoop-1.2.1/libexec/..: No such file or directory
node2: bash: /home/student/Installations/hadoop-1.2.1/bin/hadoop-daemon.sh: No such file or directory
master: starting datanode, logging to /home/student/Installations/hadoop-1.2.1/libexec/../logs/hadoop-student-datanode-master.out
master: starting secondarynamenode, logging to /home/student/Installations/hadoop-1.2.1/libexec/../logs/hadoop-student-secondarynamenode-master.out
starting jobtracker, logging to /home/student/Installations/hadoop-1.2.1/libexec/../logs/hadoop-student-jobtracker-master.out
node2: bash: line 0: cd: /home/student/Installations/hadoop-1.2.1/libexec/..: No such file or directory
node2: bash: /home/student/Installations/hadoop-1.2.1/bin/hadoop-daemon.sh: No such file or directory
master: starting tasktracker, logging to /home/student/Installations/hadoop-1.2.1/libexec/../logs/hadoop-student-tasktracker-master.out
student@master:~/Installations/hadoop-1.2.1/bin$ jps
8786 SecondaryNameNode
9073 Jps
8860 JobTracker
8656 DataNode
9000 TaskTracker
8522 NameNode

*/

 

 how to debug the exact issue?

 

Regads,

Yknev

11 REPLIES 11

avatar
Explorer

Hello,

 

I have found the root cause of issue.

 

Actually my datanode having differen user than masternode(eg. Masternode OS user - student and datanode os user - node2user), so both these OS users having different default path i.e /home/student for masternode and /home/node2user for node2.

 

To given common path for both masternode and datanode, i have created new user for datanode i.e studnet (same as masternode). so both OS users having same path now. i.e /home/student.

 

I have copied this path in core-site.xml and working fine.

 

Is it required to be maintain same user name for both masternode and datanode?

 

In case if user name is different than masternode , how can i choose the path?

 

Thanks in advance

 

 

 

avatar
Champion

if you read my previous reply , thats exactly I told that your fs.default should be same across all the nodes more over same version of core-site.xml .

to be more precies 

 

This is used to specify the default file system it needs be set to a HDFS address. this is need for  client configuration as well so your local configuration file should include this element.

 

hdfs://192.168.1.200:9000/. Here 9000 denotes port on which datanode will send heartbeat to namenode