Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

my datanode is not starting in hadoop 2.7.3 multi nodes

Highlighted

my datanode is not starting in hadoop 2.7.3 multi nodes

Contributor

my datanode is not starting in hadoop 2.7.3 multi nodes ( 1master, 2 slaves)

Here are my configuration files :
core-site.xml ( in master and slaves)
<configuration>
  <property>
  <name>hadoop.tmp.dir</name>
  <value>/app/hadoop/tmp</value>
  <description>A base for other temporary directories.</description>
</property>
<property>
  <name>fs.default.name</name>
  <value>hdfs://Hadoop:54310</value>
  <description>The name of the default file system.  A URI whose
  scheme and authority determine the FileSystem implementation.  The
  uri's scheme determines the config property (fs.SCHEME.impl) naming
  the FileSystem implementation class.  The uri's authority is used to
  determine the host, port, etc. for a filesystem.</description>
</property>
</configuration>
mapred-site.xml (in master and slaves)
<configuration>
<property>
  <name>mapred.job.tracker</name>
  <value>Hadoop:54311</value>
  <description>The host and port that the MapReduce job tracker runs
  at.  If "local", then jobs are run in-process as a single map
  and reduce task.
  </description>
</property>
<property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
</property>
</configuration>

hdfs-site.xml (in master)

<configuration>
<property>
    <name>dfs.replication</name>
    <value>2</value>
  </property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
<property>
    <name>dfs.namenode.name.dir</name>
    <value>file:/var/lib/hadoop/hdfs/namenode</value>
  </property>
</configuration>

hdfs-site.xml (in slaves)

<configuration>
<property>
    <name>dfs.replication</name>
    <value>2</value>
  </property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
<property>
    <name>dfs.datanode.data.dir</name>
    <value>file:/var/lib/hadoop/hdfs/datanode</value>
  </property>
</configuration>

yarn-site.xml ( in master and slaves)

<property>
    <name>yarn.resourcemanager.resource-tracker.address</name>
    <value>Hadoop:8025</value>
</property>
<property>
    <name>yarn.resourcemanager.scheduler.address</name>
    <value>Hadoop:8035</value>
</property>
<property>
    <name>yarn.resourcemanager.address</name>
    <value>Hadoop:8050</value>
</property>

jps in master node :

13856 SecondaryNameNode
14083 Jps
13620 NameNode
14010 ResourceManager

jps in slaves

6162 Jps
6044 NodeManager

Thnak you

14 REPLIES 14
Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

@ELMEHDI SAOUDI

could you please attach data node logs from following location?

/var/log/hadoop/hdfs/hadoop-hdfs-datanode-<hostname>.log

/var/log/hadoop/hdfs/hadoop-hdfs-datanode-<hostname>.out

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

please attach /usr/local/lib/hadoop-2.7.3/logs/hadoop-root-datanode-ubuntu.log file

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

@ELMEHDI SAOUDI I want to see this one hadoop-root-datanode-ubuntu.log

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

Contributor

@Rajkumar Singh it contains more than 6000 characters

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

@ELMEHDI SAOUDI

do attach is it as attachment, do you see any error exception in logs

alternatively you can reformat your namenode if there is nothing in data directory.

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

@ELMEHDI SAOUDI the following exception in data node state that you had formatted the namenode earliar but the traces of cluster id are remained in data node dir

p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 12.0px Menlo; color: #333333; -webkit-text-stroke: #333333; background-color: #ffffff} span.s1 {font-kerning: none}

java.io.IOException: Incompatible clusterIDs in /var/lib/hadoop/hdfs/datanode: namenode clusterID = CID-57be9ddb-b9ed-415d-af7f-9da056f2137e; datanode clusterID = CID-707e8000-a676-4e9f-81ba-af3e65ec3d2c

could you please try delete everything inside the /hadoop/hdfs/data directory and restart datanode?

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

Contributor

@Rajkumar Singh I deleted the contents of /usr/local/lib/hadoop-2.7.3/logs then I restarted hadoop but I found that there is no log file in this folder for datanodes (The previous files are old)

root@ubuntu:/usr/local/lib/hadoop-2.7.3/logs# ls
hadoop-root-namenode-ubuntu.log           SecurityAuth-root.audit
hadoop-root-namenode-ubuntu.out           userlogs
hadoop-root-secondarynamenode-ubuntu.log  yarn-root-resourcemanager-ubuntu.log
hadoop-root-secondarynamenode-ubuntu.out  yarn-root-resourcemanager-ubuntu.out



Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

@ELMEHDI SAOUDI I am asking you to delete the content of this directory (/hadoop/hdfs/data) not log directory

Highlighted

Re: my datanode is not starting in hadoop 2.7.3 multi nodes

Contributor

there is no directory And I restart but it is the same thing,

Don't have an account?
Coming from Hortonworks? Activate your account here