question Re: Got error java.io.IOException: NameNode is not formatted, but no option to format the name node in Archives of Support Questions (Read Only)

Got error java.io.IOException: NameNode is not formatted, but no option to format the name node

flushing101 — Tue, 31 Oct 2017 12:00:31 GMT

"Version: Cloudera Enterprise Data Hub Edition Trial 5.11.0 (#101 built by jenkins on 20170412-1249 git: 70cb1442626406432a6e7af5bdf206a384ca3f98)"

Failed to start Name Server for HDFS. with the following error "java.io.IOException: NameNode is not formatted."

2017-07-03 00:14:56,117 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
java.io.IOException: NameNode is not formatted.
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:222)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1096)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:780)
at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)

Try to follow "http://www.cloudera.com/documentation/manager/5-0-x/Cloudera-Manager-Managing-Clusters/cm5mc_nn.html" to format the name node directory. but there is no such action in the action menu for the selected Name node instance.

Re: Got error java.io.IOException: NameNode is not formatted, but no option to format the name node

csguna — Mon, 03 Jul 2017 06:47:02 GMT

I belive you are having a runining namenode instances under HDFS .

When you should the namenode instance - the format will be enabled .

while it is runining it is disabled .

But you should do the name format by carefully calculating the impact .

Hadoop namenode directory contains the fsimage and edit files 
which holds the basic information's about hadoop file system such 
as where is data available, which user created files (meta data )
If you format the namenode then the above information's are deleted from namenode directory 
which is specified in the hdfs-site.xml as dfs.namenode.name.dir
But you would  still left out with datas on the hadoop but not namenode meta data refernce.

Re: Got error java.io.IOException: NameNode is not formatted, but no option to format the name node

flushing101 — Tue, 04 Jul 2017 14:17:31 GMT

Thanks for the advise. I am new in hadoop world. your suggestion is very helpful.

However, I am not so sure if the format option is avaiable through the interface after stopped name node. Here is my screen shot.

Then I try to see if there is action I can take for selected instance, but there is no such option to format the namenode and recreate these checkpoint related files.

Thanks again for your time.

Re: Got error java.io.IOException: NameNode is not formatted, but no option to format the name node

flushing101 — Tue, 04 Jul 2017 14:50:47 GMT

I found a alternative for this based on documentation https://www.cloudera.com/documentation/enterprise/latest/topics/cdh_ig_hdfs_cluster_deploy.html#topic_11_2_5

Run the following Command and formated the Namenode. Thanks all

sudo -u hdfs hdfs namenode -format

Re: Got error java.io.IOException: NameNode is not formatted, but no option to format the name node

clouderakruzer — Mon, 30 Oct 2017 20:28:37 GMT

Hi flushin101,

You can find the option to 'Format Name Node', by clicking on the instance on which you intend to format the name node, from the 'screen shot' you had pasted in the previous reply. Once you click on the node/host/instance, we are provided with the 'Actions' menu (displayed next to he host/node name). We can then find the 'Format' option within that drop down menu.

Please ignore if you already knew this.

Re: Got error java.io.IOException: NameNode is not formatted, but no option to format the name node

clouderakruzer — Tue, 31 Oct 2017 08:39:32 GMT

It looks like the instructions I had posted in my earlier post, are too vague!. So I thought of adding some screen shots to make it easier to understand.

1. From Cloudera Manager HOME, select the 'HDFS'.

2. Once inside the HDFS home page, click on 'Instances' menu.

3. Once the instances that make up the HDFS component of the CDH are listed, click on the Role Type 'NameNode'. We do NOT have to select 'NameNode', using the check box (this is what i was doing initially), but just click on the 'NameNode' itself.

4. Once the NameNode instance's page comes up, select the 'Action' menu to find the 'FORMAT' option!.

Click on it to perform the format of the 'NameNode'.