question Re: unable to start HDFS in CDH5.16 in Support Questions

unable to start HDFS in CDH5.16

Clouderanew — Fri, 10 Mar 2023 10:38:17 GMT

Hi community,

In my CDH5.16 Cluster, unable to start HDFS. Please find the screenshot below

Stderr log

Please help me.

Re: unable to start HDFS in CDH5.16

DianaTorres — Fri, 10 Mar 2023 15:49:53 GMT

@Clouderanew Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our HDFS experts @jgaragorry and @pajoshi who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

Re: unable to start HDFS in CDH5.16

pajoshi — Fri, 10 Mar 2023 15:54:37 GMT

Hi @Clouderanew ,

Could you check the role logs and provide the error which is appearing before the Namenode shutdown?

Kind Regards,

Parth Joshi

Re: unable to start HDFS in CDH5.16

Clouderanew — Sat, 11 Mar 2023 04:18:32 GMT

Hi Parth,

Thanks for your response.

I have format the Namenode and issue got resolved. I look forward to work with Cloudera community.

Re: unable to start HDFS in CDH5.16

VidyaSargur — Mon, 13 Mar 2023 06:41:37 GMT

@Clouderanew

Thank you for your response. Can you please provide the complete solution here? We can mark it as solved which will be of great help to other members who may face similar problems in the future.

Thank you once again for your contribution to our community, and we look forward to your continued participation and knowledge sharing.

Re: unable to start HDFS in CDH5.16

Clouderanew — Mon, 13 Mar 2023 06:57:36 GMT

Hi Vidya,

Thank you for your response. Issue was temporary fixed. When i started my cluster today, it is showing same error like, namenode failed to format. Again i have format the namenode and issue got resolved.

It would be better if you could provide a permanent solution for this issue.

Thanks

Syed Muntazir

Re: unable to start HDFS in CDH5.16

VidyaSargur — Mon, 13 Mar 2023 07:54:37 GMT

@Clouderanew, can you please provide the details that @pajoshi asked for? He will be able to help you once you provide the information.

Re: unable to start HDFS in CDH5.16

Clouderanew — Tue, 14 Mar 2023 04:54:00 GMT

@pajoshi,

When i started my cluster today, same error is occurred, Please assist on this. Daily i have to format the namenode then only it start working.

Encountered exception loading fsimage
java.io.IOException: NameNode is not formatted.
	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:238)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1152)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:799)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:614)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:676)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:844)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:823)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1547)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1615)

Re: unable to start HDFS in CDH5.16

pajoshi — Tue, 14 Mar 2023 16:42:14 GMT

Hello @Clouderanew ,

>> Could you check if the permissions of Namenode directory or its parent dir is getting changed?

>> Do you have a valid fsimage available?

Kind Regards,

Parth Joshi

Re: unable to start HDFS in CDH5.16

Clouderanew — Fri, 17 Mar 2023 09:41:52 GMT

Hello @pajoshi

hdfs namenode permission are below

hdfs dfs -ls /
Found 2 items
drwxr-xr-x - mapred mapred 0 2023-03-17 06:32 /tmp
drwxr-xr-x - mapred mapred 0 2023-03-17 06:32 /user

FSImage directory screenshot,

Please suggets

Re: unable to start HDFS in CDH5.16

Clouderanew — Mon, 20 Mar 2023 05:25:04 GMT

Hi Community,

Please assist me.