Support Questions
Find answers, ask questions, and share your expertise

Unable to start data node

I had installed datanode and trying to start it via ambari but it was throwing some error. I tried to check the logs in /var/log/hadoop/hdfs and could not understand the issue. Does anyone faced this issue before ?

 

at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1417)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:500)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2782)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2690)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2732)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2876)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2900)
2019-12-19 07:42:35,127 INFO server.AbstractConnector (AbstractConnector.java:doStart(278)) - Started ServerConnector@53812a9b{HTTP/1.1,[http/1.1]}{localhost:41704}
2019-12-19 07:42:35,127 INFO server.Server (Server.java:doStart(414)) - Started @3594ms
2019-12-19 07:42:35,131 INFO server.AbstractConnector (AbstractConnector.java:doStop(318)) - Stopped ServerConnector@53812a9b{HTTP/1.1,[http/1.1]}{localhost:0}
2019-12-19 07:42:35,131 INFO handler.ContextHandler (ContextHandler.java:doStop(910)) - Stopped o.e.j.w.WebAppContext@cb191ca{/,null,UNAVAILABLE}{/datanode}
2019-12-19 07:42:35,137 INFO datanode.DataNode (DataNode.java:shutdown(2134)) - Shutdown complete.
2019-12-19 07:42:35,137 ERROR datanode.DataNode (DataNode.java:secureMain(2883)) - Exception in secureMain
java.io.IOException: Problem starting http server
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1165)
at org.apache.hadoop.hdfs.server.datanode.web.DatanodeHttpServer.<init>(DatanodeHttpServer.java:141)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startInfoServer(DataNode.java:957)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1417)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:500)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2782)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2690)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2732)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2876)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2900)
Caused by: java.lang.NullPointerException
at org.eclipse.jetty.util.IO.delete(IO.java:344)
at org.eclipse.jetty.webapp.WebInfConfiguration.deconfigure(WebInfConfiguration.java:195)
at org.eclipse.jetty.webapp.WebAppContext.stopContext(WebAppContext.java:1380)
at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:880)
at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:272)
at org.eclipse.jetty.webapp.WebAppContext.doStop(WebAppContext.java:546)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:142)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:160)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:142)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:160)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
at org.eclipse.jetty.server.Server.doStop(Server.java:493)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:1155)
... 9 more
2019-12-19 07:42:35,139 INFO util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 1: java.io.IOException: Problem starting http server
2019-12-19 07:42:35,143 INFO datanode.DataNode (LogAdapter.java:info(51)) - SHUTDOWN_MSG:
/************************************************************

3 REPLIES 3

@Shelton Need your help on fixing this issue 

Expert Contributor

@saivenkatg55Can you please  share the hdfs-site.xml

Mentor

@saivenkatg55 

 

This "Exiting with status 1: java.io.IOException: Problem starting http server" error should be linked to your other question I just have  responded to 

https://community.cloudera.com/t5/Support-Questions/Unable-to-start-the-node-manager/td-p/286013
If this is resolved then the java.io.IOException shouldn't occur

 

HTH