Support Questions
Find answers, ask questions, and share your expertise

DataNode does not start in HDP2.3.3 VM

Explorer

Hi

The datanode process does not start on H2,3.2 VM. when I use both the command line and the Ambari GUI.,

There is no proper documentation available for this problem, Is there a fix or upgrade for this

Regards

Sreenivas

4 REPLIES 4

Re: DataNode does not start in HDP2.3.3 VM

@Sreenivas Adiki

Can you please paste the error log messages here?

Re: DataNode does not start in HDP2.3.3 VM

Guru

Please paste datanode log from /var/log/hadoop/hdfs/*datanode*.log.

Re: DataNode does not start in HDP2.3.3 VM

Explorer

[root@sandbox hdfs]# tail -f hadoop-hdfs-datanode-sandbox.hortonworks.com.log 2016-05-19 18:53:51,898 INFO block.BlockTokenSecretManager (BlockTokenSecretManager.java:addKeys(193)) - Setting block keys 2016-05-19 18:53:51,898 INFO datanode.DataNode (BPServiceActor.java:offerService(623)) - For namenode sandbox.hortonworks.com/192.168.1.9:8020 using BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 120000msec; heartBeatInterval=3000 2016-05-19 18:53:52,014 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(511)) - Namenode Block pool BP-57164570-172.16.137.139-1445956759306 (Datanode Uuid 0424e6e0-836e-4c1c-89fb-1e53c0e66194) service to sandbox.hortonworks.com/192.168.1.9:8020 trying to claim ACTIVE state with txid=624461 2016-05-19 18:53:52,015 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(523)) - Acknowledging ACTIVE Namenode Block pool BP-57164570-172.16.137.139-1445956759306 (Datanode Uuid 0424e6e0-836e-4c1c-89fb-1e53c0e66194) service to sandbox.hortonworks.com/192.168.1.9:8020 2016-05-19 18:53:53,922 ERROR datanode.DataNode (DataXceiver.java:run(278)) - sandbox.hortonworks.com:50010:DataXceiver error processing unknown operation src: /127.0.0.1:45368 dst: /127.0.0.1:50010 java.io.EOFException at java.io.DataInputStream.readShort(DataInputStream.java:315) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:227) at java.lang.Thread.run(Thread.java:745) 2016-05-19 18:54:54,014 ERROR datanode.DataNode (DataXceiver.java:run(278)) - sandbox.hortonworks.com:50010:DataXceiver error processing unknown operation src: /127.0.0.1:45463 dst: /127.0.0.1:50010 java.io.EOFException at java.io.DataInputStream.readShort(DataInputStream.java:315) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:227) at java.lang.Thread.run(Thread.java:745) 2016-05-19 18:55:47,282 INFO datanode.DataNode (BPServiceActor.java:blockReport(488)) - Successfully sent block report 0x5f0932f30e2, containing 1 storage report(s), of which we sent 1. The reports had 1731 total blocks and used 1 RPC(s). This took 20 msec to generate and 172 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5. 2016-05-19 18:55:47,283 INFO datanode.DataNode (BPOfferService.java:processCommandFromActive(694)) - Got finalize command for block pool BP-57164570-172.16.137.139-1445956759306 2016-05-19 18:55:53,929 ERROR datanode.DataNode (DataXceiver.java:run(278)) - sandbox.hortonworks.com:50010:DataXceiver error processing unknown operation src: /127.0.0.1:45535 dst: /127.0.0.1:50010 java.io.EOFException at java.io.DataInputStream.readShort(DataInputStream.java:315) at org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:58) at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:227) at java.lang.Thread.run(Thread.java:745)

Re: DataNode does not start in HDP2.3.3 VM

Explorer

this is the error it shows in the log file