Support Questions
Find answers, ask questions, and share your expertise

Data replication in datanode new

Explorer

Hey, folks,

I know how to remove and add a server what I don't know how I can see the data replicating in the new node. someone could help me.

 

Greetings

2 ACCEPTED SOLUTIONS

Expert Contributor

Hi @Peruvian81 

 

Once you add new datanode to cluster and if the replication starts you can see messages somehow like below in datanode logs - which signifies that new node is finalizing blocks written as well as receiving blocks from source node within replication.

 

DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1490)) - src: /<IPADDRESS>:45858, dest: /<IPADDRESS>:1019, bytes: 7526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-646394656_1, offset: 0, srvID: 973c1ebc-7c88-4163-aea3-8c2e0f4f4975, blockid: BP-826310834-<IPADDRESS>-1480602348927:blk_1237811292_164146312, duration: 9130002 



datanode.DataNode (DataXceiver.java:writeBlock(669)) - Receiving BP-826310834-<IPADDRESS>-1480602348927:blk_1237811295_164146315 src: /<IPADDRESS>:36930 dest: /<IPADDRESS>:1019

 

View solution in original post

Expert Contributor

Hi @Peruvian81  there is no such option in ambari UI

 

You can either check from Namenode UI --> datanode tab and see if the block counts are increasing.

View solution in original post

3 REPLIES 3

Expert Contributor

Hi @Peruvian81 

 

Once you add new datanode to cluster and if the replication starts you can see messages somehow like below in datanode logs - which signifies that new node is finalizing blocks written as well as receiving blocks from source node within replication.

 

DataNode.clienttrace (BlockReceiver.java:finalizeBlock(1490)) - src: /<IPADDRESS>:45858, dest: /<IPADDRESS>:1019, bytes: 7526, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-646394656_1, offset: 0, srvID: 973c1ebc-7c88-4163-aea3-8c2e0f4f4975, blockid: BP-826310834-<IPADDRESS>-1480602348927:blk_1237811292_164146312, duration: 9130002 



datanode.DataNode (DataXceiver.java:writeBlock(669)) - Receiving BP-826310834-<IPADDRESS>-1480602348927:blk_1237811295_164146315 src: /<IPADDRESS>:36930 dest: /<IPADDRESS>:1019

 

Explorer

hello @sargarshimpi

 

Okay that's an option, but I wanted to know if there was another option within the front of ambari for

example.

 

Greetings

Expert Contributor

Hi @Peruvian81  there is no such option in ambari UI

 

You can either check from Namenode UI --> datanode tab and see if the block counts are increasing.

; ;