we have ambari cluster with 3 masters machines , on master01 and master03 Zk is running as all know on master02 Zk clientPort use the value 2181 , and we seen from the logs that Zk not start because port is already in use as the following ( on master02 ) netstat -tnlpa | grep 2181 tcp 0 0 10.164.28.152:38219 10.164.28.153:2181 ESTABLISHED 51471/java tcp 0 0 10.164.28.152:38218 10.164.28.153:2181 ESTABLISHED 51471/java tcp 0 0 10.164.28.152:38707 10.164.27.162:2181 ESTABLISHED 51471/java tcp6 0 0 :::2181 :::* LISTEN 24847/java tcp6 0 0 10.164.28.152:2181 10.164.28.152:48270 ESTABLISHED 24847/java tcp6 0 0 10.164.28.152:2181 10.164.28.152:40876 ESTABLISHED 24847/java tcp6 0 0 10.164.28.152:39342 10.164.27.162:2181 ESTABLISHED 39008/java tcp6 0 0 10.164.28.152:2181 10.164.27.162:53094 ESTABLISHED 24847/java tcp6 0 0 10.164.28.152:37998 10.164.28.153:2181 ESTABLISHED 38168/java tcp6 0 0 10.164.28.152:45319 10.164.28.153:2181 ESTABLISHED 39008/java tcp6 0 0 10.164.28.152:39133 10.164.28.153:2181 ESTABLISHED 39008/java tcp6 0 0 10.164.28.152:2181 10.164.28.153:33491 ESTABLISHED 24847/java tcp6 0 0 10.164.28.152:37092 10.164.28.153:2181 ESTABLISHED 48592/java tcp6 0 0 10.164.28.152:41413 10.164.28.153:2181 ESTABLISHED 28226/java tcp6 0 0 10.164.28.152:40876 10.164.28.152:2181 ESTABLISHED 38168/java so my question is is it possible to work around on this problem to use other port as - 2182 , just to start the Zk on master02 machine ? or maybe other suggestion how to start the Zk server on master02 machine ? second , how it can be that Java in ambari cluster use this port that is allocated to Zk , why this happened ? ... View more

we noticed that edits_inprogress_xxxxxxxx corrupted file (under /hadoop/hdfs/journal/hdfsha/current) , could be the reason why name--node not start correctly or start as standby and not as active so I just share with you this issue , and I want to find little verification how to identify edits_inprogress_xxxxxxxx corrupted file I found the following way but I need hortonworks approval for this verification my opinion is to use the file command , when file command return "data" then file is ok else , then edits_inprogress_xxxxxxxx corrupted is corrupted can we trust on this verification ? file edits_inprogress_0000000000075117774 edits_inprogress_0000000000075117774: ISO-8859 text, with very long lines, with no line terminators # file edits_inprogress_0000000000075149670 edits_inprogress_0000000000075149670: data ... View more