I should have mentioned earlier, HDFS Federation is not really supported in CDH5/CM5. Federation is from a time period where Namenode performance wasn't very scalable. Recent releases of Hadoop are quite good at scaling to many hundreds of nodes. Is there a reason you want to use Federation? Maybe we can resolve your problem another way.
... View more
The most likely cause is that the HBase Canary (part of HBase, not from Service Monitor) is pinging each region's health regularly. Prior to CM5.3.2, turning this HBase Canary off didn't work. So you could either - upgrade to CM 5.3.2 (or later). This should not lead to cluster downtime as only CM and agents will be upgraded. - lower the frequency of the the HBase Canary so that the discrepancy in stats is reduced.
... View more
Hi Gautam, Thanks for your reply. We are upgrading from CDH5.3.2. But you're right, CM5.4.1 allow us to select CDH5.4.2, we were confused by this message, and were too carefull. We will try it again next week. Thanks ! Benoit
... View more
