I can´t see that property explicitely defined as "False" in hbase-site.xml, so I can suppose it is True. We are using HDP 2.3.2.0-2950, wich includes HBase 1.1.2, so I think it is defined as True by default. Is it? ... View more

Ok, issue is resolved. I had to explicitly add the custom property "hbase.replication=false" to hbase-site.xml (although we have no replication at all and no peers configured) and restart HBase masters. After this, about 50 TB of data in oldWALs folder were deleted automatically in about 10 minutes 🙂 Thank you very much to all of you, you helped me a lot 🙂 ... View more

Yes, I know. I was thinking about "config groups" in Ambari. Using such, maybe I could use an independent HDFS filesystem for the backup and use the same zookeepers for replication.... maybe complex... Yes, maybe a new hole cluster would be the best solution...I think I'll do that. Thank you very much for your support ... View more

Ok, thank you very much for your answers. Looking at http://blog.cloudera.com/blog/2013/11/approaches-to-backup-and-disaster-recovery-in-hbase/, I think "HBase replication" is my solution: almost no impact, incremental backups... On the other side, we are currently creating snapshots of tables in a daily manner. I am creating a new cluster for this. I was thinking about a 2 node cluster, one as Master node with all master roles (Hbase master, zookeeper...) and one Data Node with enough storage for backup data My question is: - Should it be totally independent, with all roles installed or can I connect it to my main cluster under Ambari umbrella? I need it only for backup, I'm not going to use it for production if something happens to my main production cluster Regards, Silvio ... View more

Ok, so, if we would need to backup only HBase tables, we could use HBase replication and it would not be neccesary the use of distcp2, right? I suppose HBase replication copies underneath HDFS data too ... View more

No "peers" at all here ... View more

Well, "archive" folder under /apps/hbase/data" remains "under control" and doesn't grow. My problem is "oldWALs" under same path. I don't have any kind of replication ... View more

Hi, This is the output you request: [zk: localhost:2181(CONNECTED) 4] ls /hbase/replication [peers, rs] [zk: localhost:2181(CONNECTED) 5] ls /hbase/replication/peers [] No replication to other peers ... View more

Hi Vijaya, thanks for your answer. But if HBase data is in HDFS (I can see HBase tables as folders in HDFS strusture), if I replicate HDFS am I not replicating HBase data too? I think I still have much to read and learn... On the other side, does distcp2 supposes performance impact? Regards, Silvio ... View more