Hi, We have setup HBase database on aws ec2 instances using Ambari. We have 2 ec2 t2.larges instance, one contain zookeeper master and contains Name and Data Node. Now there is a daily crone job, runs on salve node that takes incremental backup and save it to hdfs. It works perfectly but after some days, almost after 15-20 days, the backup map reduce job started fail with Out Of Heap Memory Error. If we check our instance memory state we almost have 4.5GB in cache and 2.7GM in available. If it fails once, it will continue to fail with Out of Memory Error for forever. Resolution that we have followed in last two occasion was: delete all hdfs backup. drop hbase backup tables. take full backup once And it comes back to normal. We have not able to figure out exact issue, and it is almost time to go into production. We cannot go into with proper backup setup. Need community help to find best way to backup our database. Kindly suggest where we can be wrong with our implementation. PS: Previously we had tried to take backup and directly save it to S3 with no success. Here is the issue we were facing with old method. ... View more