Community Articles
Find and share helpful community-sourced technical articles
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.
Labels (1)
New Contributor

Error:

DEBUG [master:hbasrmaster01:60000.oldLogCleaner] master.ReplicationLogCleaner: Found log in ZK, keeping: hbasregion.abcd.com%2C60020%2C1446216523936.1475050795365

The duration for which WAL files are kept is controlled by hbase.master.logcleaner.ttl - default is 10 minutes.

If the replication peer can be dropped (for longer than the above config value), WAL files would be cleaned. After that the replication peer can be added back.

Issue: Hbase OldWAL's in /apps/hbase/data/oldWALs not getting deleted

Root Cause: Hbase had a peer that prevents the deletion of old files.

In hbase shell:

To List Peers: list_peers

To Disable Peers: disable_peer("1")

To Remove Peer: remove_peer ("1")

List agin to verify removal: list_peers

Next tail the Hbase Master log file to ensure the deletion was working.

Also look at hbase replication folder in hdfs.

Lastly we re-added the peer:

add_peer '<n>', "slave.zookeeper.quorum:zookeeper.clientport.:zookeeper.znode.parent"

1,586 Views
Don't have an account?
Coming from Hortonworks? Activate your account here
Version history
Revision #:
1 of 1
Last update:
‎12-30-2016 09:00 PM
Updated by:
 
Contributors
Top Kudoed Authors