Support Questions

Find answers, ask questions, and share your expertise

Why are the HDFS edit logs retained after a checkpoint operation is complete?

avatar
Super Collaborator

In an HA environment, I see a fairly current fsimage file in the Namenode directory. But I also see edit files for the last 20+ days even though the checkpoint frequency is 6 hours/1M transactions.

1 ACCEPTED SOLUTION

avatar
Super Collaborator

The hdfs-site.xml property dfs.namenode.num.extra.edits.retained defaults to a value of 1000000 (1 million) Reducing this value will lower the number of edit logs retained after a checkpoint in complete.

View solution in original post

3 REPLIES 3

avatar
Master Mentor

avatar
Super Collaborator

Pointed me to the right place to do more research.

avatar
Super Collaborator

The hdfs-site.xml property dfs.namenode.num.extra.edits.retained defaults to a value of 1000000 (1 million) Reducing this value will lower the number of edit logs retained after a checkpoint in complete.