Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Why are the HDFS edit logs retained after a checkpoint operation is complete?

Solved Go to solution

Why are the HDFS edit logs retained after a checkpoint operation is complete?

Expert Contributor

In an HA environment, I see a fairly current fsimage file in the Namenode directory. But I also see edit files for the last 20+ days even though the checkpoint frequency is 6 hours/1M transactions.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Why are the HDFS edit logs retained after a checkpoint operation is complete?

Expert Contributor

The hdfs-site.xml property dfs.namenode.num.extra.edits.retained defaults to a value of 1000000 (1 million) Reducing this value will lower the number of edit logs retained after a checkpoint in complete.

View solution in original post

3 REPLIES 3
Highlighted

Re: Why are the HDFS edit logs retained after a checkpoint operation is complete?

Highlighted

Re: Why are the HDFS edit logs retained after a checkpoint operation is complete?

Expert Contributor

Pointed me to the right place to do more research.

Highlighted

Re: Why are the HDFS edit logs retained after a checkpoint operation is complete?

Expert Contributor

The hdfs-site.xml property dfs.namenode.num.extra.edits.retained defaults to a value of 1000000 (1 million) Reducing this value will lower the number of edit logs retained after a checkpoint in complete.

View solution in original post

Don't have an account?
Coming from Hortonworks? Activate your account here