Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

last checkpoint error being reported

last checkpoint error being reported

Master Collaborator

I am not sure why I am getting this error and whats the resolution :

11841-mnz3u.png

6 REPLIES 6

Re: last checkpoint error being reported

Master Collaborator

I took a manual checkpoint and error is gone but I still want to know how to avoid this error and have system take automatic check points ?

Re: last checkpoint error being reported

Super Mentor

@Sami Ahmad

Is this a test system? Are the values for the following modified from default

  • dfs.namenode.checkpoint.period, set to 1 hour by default, specifies the maximum delay between two consecutive checkpoints
  • dfs.namenode.checkpoint.txns, set to 1 million by default, defines the number of uncheckpointed transactions on the NameNode which will force an urgent checkpoint, even if the checkpoint period has not been reached.

You could go to the Namenode current folder and check when was the last fsimage created. Was the cluster down for long? You may want to review the above two parameters and check the timestamps in the current folder and find why automatic checkpointing is not happening.

- Also please make sure that your systems are time sync. "ntp" service is running fine.

Re: last checkpoint error being reported

Master Collaborator

where are these two parameters defined?

Re: last checkpoint error being reported

Contributor

@Sami Ahmad

Check these parameters in HDFS configuration and make the changes as suggested.

Re: last checkpoint error being reported

Super Mentor

@Sami Ahmad

Those parameters can be found in the following path of ambari:

Ambari UI --> HDFS --> Configs --> Advanced --> (In the search filter enter "dfs.namenode.checkpoint.period") 

then you will find the following two properties there:

59396-hdfs-configs.png

.

Re: last checkpoint error being reported

How to enable frequent checkpoting ?

Don't have an account?
Coming from Hortonworks? Activate your account here