Member since
02-25-2016
72
Posts
34
Kudos Received
5
Solutions
03-09-2017
09:17 PM
let me put this scenario. If dfs.namenode.checkpoint.period ->1 hr and dfs.namenode.checkpoint.txns -> 1 million which creates checkpoint at 2PM, 3PM. After 10 mins past 3PM there were 1 million unchecked transactions so a new checkpoint would be created at 3 10PM. So the next checkpoint would be either after 1 hr ie at 4 10 PM or if it hits 1 million unchecked transactions before 4 10 PM. Please let me know if I understood right way
... View more
03-09-2017
04:19 PM
2 Kudos
Checkpointing process is defined in 2 configuration parameters:
dfs.namenode.checkpoint.period -> 10 hr which will set the time for every checkpoint.
Aslos dfs.namenode.checkpoint.txns is by default set to 1 million. What does this configuration do, in apache wiki website it says this configurations sets the number of uncheckpointed transactions.
In the first configuration we are setting it for every 10hrs, in such scenario what is the necessity for setting value for uncheckpointed transactions.
... View more
Labels:
- Labels:
-
Apache Ambari
-
HDFS