Support Questions
Find answers, ask questions, and share your expertise
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

MapReduce Checkpoint


MapReduce Checkpoint

New Contributor

MapReduce do not have checkpoints mechanism so all of the intermediate data is reproduced again when failures occur. So,I am trying to add checkpointing mechanism in map task.Although checkpoints have advantageous for fault tolerance, they make job completion time long. So,to avoid completion time long,I want to define optimum checkpoint interval in MapReduce. Now I am testing MapReduce with Young's checkpoint interval. Is defining checkpoint interval in MapReduce possible? or Young's Model convience for MapReduce?

Don't have an account?
Coming from Hortonworks? Activate your account here