Support Questions
Find answers, ask questions, and share your expertise

Will a Mapreduce job fail if namenode (or whole HDFS) is restarted

Will a Mapreduce job fail if namenode (or whole HDFS) is restarted

New Contributor
 
3 REPLIES 3

Re: Will a Mapreduce job fail if namenode (or whole HDFS) is restarted

Expert Contributor

Yes. It will fail.

Re: Will a Mapreduce job fail if namenode (or whole HDFS) is restarted

@Dashmeet Singh, Yes the MR job will fail if the Namenode is restarted.

Re: Will a Mapreduce job fail if namenode (or whole HDFS) is restarted

Indeed it would fail like the others here have mentioned, but you can configure NameNode High Availability. With a NameNode HA setup your jobs will be safe during a NameNode failover event.

More information;
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_hadoop-high-availability/content/ch_HA-N...