All three namenode directories are pointing to same metadata.

Yukti — Thu, 28 Feb 2019 10:55:44 GMT

/hadoop/hdfs/namenode

/var/hadoop/hdfs/namenode

/var/log/hadoop/hdfs/namenode

What is the use of having 3 directories pointing to same data?

Re: All three namenode directories are pointing to same metadata.

LesterMartin — Thu, 07 Mar 2019 07:26:29 GMT

While I'm doubtful these three directories are the very best answer to this problem, but the old "three directories for the NN metadata" came about long before a solid HA solution was available and as https://twitter.com/LesterMartinATL/status/527340416002453504 points out, it was (and actually still is) all about disaster recovery. The old adage was to configure the NN to write to three different disks (via the directories) -- two local and one off the box such as a remote mount point. Why?

Well... as you know that darn metadata is the keys to the whole file system and if it ever gets lost then ALL of your data is non-recoverable!!

I personally think this is still valuable even with HA as the JournalNodes are focused on the edits files and do a great job of having that information on multiple machines, but the checkpoint image files only exist on the two NN nodes in HA configuration and, well... I just like to sleep better at night.

Good luck and happy Hadooping!

question All three namenode directories are pointing to same metadata. in Support Questions

All three namenode directories are pointing to same metadata.

Re: All three namenode directories are pointing to same metadata.