Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 12-21-2016 09:32 PM
What is the correct process in moving the Journal Node Directories to a different disk?
Lets say I have 3 servers, each running a Journal Node Service:
server1
server2
server3
The Journal Nodes are currently writing to /var/lib/hadoop/hdfs/journal
I want to change this to /data1/hadoop/hdfs/journal for each server
I've tried:
1) Stopping Namenodes (HA)
2) Copying data from /var/lib/hadoop/hdfs/journal to /data1/hadoop/hdfs/journal
3) Changing the dir property for the Journal Nodes in Ambari
4) Starting the Namenodes
This did not seem to work
Created 12-21-2016 10:15 PM
@Nasheb Ismaily Did you update new directory in Ambari - HDFS - configs - dfs.journalnode.edits.dir ?
Did you restart JNs after copying the data?
If you have done that,
Clean /data1/hadoop/hdfs/journal on all three JNs and restart all JNs
As HDFS user on any namenode , run hdfs namenode -initializeSharedEdits
And then start your Namenodes .
Created 12-21-2016 10:15 PM
@Nasheb Ismaily Did you update new directory in Ambari - HDFS - configs - dfs.journalnode.edits.dir ?
Did you restart JNs after copying the data?
If you have done that,
Clean /data1/hadoop/hdfs/journal on all three JNs and restart all JNs
As HDFS user on any namenode , run hdfs namenode -initializeSharedEdits
And then start your Namenodes .
Created 06-29-2017 03:58 AM
Note that Manage Journal Node is now available through UI in Ambari 2.5.1