Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

changing datanode.dir

Solved Go to solution

changing datanode.dir

Contributor

HDP 2.5.3

I have a cluster that has 34 datanodes, each with (11) 1.2TB disks for hdfs. I added three new nodes but these only have (9) 1.2TB disks for hdfs. The new datanodes have been added but it seems that not all the file systems are seen by hdfs

When I look at one of the older datanodes, in hdfs-site.xml for dfs.datanode.data.dir all the files systems are listed (disk1 - disk11). On the new nodes, only disk1 thru disk6 are listed even though disk7, 8 and 9 are configure and mounted as file systems.

Question. How do I get these nodes to recognize the other disks? Can I edit the hdfs-site.xml and add them to the list? If so, what are the steps?

I don't seem to be able to do this thru ambari.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: changing datanode.dir

Contributor

I figured out what was wrong. There are 2 HDFS configuration groups on this cluster. One is set up for the datanodes. I just needed to add the new servers to that group

2 REPLIES 2

Re: changing datanode.dir

Super Guru
@Jon Page

Is your Ambari able to see the disk. Basically you need to add new values for dfs.datanode.dir that point to these missing disks. Look at this screenshot. You need to add new lines for these nodes.

screen-shot-2017-05-11-at-102807-am.png

Highlighted

Re: changing datanode.dir

Contributor

I figured out what was wrong. There are 2 HDFS configuration groups on this cluster. One is set up for the datanodes. I just needed to add the new servers to that group

Don't have an account?
Coming from Hortonworks? Activate your account here