Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to check disks number ?

Solved Go to solution

how to check disks number ?

New Contributor

Hello,

I need to configure YARN and MapReduce as mentioned in this link

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determi....

I'm blocked at the step of specifying disks number as shown in "step.png".

How can i extract disks number on each node of my cluster ?

How can i resolve this issue ?


step.png
1 ACCEPTED SOLUTION

Accepted Solutions

Re: how to check disks number ?

@raouia

That is wrongly printed parameter. It should be 'dfs.datanode.data.dir' instead of 'dfs.data.dir'. This has been rectified in higher version of documentation.


dfs.datanode.data.dir determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. The number of comma-delimited list equals to number of disks.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

Hope this helps you.

4 REPLIES 4

Re: how to check disks number ?

@raouia

That is wrongly printed parameter. It should be 'dfs.datanode.data.dir' instead of 'dfs.data.dir'. This has been rectified in higher version of documentation.


dfs.datanode.data.dir determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. The number of comma-delimited list equals to number of disks.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

Hope this helps you.

Re: how to check disks number ?

New Contributor

@Sridhar Reddy

Thank you for your pertinent answer.

Re: how to check disks number ?

Expert Contributor

@raouia Check the number of data disks you are using in Ambari (under HDFS configs look for dfs.datanode.data.dir) or if you havent installed yet, do a "df -h" on the node to count number of data disks - usually looks like data01, data02 ..

Highlighted

Re: how to check disks number ?

New Contributor

@PJ

Thank you for your reply.

Don't have an account?
Coming from Hortonworks? Activate your account here