how to check disks number ?

[#1]

Hello,

I need to configure YARN and MapReduce as mentioned in this link

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determi....

I'm blocked at the step of specifying disks number as shown in "step.png".

How can i extract disks number on each node of my cluster ?

How can i resolve this issue ?

[#2 · Accepted solution]

@raouia

That is wrongly printed parameter. It should be 'dfs.datanode.data.dir' instead of 'dfs.data.dir'. This has been rectified in higher version of documentation.

dfs.datanode.data.dir determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. The number of comma-delimited list equals to number of disks.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

Hope this helps you.

[#3]

@Sridhar Reddy

Thank you for your pertinent answer.

[#4]

@raouia Check the number of data disks you are using in Ambari (under HDFS configs look for dfs.datanode.data.dir) or if you havent installed yet, do a "df -h" on the node to count number of data disks - usually looks like data01, data02 ..

[#5]

@PJ

Thank you for your reply.