Support Questions

Find answers, ask questions, and share your expertise

how to check disks number ?

avatar

Hello,

I need to configure YARN and MapReduce as mentioned in this link

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determi....

I'm blocked at the step of specifying disks number as shown in "step.png".

How can i extract disks number on each node of my cluster ?

How can i resolve this issue ?


step.png
1 ACCEPTED SOLUTION

avatar
@raouia

That is wrongly printed parameter. It should be 'dfs.datanode.data.dir' instead of 'dfs.data.dir'. This has been rectified in higher version of documentation.


dfs.datanode.data.dir determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. The number of comma-delimited list equals to number of disks.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

Hope this helps you.

View solution in original post

4 REPLIES 4

avatar
@raouia

That is wrongly printed parameter. It should be 'dfs.datanode.data.dir' instead of 'dfs.data.dir'. This has been rectified in higher version of documentation.


dfs.datanode.data.dir determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. The number of comma-delimited list equals to number of disks.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determ...

Hope this helps you.

avatar

@Sridhar Reddy

Thank you for your pertinent answer.

avatar
Expert Contributor

@raouia Check the number of data disks you are using in Ambari (under HDFS configs look for dfs.datanode.data.dir) or if you havent installed yet, do a "df -h" on the node to count number of data disks - usually looks like data01, data02 ..

avatar

@PJ

Thank you for your reply.