question Re: how to check disks number ? in Archives of Support Questions (Read Only)

how to check disks number ?

kabadou_rawia — Wed, 20 Sep 2017 18:17:08 GMT

Hello,

I need to configure YARN and MapReduce as mentioned in this link

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_installing_manually_book/content/determine-hdp-memory-config.html.

I'm blocked at the step of specifying disks number as shown in "step.png".

How can i extract disks number on each node of my cluster ?

How can i resolve this issue ?

Re: how to check disks number ?

bandarusridhar1 — Wed, 20 Sep 2017 21:09:58 GMT

@raouia

That is wrongly printed parameter. It should be 'dfs.datanode.data.dir' instead of 'dfs.data.dir'. This has been rectified in higher version of documentation.

dfs.datanode.data.dir determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored. The number of comma-delimited list equals to number of disks.

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_command-line-installation/content/determine-hdp-memory-config.html

Hope this helps you.

Re: how to check disks number ?

pmj — Wed, 20 Sep 2017 21:59:36 GMT

@raouia Check the number of data disks you are using in Ambari (under HDFS configs look for dfs.datanode.data.dir) or if you havent installed yet, do a "df -h" on the node to count number of data disks - usually looks like data01, data02 ..

Re: how to check disks number ?

kabadou_rawia — Mon, 25 Sep 2017 20:44:13 GMT

@Sridhar Reddy

Thank you for your pertinent answer.

Re: how to check disks number ?

kabadou_rawia — Mon, 25 Sep 2017 20:45:03 GMT

@PJ

Thank you for your reply.