Using LVM to create Hadoop Volumes

[#1]

Hi All,

We are using LVM on the Data nodes HDFS Volumes .Is this going to create latency in Read/Write .

We have observed that local to HDFS files copies are taking too much of time .especially when doing multiple copies.

Any thoughts on this ..

Shihab

[#2 · Accepted solution]

HWX doesn't recommend using lvm for the datanodes (overhead and no benefit).

You typically create a partition per disk (no raid) with the your FS directly on top.

FS typically are ext4 or xfs.