Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to specify more than one path for storage in hadoop?

Highlighted

How to specify more than one path for storage in hadoop?

New Contributor

Can you explain how to specify more than one path for storage in Hadoop?

2 REPLIES 2

Re: How to specify more than one path for storage in hadoop?

New Contributor

The parameter to specify more than one path for storage in Hadoop is in hdfs-site.xml.

Property: dfs.datanode.data.dir (Please verify)
dfs.datanode.data.dir value can be any directory which is available on the data node. It determines where on the local filesystem data node should store its blocks.
It can be a directory where disk partitions are mounted like '/user1/hadoop/data, /user2/hadoop/data' which is in case if you have multiple disks partitions to be used for HDFS the purpose. When it has multiple values, data is copied to the HDFS in a round-robin fashion. If one of the directory's disk is full, round-robin data copy will continue on the rest of the directories.

Re: How to specify more than one path for storage in hadoop?

Super Collaborator