Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

what should be the value for dfs.datanode.data.dir in hdfs-site.xml

Solved Go to solution

what should be the value for dfs.datanode.data.dir in hdfs-site.xml

New Contributor

hi , I have

<property> <name>dfs.datanode.data.dir</name> <value>/hadoop/hdfs/data</value><final>true</final></property

When i cd to /hadoop/hdfs/data , i see below files

[hdfs@xxxxxxxxxx]$ pwd

/hadoop/hdfs/data

[hdfs@xxxxxxxxxxx]$ ls -ltr

total 8

-rw-r--r-- 1 hdfs hadoop 43 Jan 19 00:01 in_use.lock

drwxr-xr-x 5 hdfs hadoop 4096 Jan 19 00:01 current

My understand , was dfs.datanode.data.dir , should hold a series of disks values like ‘/u01/hadoop/data, /u02/hadoop/data’ …. where hdfs will store the data. In that case where will be current directory of datanode reside , which holds the VERSION file.

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: what should be the value for dfs.datanode.data.dir in hdfs-site.xml

All the HDFS meta directories explained here, http://hortonworks.com/blog/hdfs-metadata-directories-explained/ hope this helps.

3 REPLIES 3
Highlighted

Re: what should be the value for dfs.datanode.data.dir in hdfs-site.xml

All the HDFS meta directories explained here, http://hortonworks.com/blog/hdfs-metadata-directories-explained/ hope this helps.

Re: what should be the value for dfs.datanode.data.dir in hdfs-site.xml

Super Collaborator
@Jacqualin jasmin

dfs.datanode.data.dir can be any directory which is available on the datanode. It can be a directory where disk partitions are mounted like '/u01/hadoop/data, /u02/hadoop/data' which is in case if you have multiple disks partitions to be used for hdfs purpose.

Re: what should be the value for dfs.datanode.data.dir in hdfs-site.xml

Contributor

@Jacqualin jasmin, you name any directory on your datanodes as the data directory. Make sure of the permissions and the value of the dfs.datanode.data.dir parameter in HDFS configurations.

e.g. /dev/vdb 1.5T 70M 1.4T 1% /volumes/disk1

dfs.datanode.data.dir=/volumes/disk1/hadoop/data/

after that you will find the VERSION file into the data directory once your HDFS detects the data directory.

Don't have an account?
Coming from Hortonworks? Activate your account here