- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
HDFS datanode.data.dir
- Labels:
-
HDFS
Created ‎12-15-2016 03:14 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have a cluster of machines with 3 datanodes. i have added multiple directories for datanode.data.dir let say /var/home and /home/test. so my question is if my dfs.replication.factor is 3. Will it write the file replicas on 3 nodes & will it create same replica of data on multiple directory of every disk?
Created ‎12-15-2016 06:07 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
use this feature:
http://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apache...
Created ‎12-15-2016 03:22 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
DataNode _Disk_.
Regardless of how many disk (directories - dfs.datanode.data.dirs) you
configure per DataNode, the replica on each DataNode host will be uniquely
one and may reside on any one disk.
Created ‎12-15-2016 04:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created ‎12-15-2016 06:07 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
use this feature:
http://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apache...
