Created 12-02-2015 09:15 PM
Wanted to see how many people have clusters where the HDFS DataNodes are running on XFS vs Ext4 filesystems? I'm trying to get a sense for which filesystem is chosen most often in the wild. Feel free to comment if you have a preference for one vs the other.
Thanks!
Created 12-03-2015 10:42 PM
From a SmartSense perspective it's about 80% ext4, and 20% XFS. We recommend using either and have specific mount options for each type of filesystem.
Created 12-09-2015 09:50 PM
We use all XFS but, during some benchmarks on the jobs, we changed to EXT4 for better performance (1-3% depending on the workflow).
Created 12-10-2015 01:51 AM
Is it possible to publish benchmark numbers ?
Created 12-10-2015 05:42 PM
I had to ask to our customer, but i think there'll be no probelm
Created 12-16-2015 03:09 PM
Has anyone tried BTRFS?
We are testing with that now and have not seen any issues so far.