Support Questions

Find answers, ask questions, and share your expertise

Ext4 vs XFS Filesystem - Survey of Popularity

avatar
Expert Contributor

Wanted to see how many people have clusters where the HDFS DataNodes are running on XFS vs Ext4 filesystems? I'm trying to get a sense for which filesystem is chosen most often in the wild. Feel free to comment if you have a preference for one vs the other.

Thanks!

1 ACCEPTED SOLUTION

avatar

From a SmartSense perspective it's about 80% ext4, and 20% XFS. We recommend using either and have specific mount options for each type of filesystem.

View solution in original post

13 REPLIES 13

avatar
Rising Star

We use all XFS but, during some benchmarks on the jobs, we changed to EXT4 for better performance (1-3% depending on the workflow).

avatar
Master Mentor

@Andrea D'Orio

Is it possible to publish benchmark numbers ?

avatar
Rising Star
@Neeraj Sabharwal

I had to ask to our customer, but i think there'll be no probelm

avatar
New Contributor

Has anyone tried BTRFS?

We are testing with that now and have not seen any issues so far.