Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]

Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Ext4 vs XFS Filesystem - Survey of Popularity

avatar
Expert Contributor

Wanted to see how many people have clusters where the HDFS DataNodes are running on XFS vs Ext4 filesystems? I'm trying to get a sense for which filesystem is chosen most often in the wild. Feel free to comment if you have a preference for one vs the other.

Thanks!

1 ACCEPTED SOLUTION

avatar

From a SmartSense perspective it's about 80% ext4, and 20% XFS. We recommend using either and have specific mount options for each type of filesystem.

View solution in original post

13 REPLIES 13

avatar
Rising Star

We use all XFS but, during some benchmarks on the jobs, we changed to EXT4 for better performance (1-3% depending on the workflow).

avatar
Master Mentor

@Andrea D'Orio

Is it possible to publish benchmark numbers ?

avatar
Rising Star
@Neeraj Sabharwal

I had to ask to our customer, but i think there'll be no probelm

avatar
New Member

Has anyone tried BTRFS?

We are testing with that now and have not seen any issues so far.