Linux: Common Filesystems
-
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
-
I've been using XFS for pretty much everything new for a year or so now. Just seems to make the most sense.
-
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
Ya I meant XFS. I really only use EXT4 if I'm going to be playing with the sizes of the LVs to test stuff. The home partition on my laptop is EXT4 but it's been that way for about 2 years and I don't want to move everything off to change it.
I also usually use EXT4 for USB drives.
-
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
-
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
-
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
-
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
I'm saying you can easily get CAD files that are around 300-600 GB each for large assemblies with a bunch of sub-assemblies.
-
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
I'm also saying a file server that is a VM. Not a CAD workstation.
-
@johnhooks said:
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
I'm also saying a file server that is a VM. Not a CAD workstation.
Right, but when you're working with files that large - why bother storing them in a VM - just st.... OK yeah, that goes against the standard practice now.. so we need a VM, even if the whole host is a VM - welp, I guess your stuck with XFS
-
@Dashrender said:
@johnhooks said:
@Dashrender said:
@scottalanmiller said:
@johnhooks said:
@scottalanmiller said:
EXT4 vs XFS
Filename Length Max File Size Max Filesystem ext4 255 bytes 16 GiB to 16 TiB 1 EiB XFS 255 bytes 8 EiB 8 EiBThat's a pretty big file.
On XFS that's one crazy large file. On EXT4, it's not really. If you wanted to virtualized a moderately sized file server today (smaller than several of NTG's systems) then EXT4 couldn't handle it. The single file size limits of EXT4 are so small that they even can impact the SMB market today. This is a big reason why XFS took over so quickly as the main filesystem on Linux. 16TB isn't "small" but when it represents the entire filesystem for a file server, it starts to look like quite the limitation.
you have files (a VM file) that's larger than 16 TiB?
That's not a ton for a file server with large CAD drawings.
Hold on - why would you put the CAD drawings into a VM at that point? Assuming you aren't saying you have single drawings that are 16 TiB. Why not just dump the CAD files directly into a filesystem themselves?
A filesystem has to fit into a file. So a file limit becomes a filesystem limit.
-
@Dashrender said:
Right, but when you're working with files that large - why bother storing them in a VM - just st.... OK yeah, that goes against the standard practice now.. so we need a VM, even if the whole host is a VM - welp, I guess your stuck with XFS
Pretty much. EXT4 is pretty silly for a server of any size, which is why even for desktops RHEL is XFS by default and EXT4 only as an option for advanced users. EXT4's days are pretty much over.
