File Server Upgrade Options

larsen161

I posted over on SW but wanted to get the mango input too
https://community.spiceworks.com/topic/2054391-file-server-upgrade-options

I'm looking for some views and opinions on how to upgrade, change, or replace our existing file server setup to accommodate the imminent capacity limitation that will be reached soon. Use case is storing and editing of video files of around 2-4GB in size currently growing as more 4/6k content is used.

Initial thoughts are go with something like a Dell R730xd or HP DL180 but I'm worried that capacity constraints on these won't allow me to go much past current storage capacity at RAID10. Then use the current DS316JS as DAS on this new unit.

Current Setup
Mac Pro (mid 2012) running macOS 10.12.5, 24GB, 2x 2.4GHz Xeon (no comments needed, we're moving forward)
A DS316JS with 2 equal sets of RAID5 in a 8 x 6TB config (same as above)
Connected via a Areca ARC-1883x RAID Card
Networked with a 6 port 1 Gbps NIC
Backed up to Backblaze ($5/mo)

Goals
Run a 'proper' storage server OS
Migrate to more reliable RAID configuration
Upgrade storage capacity (expect to run out in March 2018)
Backup data

Support 6k video editing across a team of 12
Adding 10Gbps to server
Adding 10Gbps switch
Adding 10Gbps to clients

Constraints
Cost - we need to keep costs as low as possible

leverage existing DS316JS and drives as much as possible
keeping backup with Backblaze would be a key cost savings

DustinB3403

How much storage space do you have currently?

marcinozga

If you need to keep cost down, then Supermicro is your friend. They have some massive storage options available, that you probably won't even find from other vendors.

larsen161

@dustinb3403 "2 equal sets of RAID5 in a 8 x 6TB"

DustinB3403

@larsen161 said in File Server Upgrade Options:

@dustinb3403 "2 equal sets of RAID5 in a 8 x 6TB"

With or without a spare drive in the arrays?

coliver

@larsen161 said in File Server Upgrade Options:

@dustinb3403 "2 equal sets of RAID5 in a 8 x 6TB"

So you have 96TB raw. How much storage do you need? Can you afford half of that being eaten up by RAID 10 or do you need to move to RAID 6?

larsen161

@dustinb3403

Filesystem Size Used Avail Capacity iused ifree %iused Mounted on
/dev/disk2s2    38Ti   30Ti  8.1Ti    79%     3450784 4291516495    0%   /Volumes/Grandsister_Benny
/dev/disk1s2    38Ti   26Ti   12Ti    69%     1177292 4293789987    0%   /Volumes/Grandmaster_Benny

scottalanmiller

RAID 6 or maybe 60 will make the most sense, Im sure, to keep costs from exploding.

Dashrender

@scottalanmiller said in File Server Upgrade Options:

RAID 6 or maybe 60 will make the most sense, Im sure, to keep costs from exploding.

assuming this gives the performance you need, this was my thinking.

larsen161

@coliver expect to run out of storage in march. @scottalanmiller the raid 6 or 60 does seem like the most cost conscious option.

coliver

@larsen161 said in File Server Upgrade Options:

@coliver expect to run out of storage in march. @scottalanmiller the raid 6 or 60 does seem like the most cost conscious option.

Yep, then RAID 6 or 60 is the way to go.

DustinB3403

@larsen161 said in File Server Upgrade Options:

@dustinb3403

Filesystem       Size   Used Avail    Capacity iused      ifree                 %iused  Mounted on
/dev/disk2s2    38Ti   30Ti   8.1Ti    79%       3450784 4291516495    0%         /Volumes/Grandsister_Benny
/dev/disk1s2    38Ti   26Ti   12Ti     69%       1177292 4293789987    0%         /Volumes/Grandmaster_Benny

Ok now it makes a bit more sense, the columns being misaligned had me confused for a second.

DustinB3403

I'd probably look at RAID60 at these scales.

scottalanmiller

@larsen161 said in File Server Upgrade Options:

@coliver expect to run out of storage in march. @scottalanmiller the raid 6 or 60 does seem like the most cost conscious option.

And I agree inn superMicro chassis. Pretty much unbeatable.

larsen161

@scottalanmiller wow, supermicro has some impressive chassis. but ohh boy, their website design though....

perhaps something like the 24-bay, 4u SC846BE1C-R1K28B

do they offer pre-sales support or its via a reseller typically?

scottalanmiller

@larsen161 said in File Server Upgrade Options:

@scottalanmiller wow, supermicro has some impressive chassis. but ohh boy, their website design though....

perhaps something like the 24-bay, 4u SC846BE1C-R1K28B

do they offer pre-sales support or its via a reseller typically?

Generally via reseller. I don't like their sales system, but I love their products. I wish that xByte would carry them.

Obsolesce

@larsen161 said in File Server Upgrade Options:

Goals
Run a 'proper' storage server OS
Migrate to more reliable RAID configuration
Upgrade storage capacity (expect to run out in March 2018)
Backup data
Support 6k video editing across a team of 12
Adding 10Gbps to server
Adding 10Gbps switch
Adding 10Gbps to clients

You can use any existing server you have, but get a decent RAID card, such as a H830 2GB nvcache.
Go to xbyte.com, and price out something like a Dell MD1400. You could build something nice with a bunch of NL SAS drives. This whole thing will run at 12gbps bandwidth. Hook your server up to 10gbps fiber switch.

It'll look like this:

client -> fiber switch -> server -> 12gbps SAS to MD1400 (and back)

You could probably do the whole thing for under 7k depending on how big the hard drives are and how many. If you threw in 12x 4TB NL SAS drives, it'll be under 7k most likely. You could RAID10 that.

larsen161

Thoughts on a 45 Drives setup?

travisdh1

@larsen161 said in File Server Upgrade Options:

Thoughts on a 45 Drives setup?

Not that great generally. For how Backblaze uses them they're good, but really not nearly so reliable as a normal server.

scottalanmiller

@larsen161 said in File Server Upgrade Options:

Thoughts on a 45 Drives setup?

Cheesy. Not for production use. Better than the B.B. Pods, but still not applicable to any SMB.