Server with multiple backplane / Drive Configuration
-
@PhlipElder said in Server with multiple backplane / Drive Configuration:
We tend to split-up high bandwidth/IOPS drives across cables.
In this case, we'd put half of the SSDs on one backplane and half on the other and set up the RAID array that way. This gives us a lot more bandwidth to play with.
So you're saying the backplane cable is a bottleneck?
-
@Dashrender said in Server with multiple backplane / Drive Configuration:
@CCWTech said in Server with multiple backplane / Drive Configuration:
@notverypunny said in Server with multiple backplane / Drive Configuration:
My vote would be to follow your example of keeping each array together on the backplane, not sure if it's going to make a difference but that's my gut.
You're inevitably going to get a question / inquisition on why R5 on the 6 SSDs so.... counting down .... 3..... 2...... 1.....
Sure, my answer would be why not RAID 5?
(RAID 5 on spinning drives is a bad idea, but since SSD's are completely different RAID 5 on an SSD array is just fine.)Better answer - because math.
Ha. . . that is what it really comes down too. The math just doesn't show any risk of URE when using SSDs in an OBR5. And since generally speaking SSDs don't limp along but instead just die when they do go, it's much more apparent to replace any failed equipment.
The the recovery times are so much faster with SSDs. Still have the impact of rebuilding the array on the drives, but you can't get around that.
-
@Dashrender said in Server with multiple backplane / Drive Configuration:
@PhlipElder said in Server with multiple backplane / Drive Configuration:
We tend to split-up high bandwidth/IOPS drives across cables.
In this case, we'd put half of the SSDs on one backplane and half on the other and set up the RAID array that way. This gives us a lot more bandwidth to play with.
So you're saying the backplane cable is a bottleneck?
Each cable has four SAS/SATA paths in it. So yes, with SSDs it is possible to saturate a single cable set.
A single 6Gbps SAS cable saturates around 377K IOPS. A single 12Gbps cable saturates around 750K IOPS. At least, that's what's happened in our own in-house storage thrashing tests.
-
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
@CCWTech It depends on the backplanes. There are different types.
Ok, Can you explain more please?
Well, the backplanes can be wired straight, meaning you have literally 1 SAS port for every bay. And the RAID card has to have support for 8 SAS ports per backplane (two cables).
Or the backplanes can be wired with integrated SAS expanders. Then you usually have 4 SAS ports from the RAID card to the SAS expander in one cable.
Then there is also the possibility that you have dual SAS expanders on the backplanes for using fail-over configuration.
The backplanes can also internally be wired in a daisy-chain configuration which means that backplane number two isn't fed from the RAID card but from the first backplane and only the first backplane is hooked up to the RAID card.
-
Better answer - because math.
LOL, true.
-
What server/model is it?
-
@Pete-S said in Server with multiple backplane / Drive Configuration:
What server/model is it?
HP ML350 Gen 10
-
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
What server/model is it?
HP ML350 Gen 10
https://techlibrary.hpe.com/docs/iss/ML350_Gen10/setup_install/
OK, looks like there are many storage options on that machine and many different raid controller options as well.
But, there are no SAS expanders on the backplanes. Backplanes are straight "dumb" wiring so to speak. HPE has an additional SAS expander card that have to be installed if you're using that.
So if you have 16 drive bays I assume 8x2.5" drive bays per "box". You then probably have it paired with the P816i-a controller in which case you have each drive bay directly wired to one SAS port from the controller.
So it makes no performance difference how you install the drives. I would however put the SSDs in one box (one backplane) and the HDDs in the other - just to make it less confusing and less of chance to pull the wrong drive when something fails.
I don't understand why you would use 2.5" HDDs at all though but that is another matter. The server can also be configured with one 8x2.5" and one 4x3.5" bay which would be my preference.
-
@Pete-S said in Server with multiple backplane / Drive Configuration:
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
What server/model is it?
HP ML350 Gen 10
https://techlibrary.hpe.com/docs/iss/ML350_Gen10/setup_install/
OK, looks like there are many storage options on that machine and many different raid controller options as well.
But, there are no SAS expanders on the backplanes. Backplanes are straight "dumb" wiring so to speak. HPE has an additional SAS expander card that have to be installed if you're using that.
So if you have 16 drive bays I assume 8x2.5" drive bays per "box". You then probably have it paired with the P816i-a controller in which case you have each drive bay directly wired to one SAS port from the controller.
So it makes no performance difference how you install the drives. I would however put the SSDs in one box (one backplane) and the HDDs in the other - just to make it less confusing and less of chance to pull the wrong drive when something fails.
I don't understand why you would use 2.5" HDDs at all though but that is another matter. The server can also be configured with one 8x2.5" and one 4x3.5" bay which would be my preference.
Yes, it is the HP SAS expander card I'm using.
-
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
What server/model is it?
HP ML350 Gen 10
https://techlibrary.hpe.com/docs/iss/ML350_Gen10/setup_install/
OK, looks like there are many storage options on that machine and many different raid controller options as well.
But, there are no SAS expanders on the backplanes. Backplanes are straight "dumb" wiring so to speak. HPE has an additional SAS expander card that have to be installed if you're using that.
So if you have 16 drive bays I assume 8x2.5" drive bays per "box". You then probably have it paired with the P816i-a controller in which case you have each drive bay directly wired to one SAS port from the controller.
So it makes no performance difference how you install the drives. I would however put the SSDs in one box (one backplane) and the HDDs in the other - just to make it less confusing and less of chance to pull the wrong drive when something fails.
I don't understand why you would use 2.5" HDDs at all though but that is another matter. The server can also be configured with one 8x2.5" and one 4x3.5" bay which would be my preference.
Yes, it is the HP SAS expander card I'm using.
Since the backplanes in that server doesn't do anything, it makes no difference in what bays you put the drives. Not from a performance perspective and not from a redundancy perspective.
From the SAS expander to the backplane to the drive is electrically the same as just having a straight cable. So there is nothing that can fail - unless you physically abuse it.
The backplane does have some electronic components on it though but that is for driving the LEDs in the drive bays.
-
@Pete-S said in Server with multiple backplane / Drive Configuration:
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
@CCWTech said in Server with multiple backplane / Drive Configuration:
@Pete-S said in Server with multiple backplane / Drive Configuration:
What server/model is it?
HP ML350 Gen 10
https://techlibrary.hpe.com/docs/iss/ML350_Gen10/setup_install/
OK, looks like there are many storage options on that machine and many different raid controller options as well.
But, there are no SAS expanders on the backplanes. Backplanes are straight "dumb" wiring so to speak. HPE has an additional SAS expander card that have to be installed if you're using that.
So if you have 16 drive bays I assume 8x2.5" drive bays per "box". You then probably have it paired with the P816i-a controller in which case you have each drive bay directly wired to one SAS port from the controller.
So it makes no performance difference how you install the drives. I would however put the SSDs in one box (one backplane) and the HDDs in the other - just to make it less confusing and less of chance to pull the wrong drive when something fails.
I don't understand why you would use 2.5" HDDs at all though but that is another matter. The server can also be configured with one 8x2.5" and one 4x3.5" bay which would be my preference.
Yes, it is the HP SAS expander card I'm using.
Since the backplanes in that server doesn't do anything, it makes no difference in what bays you put the drives. Not from a performance perspective and not from a redundancy perspective.
From the SAS expander to the backplane to the drive is electrically the same as just having a straight cable. So there is nothing that can fail - unless you physically abuse it.
The backplane does have some electronic components on it though but that is for driving the LEDs in the drive bays.
Awesome thank you everyone!
