Raid10, must use or another Raid limits?
-
@Jimmy9008 said in Raid10, must use or another Raid limits?:
So we have been told to use up to 15k to get ourselves backed up until then using the Veeam Agent Free Edition, then in 2020 we will be incorporated. Out of my hands, but is what it is.
Holy crap these people can just burn money for fun. This waste is insane!
-
I hope that they pay really well, because they are mocking you with the money to just throw away for no reason.
-
@scottalanmiller said in Raid10, must use or another Raid limits?:
I hope that they pay really well, because they are mocking you with the money to just throw away for no reason.
Lol, its ok.
-
@Jimmy9008 said in Raid10, must use or another Raid limits?:
So, I just need something for 15k or less that will get me to 2020.
Downside... there is no answer we can give (or you can give) that will tell you if this is the case.
Upside... you are given no goals or requirements. So ANYTHING you give is an answer.
-
Given their requirements, get the cheapest crap you can, RAID 6 it, and who cares. Honestly, that's the answer. With the corners that they are trying to cut, it doesn't matter. I'm serious, I would step back and not worry about it working, only with meeting the stated requirements.
-
@scottalanmiller said in Raid10, must use or another Raid limits?:
@Jimmy9008 said in Raid10, must use or another Raid limits?:
So, I just need something for 15k or less that will get me to 2020.
Downside... there is no answer we can give (or you can give) that will tell you if this is the case.
Upside... you are given no goals or requirements. So ANYTHING you give is an answer.
In terms of VMs, from memory (im at home) the blades run around 380 VMs. The storage side (aka 170TB number) comes from another team, so I have to just go based on that.
-
https://mangolassi.it/topic/11852/why-it-builds-a-house-of-cards
Someone is building a house of cards. Just make sure you aren't the one responsible when it falls.
-
@Jimmy9008 said in Raid10, must use or another Raid limits?:
In terms of VMs, from memory (im at home) the blades run around 380 VMs. The storage side (aka 170TB number) comes from another team, so I have to just go based on that.
So... could be anything. No retention or recovery details? RTO? RPO?
-
@scottalanmiller said in Raid10, must use or another Raid limits?:
@Jimmy9008 said in Raid10, must use or another Raid limits?:
In terms of VMs, from memory (im at home) the blades run around 380 VMs. The storage side (aka 170TB number) comes from another team, so I have to just go based on that.
So... could be anything. No retention or recovery details? RTO? RPO?
Retention: 20 days, daily incremental. RTO, RPO - nope.
-
@Jimmy9008 said in Raid10, must use or another Raid limits?:
daily incremental.
Such a meaningless thing to have included. So frustrating.
-
@Jimmy9008 said in Raid10, must use or another Raid limits?:
Retention: 20 days
That's at least pretty easy.
-
@Jimmy9008 said in Raid10, must use or another Raid limits?:
@scottalanmiller said in Raid10, must use or another Raid limits?:
@Jimmy9008 said in Raid10, must use or another Raid limits?:
@scottalanmiller said in Raid10, must use or another Raid limits?:
@Jimmy9008 said in Raid10, must use or another Raid limits?:
At the end of the retention period, it injects the oldest increment in to the original full backup... is that not possible with tape?
Definitely not possible with tape. But that's just one of the many assumptions that need to be changed. Someone did your backup planning based on false assumptions. You need to back up and decide on goals and make all decisions based on those goals.
However, what you describe isn't exactly how Veeam works. Also, Veeam is a company, not a product, there are multiple free products from them. And they all work a bit differently.
https://www.veeam.com/windows-endpoint-server-backup-free.html
That one.
Good thing that I asked, this is a case where me being pedantic really did result in the answer no one would expect. "The free version of Veeam" means this one to almost all people: https://www.veeam.com/virtual-machine-backup-solution-free.html
Does the version you put here allow scheduling with the free version, and unlimited VMs?
If free is the target point for the software that does this, while Veeam has an option, it may not be the best solution.
-
Honestly speaking, since you can't afford any licensing for this, you should only be looking at open source solutions. Not even things that are free and closed.
Just removing the "licensing overhead and conversation from the table".
-
@DustinB3403 said in Raid10, must use or another Raid limits?:
Honestly speaking, since you can't afford any licensing for this, you should only be looking at open source solutions. Not even things that are free and closed.
Just removing the "licensing overhead and conversation from the table".
If we were building with full freedom, definitely. UrBackup, Tape, we could solve the problem pretty easily from a business perspective.
But given the strict requirements, our hands are tied.
-
I would not do as what has been discussed.
I'd do 3 arrays of 8 x 8TB 3.5" SATA enterprise drives on software RAID 6. That's about 150TB. If it's not enough just go with 4 arrays instead.
Time to rebuild a 8TB drive at 100 MB/s is 8000000/100=80000s=22 hours. That's nothing.
Probability for drive failure is 4% per year for each array.If you have unrecoverable read error (probability < 9% for the above config) during rebuild it's not the end of the world. That's old hardware raid thinking. You just have to clone the offending drive, replace it and rebuild again. You will end up with a byte somewhere on the array that are incorrect but the rest of the data will be fine. Backups should have file hash (checksum) to verify it's integrity so no big deal in this particular case.
8TB Exos Enterprise SATA drives are around $250. So 24*250=$6000 for the drives.
Software raid won't need a raid controller and has very low CPU and RAM requirements on HDD arrays - if you use a reasonable file system. If you're using Supermicro you should pick a chassis with a SAS port expander, not the one mentioned earlier in the thread.I would use the arrays as individuals so you can take one of them out of commission if you like and run backups on the others instead. Maybe even put it on two servers instead of one.
-
@Pete-S the issues here is you're splitting the array. The disks all could still fail, and a resilver would need to be done anyways.
In what world if a few bits being screwy acceptable?
That means that data is useless.
-
@scottalanmiller said in Raid10, must use or another Raid limits?:
@DustinB3403 said in Raid10, must use or another Raid limits?:
Honestly speaking, since you can't afford any licensing for this, you should only be looking at open source solutions. Not even things that are free and closed.
Just removing the "licensing overhead and conversation from the table".
If we were building with full freedom, definitely. UrBackup, Tape, we could solve the problem pretty easily from a business perspective.
But given the strict requirements, our hands are tied.
The backup solution is up for design. We aren't dealing with the existing file servers.
Urbackup on the white box, with a MD raid 10.
-
@DustinB3403 said in Raid10, must use or another Raid limits?:
@Pete-S the issues here is you're splitting the array. The disks all could still fail, and a resilver would need to be done anyways.
In what world if a few bits being screwy acceptable?
That means that data is useless.
I'm not sure what you mean. But a backup is a backup, so the original is still in place. If you have 100 incremental backups and you know that number 65 has bit errors you have to schedule a full backup on the VM that the backup belongs to.
It's a numbers game.
-
@Pete-S it's not just a numbers game, that's a failure of your backup. And if you require data from that backup, then your done for.
It may work, it may not. But it's not a reasonable thing to say "eh it's our only backup it may work when we need".
-
@DustinB3403 said in Raid10, must use or another Raid limits?:
@Pete-S it's not just a numbers game, that's a failure of your backup. And if you require data from that backup, then your done for.
It may work, it may not. But it's not a reasonable thing to say "eh it's our only backup it may work when we need".
RAID10 makes no difference if that is what you mean. You can have a disc failure on rebuild and then you have nothing.
That's why I say it's a numbers game. With 4% probability of having to rebuild a drive and a 9% probability of a bit error in the rebuilding process the probability is 0.4% that you will not have a backup that is OK. Now multiply that with the probability that you will need that particular backup set during the one or two days it takes for you to identify the problem and schedule a full backup of that particular VM (which renders backup with screwy bits obsolete).
And to take it a bit further. What will happen if the backup is truly lost? There is a dollar amount attached to that problem.
