Backup Systems without on-site external storage
-
@eddiejennings
I have similar scenario and my idea to get local backup was to have drives on the host that are passed through to one VM which just works as a file server for those drives - software raid.If the entire machine goes bye bye it would be a matter physically removing the drives in the bays and mounting them on another server. This would be possible because the files are located on a real file system (no LVM) and not inside a VM. Since it's software raid it is 100% portable to another machine with other hardware.
-
@pete-s said in Backup Systems without on-site external storage:
@eddiejennings
I have similar scenario and my idea to get local backup was to have drives on the host that are passed through to one VM which just works as a file server for those drives - software raid.If the entire machine goes bye bye it would be a matter physically removing the drives in the bays and mounting them on another server. This would be possible because the files are located on a real file system (no LVM) and not inside a VM. Since it's software raid it is 100% portable to another machine with other hardware.
So is it a VM our isn't it?
No LVM just complicates managing that storage, why would you think that it's good not to have it?
Yes, you can move those drives to another hardware box, but unless we're talking about a white box or bad NAS, the system almost always outlasts the drives themselves.
With LVM, you could plug in USB storage, mirror the entire thing, and carry the USB drive off with minimal fuss.
-
@travisdh1 said in Backup Systems without on-site external storage:
@pete-s said in Backup Systems without on-site external storage:
@eddiejennings
I have similar scenario and my idea to get local backup was to have drives on the host that are passed through to one VM which just works as a file server for those drives - software raid.If the entire machine goes bye bye it would be a matter physically removing the drives in the bays and mounting them on another server. This would be possible because the files are located on a real file system (no LVM) and not inside a VM. Since it's software raid it is 100% portable to another machine with other hardware.
So is it a VM our isn't it?
No LVM just complicates managing that storage, why would you think that it's good not to have it?
Yes, you can move those drives to another hardware box, but unless we're talking about a white box or bad NAS, the system almost always outlasts the drives themselves.
With LVM, you could plug in USB storage, mirror the entire thing, and carry the USB drive off with minimal fuss.
A backup is a backup and you need to be able to restore it on another machine. Otherwise it's not a backup.
An USB drive hanging of a colo rackserver isn't what I call a backup.
What I'm talking about is backup to disk array that only contain backup files and if the need arises easily can be mounted and restored on another server. If you don't have a hardware problem there will not be any need to remove the drives.
I don't know what purpose LVM would serve on a one partition disk array but if it makes you feel warm and cozy go ahead.
-
@pete-s said in Backup Systems without on-site external storage:
@travisdh1 said in Backup Systems without on-site external storage:
@pete-s said in Backup Systems without on-site external storage:
@eddiejennings
I have similar scenario and my idea to get local backup was to have drives on the host that are passed through to one VM which just works as a file server for those drives - software raid.If the entire machine goes bye bye it would be a matter physically removing the drives in the bays and mounting them on another server. This would be possible because the files are located on a real file system (no LVM) and not inside a VM. Since it's software raid it is 100% portable to another machine with other hardware.
So is it a VM our isn't it?
No LVM just complicates managing that storage, why would you think that it's good not to have it?
Yes, you can move those drives to another hardware box, but unless we're talking about a white box or bad NAS, the system almost always outlasts the drives themselves.
With LVM, you could plug in USB storage, mirror the entire thing, and carry the USB drive off with minimal fuss.
A backup is a backup and you need to be able to restore it on another machine. Otherwise it's not a backup.
An USB drive hanging of a colo rackserver isn't what I call a backup.
Neither is a backup going to drives in the same host. At least with the USB, you'd still have something available if the place burned down.
What I'm talking about is backup to disk array that only contain backup files and if the need arises easily can be mounted and restored on another server. If you don't have a hardware problem there will not be any need to remove the drives.
So long as the system is not writing junk to the array. Which while not common, I have seen happen.
I don't know what purpose LVM would serve on a one partition disk array but if it makes you feel warm and cozy go ahead.
Why would you not want LVM?
It's not that it makes me feel warm and fuzzy, it's the added functionality.
-
@pete-s said in Backup Systems without on-site external storage:
I don't know what purpose LVM would serve on a one partition disk array but if it makes you feel warm and cozy go ahead.
Adds snapshotting.
-
@pete-s said in Backup Systems without on-site external storage:
An USB drive hanging of a colo rackserver isn't what I call a backup.
As a USB connection is a network one (layer 2) and it's an external box, I'd consider it a backup, just a poor one. But technically, a USB connected disk is just a really crappy SAN. So if a SAN is considered good enough to be a back up, then a USB drive qualifies in that way.
To make a USB drive not qualify you'd have to come up with additional rules around backups like that they require internal redundancy (ruling out nearly all backup media like tape), that they need a minimum distance from the machine, etc. USB, as long as it is external, has both the network and physical separation. But is not protected from ransomware, but neither is any SAN.
-
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
-
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
-
Direct backup to both SFTP and loads of cloud providers, very nice.
-
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
I’ve only tested it with backing up nextcloud user data and it’s been working great so far.
-
@black3dynamite said in Backup Systems without on-site external storage:
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
I’ve only tested it with backing up nextcloud user data and it’s been working great so far.
What are you backing up to?
-
@scottalanmiller said in Backup Systems without on-site external storage:
@black3dynamite said in Backup Systems without on-site external storage:
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
I’ve only tested it with backing up nextcloud user data and it’s been working great so far.
What are you backing up to?
I only tried an external hard drive and sftp to a Linux Server. I would like to try Backblaze.
-
@black3dynamite said in Backup Systems without on-site external storage:
@scottalanmiller said in Backup Systems without on-site external storage:
@black3dynamite said in Backup Systems without on-site external storage:
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
I’ve only tested it with backing up nextcloud user data and it’s been working great so far.
What are you backing up to?
I only tried an external hard drive and sftp to a Linux Server. I would like to try Backblaze.
I would like to check out Wasabi.
-
@scottalanmiller said in Backup Systems without on-site external storage:
@black3dynamite said in Backup Systems without on-site external storage:
@scottalanmiller said in Backup Systems without on-site external storage:
@black3dynamite said in Backup Systems without on-site external storage:
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
I’ve only tested it with backing up nextcloud user data and it’s been working great so far.
What are you backing up to?
I only tried an external hard drive and sftp to a Linux Server. I would like to try Backblaze.
I would like to check out Wasabi.
At first glance, https://wasabi.com/pricing/ looks like it could be a little cheaper than B2. Would definitely be cheaper if you need to download significant amounts often.
-
@scottalanmiller said in Backup Systems without on-site external storage:
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
Borg and Restic are really similar. Borg supports less targets but is faster. They are both pretty good simple utilities. I have Borg running at home for my laptop but I don't need S3 support or anything.
-
@travisdh1 said in Backup Systems without on-site external storage:
@scottalanmiller said in Backup Systems without on-site external storage:
@black3dynamite said in Backup Systems without on-site external storage:
@scottalanmiller said in Backup Systems without on-site external storage:
@black3dynamite said in Backup Systems without on-site external storage:
@obsolesce said in Backup Systems without on-site external storage:
I've recently come across Restic and looks great:
Site:
https://github.com/restic/resticDocumentation:
https://restic.readthedocs.io/en/latest/I haven't tried it yet, but it's on my list to try on my KVM server using Google's cloud as a test.
I’ve only tested it with backing up nextcloud user data and it’s been working great so far.
What are you backing up to?
I only tried an external hard drive and sftp to a Linux Server. I would like to try Backblaze.
I would like to check out Wasabi.
At first glance, https://wasabi.com/pricing/ looks like it could be a little cheaper than B2. Would definitely be cheaper if you need to download significant amounts often.
That was its selling point - a bit cheaper than even B2, but with full S3 compatibility.
