Storage and Data Locality
-
I’ve used rsnapshot before and it works really well. Uses hard links to save space. Won’t help with your VM disks but will help with files.
-
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
-
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
-
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
-
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
Don't need it for DR. Then the question becomes, why did someone make that policy?
-
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
With stateless machines, wouldn't it be easier to automate the deployment, especially if your data is stored on another virtual disk or storage appliance?
-
@black3dynamite said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
With stateless machines, wouldn't it be easier to automate the deployment, especially if your data is stored on another virtual disk or storage appliance?
Exactly, that's the theory. Have a system like Salt, Ansible, or just a build script that can restore the box automatically and another script or command that can restore the data, rather than the system. This provides not just lower cost and faster backups, but faster and more flexible restores.
-
@scottalanmiller said in Storage and Data Locality:
@black3dynamite said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
With stateless machines, wouldn't it be easier to automate the deployment, especially if your data is stored on another virtual disk or storage appliance?
Exactly, that's the theory. Have a system like Salt, Ansible, or just a build script that can restore the box automatically and another script or command that can restore the data, rather than the system. This provides not just lower cost and faster backups, but faster and more flexible restores.
I keep forgetting how much easier state machines make backups for servers, keep beating it into my head, I promise I'll get reprogrammed soon.
-
@travisdh1 said in Storage and Data Locality:
@scottalanmiller said in Storage and Data Locality:
@black3dynamite said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
With stateless machines, wouldn't it be easier to automate the deployment, especially if your data is stored on another virtual disk or storage appliance?
Exactly, that's the theory. Have a system like Salt, Ansible, or just a build script that can restore the box automatically and another script or command that can restore the data, rather than the system. This provides not just lower cost and faster backups, but faster and more flexible restores.
I keep forgetting how much easier state machines make backups for servers, keep beating it into my head, I promise I'll get reprogrammed soon.
Takes a while to get used to thinking of them in that way.
-
@scottalanmiller said in Storage and Data Locality:
@black3dynamite said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
With stateless machines, wouldn't it be easier to automate the deployment, especially if your data is stored on another virtual disk or storage appliance?
Exactly, that's the theory. Have a system like Salt, Ansible, or just a build script that can restore the box automatically and another script or command that can restore the data, rather than the system. This provides not just lower cost and faster backups, but faster and more flexible restores.
Ya. I just back up GitLab. There’s a couple VMs with data but not many. All of our workstations are stateless. If there’s an issue I just kickstart again and Ansible does the work.
-
@scottalanmiller said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
Don't need it for DR. Then the question becomes, why did someone make that policy?
They want every physical and virtual server backed up at least weekly.
If a stateless server goes down, I don't have time to rebuild it. I am also not at a place to fully implement Salt to redeploy every damn server we have... we have 100+ servers and most of them are all different. That's a lot of work.
Yes, in an ideal environment it wouldn't be like that. But it takes time to get there, and there aren't enough of us to do it now, and there are many higher priority things going on atm. But it's getting closer.
There's also the issue of me being "the man behind the curtain" like the Wizard of OZ. It was brought up that implementing so many different things like SS, NC, this, that, and the other thing isn't desirable because of the hit by the bus issue...
So politics are another thing.
Anyways, ReaR works great for servers... I use it, and am glad I do. It's already proved itself!!
-
@scottalanmiller said in Storage and Data Locality:
@black3dynamite said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
@stacksofplates said in Storage and Data Locality:
@tim_g said in Storage and Data Locality:
ReaR is great as agent based backup for image based recovery and inceementals. For file based, I like FWBackups.
ReaR works great on stateless VMs, really easy and quick to recover.
Why are you backing up stateless machines?
Policy and DR.
With stateless machines, wouldn't it be easier to automate the deployment, especially if your data is stored on another virtual disk or storage appliance?
Exactly, that's the theory. Have a system like Salt, Ansible, or just a build script that can restore the box automatically and another script or command that can restore the data, rather than the system. This provides not just lower cost and faster backups, but faster and more flexible restores.
Yes you should have seen from my post hostory here that i fully understand and prefer that....
-
@aaronstuder said in Storage and Data Locality:
rsync?
I had considered that. I can't remember why I decided against that at the moment. I'm currently using it to transfer my NextCloud backups off-site.
-
@dafyre said in Storage and Data Locality:
@aaronstuder said in Storage and Data Locality:
rsync?
I had considered that. I can't remember why I decided against that at the moment. I'm currently using it to transfer my NextCloud backups off-site.
That's what rsnapshot uses under the hood. They just take care of the options and everything for you.
-
@stacksofplates Wow, rsnapshot looks good.
-
@aaronstuder said in Storage and Data Locality:
@stacksofplates Wow, rsnapshot looks good.
It's a very good.
