Create NFS file share on Hyper-V Server 2016
-
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@dashrender said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@dashrender said in Create NFS file share on Hyper-V Server 2016:
@dashrender said in Create NFS file share on Hyper-V Server 2016:
Scott - is there a way to get the data of the backups of the local VM's on HV06 into a VHD that is also on HV06?
Assume VM01 is the 15 TB VM that needs to be backed up... currently Hyper-V backs it up using Windows backup to from (just go with me) c:\vms\vm01.vhd to e:\backup\backupupfile e: being on the MD1000.
Is there a way to backup VM01 to the filesystem inside VM99 instead? Then pass the tape through to VM99 and backup everything inside there?
Can this be done and never touch the network?So I take it there was no merit here?
The Hyper-V VM backups via Windows Server Backup are separated and are not in a single VHD. So it's 15 TB separated into appropriate folders depending on the VM and data. There is no single 15TB VM. It's 70 VMs totaling 15 TB. And another few total TBs from physical Linux servers, that need to be backed up to the MD1000.
OK none of that changes my question.
Oh I see the question. Yes you can pass a tape drive to a VM using SW tape redirector... but it's slower.
I have a few things to test, but i'm going in order of least work required. So first I'm going to try the following:
- Set up Linux VM to host an NFS share in a .VHDX on the MD1000.
- Make sure that .VHDX is EXCLUDED in the main tape backup job.
- Install Yosemite client in the Linux VM hosting the NFS share.
- See if I can configure Yosemite to:
- Back up Hyper-V Backups directly from MD1000 to tape (as they currently are)
- Back up contents of NFS share to tape.
I think this is what both you and SAM were saying (right?)... it just took me awhile to get what you were saying.
Yes!
-
And now you see why Dash really wanted to know which software was in use, so that we could figure out which pieces needed to be used in which way.
-
@scottalanmiller said in Create NFS file share on Hyper-V Server 2016:
And now you see why Dash really wanted to know which software was in use, so that we could figure out which pieces needed to be used in which way.
Yes, I started only wanting to run NFS on the HV06 host itself... as in not in a VM, but through a program to install that will allow you to share out a folder via NFS. I was thinking along those lines, and not wanting the software to be relevant.
But I guess in the end, running the backup software inside of a VM instead of the host may be the way to go. The backup software client still needs to be on HV06 (the host) so that stuff can be backed up and so that the tape drive is made available to Yosemite. But also putting the Yosemite client on the VM hosting an NFS share I think will allow me to back up that NFS share directly to tape and also the other stuff to tape in the same job (hopefully not over the network).
I'm going to be testing this today.
Thanks everyone!
-
So far, it looks like it will let me do what I want. (serv-nfs) Installed on Fedora 27 minimal from net install, plus a few necessities like Cockpit etc.
Now to fill the linuxbackups directory with a physical Linux server backup test:
-
@tim_g late to party. can this help with your original plan?
-
@matteo-nunziati said in Create NFS file share on Hyper-V Server 2016:
@tim_g late to party. can this help with your original plan?
Yes, something like that but a little more current would have been perfect!
A lot less moving parts with something like that... I'd be able to cut out needing another VM and Yosemite license.
-
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@matteo-nunziati said in Create NFS file share on Hyper-V Server 2016:
@tim_g late to party. can this help with your original plan?
Yes, something like that but a little more current would have been perfect!
A lot less moving parts with something like that... I'd be able to cut out needing another VM and Yosemite license.
Or just don't use Yosemite
-
@dustinb3403 said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@matteo-nunziati said in Create NFS file share on Hyper-V Server 2016:
@tim_g late to party. can this help with your original plan?
Yes, something like that but a little more current would have been perfect!
A lot less moving parts with something like that... I'd be able to cut out needing another VM and Yosemite license.
Or just don't use Yosemite
They stopped selling it, and they want to ride out this last year of support, which ends for everyone Sept 30th I think. Then we are forced to... which can't come soon enough.
-
With less than 9 months to go, Now is the prefect time to be looking at, testing other options. It's kinda crazy to wait until sept to do that.
-
@dashrender said in Create NFS file share on Hyper-V Server 2016:
With less than 9 months to go, Now is the prefect time to be looking at, testing other options. It's kinda crazy to wait until sept to do that.
Already tested and decided on several options, it comes down to budget, which is not decided by me.
My boss already has all he needs from me, with my recommendations and costs.
-
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@dustinb3403 said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@matteo-nunziati said in Create NFS file share on Hyper-V Server 2016:
@tim_g late to party. can this help with your original plan?
Yes, something like that but a little more current would have been perfect!
A lot less moving parts with something like that... I'd be able to cut out needing another VM and Yosemite license.
Or just don't use Yosemite
They stopped selling it, and they want to ride out this last year of support, which ends for everyone Sept 30th I think. Then we are forced to... which can't come soon enough.
Sounds like it is time for Veeam.
-
@scottalanmiller said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@dustinb3403 said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
@matteo-nunziati said in Create NFS file share on Hyper-V Server 2016:
@tim_g late to party. can this help with your original plan?
Yes, something like that but a little more current would have been perfect!
A lot less moving parts with something like that... I'd be able to cut out needing another VM and Yosemite license.
Or just don't use Yosemite
They stopped selling it, and they want to ride out this last year of support, which ends for everyone Sept 30th I think. Then we are forced to... which can't come soon enough.
Sounds like it is time for Veeam.
That's great backup software, but for us, it's twice as expensive as other options that tested just as good or better.
-
I did a physical Linux server backup to the NFS share... it went at like 23-ish MB/sec.
I need to find the bottleneck. Perhaps it's just regular network congestion, I'm going to need to run another test while copying data in other places to compare speeds.
-
I also tried a Tape backup last night... it ran. But on the NFS server it didn't because apparently Yosemite service wasn't set to start at boot, so I didn't realize it wasn't running before I ran the tape job...
-
@tim_g said in Create NFS file share on Hyper-V Server 2016:
I did a physical Linux server backup to the NFS share... it went at like 23-ish MB/sec.
I need to find the bottleneck. Perhaps it's just regular network congestion, I'm going to need to run another test while copying data in other places to compare speeds.
23MB/sec sounds about right if it's being pushed over a 1Gb network at some point.
-
@travisdh1 said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
I did a physical Linux server backup to the NFS share... it went at like 23-ish MB/sec.
I need to find the bottleneck. Perhaps it's just regular network congestion, I'm going to need to run another test while copying data in other places to compare speeds.
23MB/sec sounds about right if it's being pushed over a 1Gb network at some point.
really? you only expect to get 184 Mb/s over 1 Gb network? I suppose if the ReaR process can't keep up (IOPs issue on server in question), that might be the case.
Tim - what speeds did you see in the past?
-
@dashrender said in Create NFS file share on Hyper-V Server 2016:
Tim - what speeds did you see in the past?
I don't remember. When I originally set up the physical Linux servers to back up to an NFS share through HV06 on the MD1000, I looked then and must have been a number I expected, otherwise I'd remember more about it and done it a different way if the numbers were this low.
-
Bleh, the stuff from the NFS share is going to Tape via network (3 GB/minute). The other stuff goes way faster (14 GB/minute), so I can tell that's going directly from MD1000 to tape through HV06 via SAS cable.
-
@tim_g said in Create NFS file share on Hyper-V Server 2016:
Bleh, the stuff from the NFS share is going to Tape via network (3 GB/minute). The other stuff goes way faster (14 GB/minute), so I can tell that's going directly from MD1000 to tape through HV06 via SAS cable.
So is the other one, it's just likely going through the vSwitch inside Hyper-V.
-
@dashrender said in Create NFS file share on Hyper-V Server 2016:
@tim_g said in Create NFS file share on Hyper-V Server 2016:
Bleh, the stuff from the NFS share is going to Tape via network (3 GB/minute). The other stuff goes way faster (14 GB/minute), so I can tell that's going directly from MD1000 to tape through HV06 via SAS cable.
So is the other one, it's just likely going through the vSwitch inside Hyper-V.
No, there's no hyper-v involved between the Windows Server Backup data on the MD1000 and tape. HV06 pushes that data from the MD1000 through SAS all the way to the tape drive. That's going at 233 MB/s (1866 mbps), which is fitting for a 3gbps SAS backplane on the MD1000.
The data on the NFS share is going over the regular network from the VM. I'm just not sure the path it's taking. That it's only getting 50 MB/s over a 1gbps network tells me its making it's way (routing over) onto the regular network, somewhere between the VM and it's host. The fact that the NFS share needs to be accessible over the regular network limits me from being able to keep it internal only to the VM and host.
I'll have to think about it a little bit, I'm sure I can figure somethign out.