Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s
-
Is your local SR for XCP-NG a LVM based or a thin provisioned EXT3 based?
-
What Brand and Model of server is it? There is a Dell BIOS "system profile" setting that could be crushing your performance that looks like it was the default setting on some 12G servers. DAPC specifically.
-
The BIOS "power saving" discussion can be found here. I recently changed my setting from DAPC ==> Performance ==> PPW/OS.
FWIW, the noise from the fans was more than I liked for my home office environment when set to Performance.
-
So I read an article from a senior level virtualization expert on the Dell BIOS system performance setting. Could be that but I don't have the ability to check right now. At home in my lab when I noticed that some of my vm's were going crap after about 10 of them were running, I properly enabled the settings and that fixed the issue of some of the sluggishness at my lab. Keep in mind this is an old R710 with a 512 Mb H700 with 2 drives in a raid 0. Not really a good comparison.
Honestly, every system I've virtualized ever has had the same issue with windows slow as hell file transfers.
Yes I use the local SR. At work, unfortunately, I used thin provisioning and will be switching back to thick when I do updates.
Can't be the drivers (this time) as they were always installed properly. I have taken some time to "bork" one system in my lab. It's nigh impossible to fix when the drivers are screwed up.
The system I'm currently on are two R530's both on RAID 10 with 4 drives (8 total but not using the other 4 yet). Dell brand drives I don't remember speed but assume they are NL-SAS with either 7200 RPM or 10k RPM.
-
Also it can't be the vm setup because it's the same performance whether on 2-core, 4-core, 8-core, with ram up to 16 Gbs. So if it is vm level, I'm happy to check whatever anyone suggests.
For clarity, last night I kicked off a 1.5 TB file copy and when I woke up on 500 Gb in change was transferred after 9 hours. -_-
-
Turn off VMQ within your Windows VM?
-
Keep in mind I've had same issue on EVERY hypervisor from Citrix, VMWare and Hyper-V. I know hyper-v has its flags you need to turn off that are clearly documented to address the situation it has with nic's but were talking on the same SR lol. Not transferring across nic.
-
@black3dynamite not yet, I can try that again but I think my nic's are intel (not 100% sure), this is what I have done so far.
https://docs.microsoft.com/en-us/windows-server/storage/file-server/troubleshoot/slow-file-transfer
-
Have you tried disabling VMQ on the NIC Adapters in the VM? Some say this helps, others say it doesn't. I generally have good results with it.
-
I'll probably wait till everyone leaves and come in the morning early to double-check the BIOS. The disabling of the VMQ however, when I ran the command it didn't return that I had anything enabled....
I checked the Xen nic, and it doesn't have a listing in the advanced tab for the VMQ
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
I'll probably wait till everyone leaves and come in the morning early to double-check the BIOS. The disabling of the VMQ however, when I ran the command it didn't return that I had anything enabled....
I checked the Xen nic, and it doesn't have a listing in the advanced tab for the VMQ
I figured it wouldn't, but I was putting it out there anyway.
If you look at the NIC status, what does it show the connected speed?
-
@krisleslie no one has mentioned it, but are you sure that you have GigE end to end? 10MB/s is the speed cap when you have a 100Mb/s network link somewhere.
-
You could also have a bad switch in the mix.... that was the case for someone around here recently.
-
@dafyre said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
ook at the NIC status, what does it show the connected speed?
1 Gb
-
@scottalanmiller can't be it, because sometimes I see it do 60 Mbps + like during OS install or if I happen to catch it.
-
Potential bad switch as in maybe one of the interfaces is bad? I think a long time ago me and scott thought about switching to 10 gb interconnects for each switch
-
Can't be the NIC (???) I'm doing like a file transfer from one folder to another on the same disk/vm of the vm that I'm running. When I tried last night to copy vm to vm yea after 10 hours only 1/3rd got done give or take an hour or so.
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
Can't be the NIC (???) I'm doing like a file transfer from one folder to another on the same disk/vm of the vm that I'm running. When I tried last night to copy vm to vm yea after 10 hours only 1/3rd got done give or take an hour or so.
OK that takes the switch out of the situation.
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@dafyre said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
ook at the NIC status, what does it show the connected speed?
1 Gb
In the VM or at the Host?
-
As I'm running Crystal Disk Mark the speeds are so horrible I want to vomit.