Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s
-
@bnrstnr well hate to tell you but you hit the nail on the head. It's literally 1000's of small files between 100-500k.
-
@black3dynamite thats why you the man, I sure will.
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@bnrstnr well hate to tell you but you hit the nail on the head. It's literally 1000's of small files between 100-500k.
Try zipping them into a single, or multiple large files, then transfer.
I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.
-
@Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.
I use Robocopy, I believe it's more powerful, but I think it's a little more complex too. Either will be way better at handling all of those small files than copying them in explorer.
-
@bnrstnr said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.
I use Robocopy, I believe it's more powerful, but I think it's a little more complex too. Either will be way better at handling all of those small files than copying them in explorer.
yeah, xcopy when it's a simple copy.. Robo when you need more power.
-
@Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.
well, small files.
Now, make 500 1 GB files and see how fast it goes.
-
@Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.
well, small files.
Now, make 500 1 GB files and see how fast it goes.
Or 1 500GB file. Even better.
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
@Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.
Did you add the switch to use Multiple CPU threads?
-
The data is from one of my Ubiquiti UniFi Video (NVR) server. So the files are not really big. So are you proposing like maybe zipping the files into one file then transferring?
-
@bnrstnr That I did not, I'll look back over the command tomorrow. I have one of my servers home and will be testing the BIOS settings change.
-
@krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:
The data is from one of my Ubiquiti UniFi Video (NVR) server. So the files are not really big. So are you proposing like maybe zipping the files into one file then transferring?
If they are pre-compressed, then just tar them, don't zip them.
