XenServer Export Performance Seems Poor
-
@BRRABill said:
Bob's Burgers?
Which the latest online episode has a similar theme to a thread here on ML today.
-
@scottalanmiller said:
@BRRABill said:
Best Buy?
OH! My mind totally jumped to a burger or donut place with coffee to go and sit and wait. OMG, that's hilarious. Best Buy makes so much more sense.
LOL - you're totally to much of a world traveler now.
-
I think it's been to long since @scottalanmiller has last seen a best buy for it come to mind.
-
@DustinB3403 said:
I think it's been to long since @scottalanmiller has last seen a best buy for it come to mind.
When I am in Texas we use Fry's instead of BB, so I get disconnected. When I am in NY, then it is BB.
-
@scottalanmiller said:
@DustinB3403 said:
I think it's been to long since @scottalanmiller has last seen a best buy for it come to mind.
When I am in Texas we use Fry's instead of BB, so I get disconnected. When I am in NY, then it is BB.
I have a BB 5 miles away, and a Micro Center 75. You probably don't have to guess which one I go to.
-
@olivier said:
As you can see, you are not the first: https://bugs.xenserver.org/browse/XSO-44
Import/Export speed is a nightmare
Disabling compression is a good first step to avoid GZIP in XenServer (which is known to be slow).
is there a way to disable compression on the VM export option? I see that checkbox for backups, but the export button just starts a download process with no options.
-
I created a backup job so I could move forward with testing.
I've installed a 3 TB drive in another desktop. WIn7 SP1 x64 4 GB RAM 1 Gb network connection, same switch as XS.
Backup started at 8:18 AM CDT
-
Tick tock tick tock
-
@Dashrender said:
I created a backup job so I could move forward with testing.
I've installed a 3 TB drive in another desktop. WIn7 SP1 x64 4 GB RAM 1 Gb network connection, same switch as XS.
Backup started at 8:18 AM CDT
Did you disable compression or not? Because that was the limiter before.
-
@Dashrender said:
@olivier said:
As you can see, you are not the first: https://bugs.xenserver.org/browse/XSO-44
Import/Export speed is a nightmare
Disabling compression is a good first step to avoid GZIP in XenServer (which is known to be slow).
is there a way to disable compression on the VM export option? I see that checkbox for backups, but the export button just starts a download process with no options.
Try reading.
-
@DustinB3403 said:
@Dashrender said:
@olivier said:
As you can see, you are not the first: https://bugs.xenserver.org/browse/XSO-44
Import/Export speed is a nightmare
Disabling compression is a good first step to avoid GZIP in XenServer (which is known to be slow).
is there a way to disable compression on the VM export option? I see that checkbox for backups, but the export button just starts a download process with no options.
Try reading.
Stop trying to be a dick just because someone questions your favorite toy.
I did read. He stated the options and asked if there was a way to disable it. He never subsequently posted that he did or did not.
He stated he created a backup job. One can assume he chose that option because he is able to uncheck that box as stated. But that would be an assumption, not a fact.
-
If you read what @Dashrender said, there is no option to enable or disable the compression within Xen Orchestra (it doesn't exist). Since it appears you aren't testing the appliance, why are you trying to comment on the functionality of it?
-
OK guys.. please take your debate to a WC thread.
-
Doesn't answer your export question, but something I came across:
https://xen-orchestra.com/blog/xenserver-backup-compress-or-not-compress/ -
@JaredBusch said:
@Dashrender said:
I created a backup job so I could move forward with testing.
I've installed a 3 TB drive in another desktop. WIn7 SP1 x64 4 GB RAM 1 Gb network connection, same switch as XS.
Backup started at 8:18 AM CDT
Did you disable compression or not? Because that was the limiter before.
Yes I disabled compression for this backup job. When I created a new backup job for this - couldn't use the Export option - I did make sure to check the box to disable compression.
-
@BRRABill said:
Doesn't answer your export question, but something I came across:
https://xen-orchestra.com/blog/xenserver-backup-compress-or-not-compress/Cool thanks - and you're right, While he does say export in the opening line, he's not talking about a single export, he's talking about backups.
I love the more or less one button push to create a one time export/backup of the system, it would be nice though to get a prompt for options (compressed/not compressed). I also wonder - is it efficient to download the "export" through the browser download instead of a direct push like the backup function uses? i.e. is the browser adding any overhead?
With that in mind an option of what pre-mapped mountpoint (network or local) to save to, and compress or non-compress would be to great options to see for the "export" option.
-
A little more than 5 hours and 270 GB done.
It seems to be going about 2 times faster, maybe 3.
-
@Dashrender said:
I love the more or less one button push to create a one time export/backup of the system, it would be nice though to get a prompt for options (compressed/not compressed). I also wonder - is it efficient to download the "export" through the browser download instead of a direct push like the backup function uses? i.e. is the browser adding any overhead?
Right, since this basically is a full backup that is being downloaded to your browser.
-
@Dashrender In any case, it's not a "full" direct push: it goes through
xo-server, since we can't tell XenServer to push itself a VM somewhere. In fact, export is always working in "pull": a HTTP handler is opened by XAPI, and listen for HTTP GET request.This is valid for everything,
xe, XenCenter, XO export through your browser, XO backups etc.So it's not really an overhead with your browser,
xo-serverjust act as a proxy to deliver your file (so if you don't have network bottleneck between you andxo-serverthat's OK:XenServer --> xo-server --> browserA backup will do:
XenServer --> xo-server --> remote pointBut as I said, in any case,
xo-serverwill do a HTTP GET.The main bottleneck is Gzip compression first. If you disable it, that's another potential bottleneck: the XAPI HTTP handler speed.
Note: the possibility to ask XAPI to push a backup somewhere will be discussed with the XAPI team during Xen Hackathon. IDK if they could do something, but I'll be at their office to explain the issue, in front of the whole dev team.
-
By the way you can rename the topic title
