Need to Improve Disk Utilization on XenServer 7.2
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
Just more reason I like open source I think Iām gonna switch to kvm at home
I've been using KVM instead of Hyper-V or VirtualBox for desktop use for the last ~year and it is great. So much better.
-
@scottalanmiller well like they say all good things come to an end
XSI like XO I hope he considers porting to KVM.
-
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
My Win10 VM gets twice the I/O as his. We both had nothing in the background running.
I know this doesn't help with Xen, but food for thought. (we're both using m.2 SSDs) Mine was over 2k MBps reads, his was 1k, mine was 400 MBps writes, his was 200
Edit: We're both running Fedora 26. At that time I was running Gnome and him Cinnamon.
-
@tim_g what would be the comparison speed of a raid 10 off spinning rust to 1 ssd in iops?
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
@scottalanmiller well like they say all good things come to an end
XSI like XO I hope he considers porting to KVM.
Oh he is considering it. Just don't know what he decided.
-
@tim_g said in Need to Improve Disk Utilization on XenServer 7.2:
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
My Win10 VM gets twice the I/O as his. We both had nothing in the background running.
I know this doesn't help with Xen, but food for thought. (we're both using m.2 SSDs) Mine was over 2k MBps reads, his was 1k, mine was 400 MBps writes, his was 200
Edit: We're both running Fedora 26. At that time I was running Gnome and him Cinnamon.
But both on KVM, right? No Xen involved?
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
@tim_g what would be the comparison speed of a raid 10 off spinning rust to 1 ssd in iops?
A SATA 7200 RPM drive is ~100 IOPS. So four of them in RAID 10 is 400 Read IOPS.
A typical SATA SSD is 10K - 100K IOPS.
You would need hundreds of SATA drives in a massive RAID 10 with huge cache to come close to a single $100 SSD drive, let alone a nice M.2 drive.
-
@scottalanmiller said in Need to Improve Disk Utilization on XenServer 7.2:
@tim_g said in Need to Improve Disk Utilization on XenServer 7.2:
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
My Win10 VM gets twice the I/O as his. We both had nothing in the background running.
I know this doesn't help with Xen, but food for thought. (we're both using m.2 SSDs) Mine was over 2k MBps reads, his was 1k, mine was 400 MBps writes, his was 200
Edit: We're both running Fedora 26. At that time I was running Gnome and him Cinnamon.
But both on KVM, right? No Xen involved?
Correct.
-
@tim_g said in Need to Improve Disk Utilization on XenServer 7.2:
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
Why RAW (.img), I thought qcow2 is/was preferred?
-
@fateknollogee said in Need to Improve Disk Utilization on XenServer 7.2:
@tim_g said in Need to Improve Disk Utilization on XenServer 7.2:
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
Why RAW (.img), I thought qcow2 is/was preferred?
I don't need any special features like snapshotting or anything like that, only performance. RAW is presented as-is to the VM and gives the best IO performance.
I can always convert if need be, and there are other ways of snapshotting/checkpointing.
There are many other differences too, but it's better to google comparisons rather than me try to quickly explain it while preoccupied.
-
@tim_g said in Need to Improve Disk Utilization on XenServer 7.2:
@fateknollogee said in Need to Improve Disk Utilization on XenServer 7.2:
@tim_g said in Need to Improve Disk Utilization on XenServer 7.2:
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
Why RAW (.img), I thought qcow2 is/was preferred?
I don't need any special features like snapshotting or anything like that, only performance. RAW is presented as-is to the VM and gives the best IO performance.
I can always convert if need be, and there are other ways of snapshotting/checkpointing.
There are many other differences too, but it's better to google comparisons rather than me try to quickly explain it while preoccupied.
If you preallocate the qcow2s you get close to raw speeds.
-
For what I'm doing qcow2 is fine, except I can't snapshot "q35/uefi"...a fix is coming sometime in the future.
-
Scott I knew it was vast difference but not 100x!!!! Dude a 4 ssd raid 10 is Basiclally all you need !!!
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
Scott I knew it was vast difference but not 100x!!!! Dude a 4 ssd raid 10 is Basiclally all you need !!!
Absolutely, that's why no one uses RAID 10 for SSDs, doesn't make sense as the leap in performance is so big. That's why RAID 5 is about all that is used.
-
@scottalanmiller said
You can also install the GUI on the server and have local management tools. Obviously managing purely remotely is better. But as this is a desktop anyway, local management tools are not out of the question and you can switch later once you are comfortable with it. There is no lock in to your GUI or tools choices like with Hyper-V.
"Obviously"
Hey do you consider cockpit a GUI?
-
@scottalanmiller
Hey Scott, I'm going to switch my SATA 7200 RPM spinning rust probably tonight. I'll go ahead and switch to a SSD (luckily I have a bunch sitting around). With that in mind, I'm trying to wrap my head around the performance impact per machine with SSD vs a HDD. I realize the RPM's drop per "vm" I have with spinning rust. Does my IOPS drop per vm with SSD?Also just to give some context, on my two Dell R530 @ work (thank God remember those oldy goldy days SAM I had haha), I went with SAS 7200's with my H700 512 MB Cache. The thing runs like a champ with just my four 2 TB HDD's in Raid 10. I have literally no IOPS problems that I've experienced. I have about 30 VM's running. With that in mind, does it make sense at work to consider the swap to full SSD?
The only server i have that takes pure storage is a Ubiquiti NVR, short of that nothing else runs slow or has even blimped at me wrong. No startup sprawl either which when I look back at my old craptacular Dell Tower T110 i, it died from sprawl.
-
@scottalanmiller said in Need to Improve Disk Utilization on XenServer 7.2:
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
Scott I knew it was vast difference but not 100x!!!! Dude a 4 ssd raid 10 is Basiclally all you need !!!
Absolutely, that's why no one uses RAID 10 for SSDs, doesn't make sense as the leap in performance is so big. That's why RAID 5 is about all that is used.
If you used 4 ssd in a raid 10 do you still get ever increasing levels of performance?
-
@brrabill said in Need to Improve Disk Utilization on XenServer 7.2:
@scottalanmiller said
You can also install the GUI on the server and have local management tools. Obviously managing purely remotely is better. But as this is a desktop anyway, local management tools are not out of the question and you can switch later once you are comfortable with it. There is no lock in to your GUI or tools choices like with Hyper-V.
"Obviously"
Hey do you consider cockpit a GUI?
Yes, do you consider it local?
-
@jmoore said in Need to Improve Disk Utilization on XenServer 7.2:
@scottalanmiller said in Need to Improve Disk Utilization on XenServer 7.2:
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
Scott I knew it was vast difference but not 100x!!!! Dude a 4 ssd raid 10 is Basiclally all you need !!!
Absolutely, that's why no one uses RAID 10 for SSDs, doesn't make sense as the leap in performance is so big. That's why RAID 5 is about all that is used.
If you used 4 ssd in a raid 10 do you still get ever increasing levels of performance?
RAID is RAID. That the disk is SSD isn't a factor to the RAID system.
What can be a factor is if you use a RAID controller that caps out lower than your RAID subsystem.
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
@scottalanmiller
Hey Scott, I'm going to switch my SATA 7200 RPM spinning rust probably tonight. I'll go ahead and switch to a SSD (luckily I have a bunch sitting around). With that in mind, I'm trying to wrap my head around the performance impact per machine with SSD vs a HDD. I realize the RPM's drop per "vm" I have with spinning rust. Does my IOPS drop per vm with SSD?No, SSDs do not have contention.
