Need to Improve Disk Utilization on XenServer 7.2
-
What kind of cache do you have on the storage system?
-
Yes I could pop in a second drive.
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
Yes I could pop in a second drive.
Going to RAID 1, that would double your read IOPS (RIOPS) but keep your write IOPS (wiops) steady the same as they are now. There are always reads, normally way more reads than writes, so this would certainly help and possibly fix the problem completely. Also staggering boot ups can help, give one VM time to get up and running before the other kicks off.
Without any RAID layer, I assume there is no cache mechanism as nearly all systems from hardware RAID to software RAID put their cache systems into their RAID and adding it separately is not trivial or obvious. So having a single slow mechanical drive without the contention absorbtion cache would be expected to cause IOPS to plummet with multiple VMs.
-
I assume that this is just a lab box? It might be worth getting a consumer SSD for this if the disk speed is an issue at all.
-
Talking offline, @krisleslie has SSD available. This, combined with moving to RAID 1, should fix the problems
- SSD typically have 10K - 100K IOPS per drive. 7200 RPM SATA have ~100 IOPS per drive. So this is a 100x - 1,000x time improvement in starting IOPS.
- SSD are electrical, not mechanical, and do not have a reduction in total available IOPS from contention. So instead of 100 IOPS dropping to 50-80 total IOPS split in two, it would remain the same total.
- RAID 1 would double the Read IOPS so most operations would have twice the available IOPS as a single SSD and write IOPS would be less likely to wait on Read operations.
- My adding a RAID layer, like MD RAID, there is the chance to add RAM cache on top of the RAID subsystem to absorb contention and improve IOPS for items in the cache.
-
With the recent news that Amazon is abandoning Xen, the concensus is that its time is really over. Citrix has really been crippling XenServer for about a year now. So a lot of people are moving to KVM. KVM is getting all of the love and attention these days. It might be worth switching now as this is a new install.
-
KVM also fully supports MD RAID, as does Xen, but XenServer officially doesn't support software RAID at all, which is stupid and ridiculous. You can make it work just fine, but they try to make it hard.
-
Fedora 26 makes a perfect platform for KVM. And Fedora 27 is releasing in just a couple of days.
-
@scottalanmiller wow if Amazon is moving away that’s HUGE. What’s that going to do to XO?!?!
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
@scottalanmiller wow if Amazon is moving away that’s HUGE. What’s that going to do to XO?!?!
XO was on here this week discussing that a lot. They are mostly still focused on XS, but definitely looking into how they can hook into KVM.
-
@scottalanmiller
So it sounds like I would do an install of Fedora as a server not desktop, to strip away the GUI. Then install kvm? What about management tools? -
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
@scottalanmiller
So it sounds like I would do an install of Fedora as a server not desktop, to strip away the GUI. Then install kvm? What about management tools?You can also install the GUI on the server and have local management tools. Obviously managing purely remotely is better. But as this is a desktop anyway, local management tools are not out of the question and you can switch later once you are comfortable with it. There is no lock in to your GUI or tools choices like with Hyper-V.
-
Check out this thread...
https://mangolassi.it/topic/14944/manage-kvm-through-cockpit/
-
-
-
Just more reason I like open source I think I’m gonna switch to kvm at home
-
@krisleslie said in Need to Improve Disk Utilization on XenServer 7.2:
Just more reason I like open source I think I’m gonna switch to kvm at home
I've been using KVM instead of Hyper-V or VirtualBox for desktop use for the last ~year and it is great. So much better.
-
@scottalanmiller well like they say all good things come to an end
XSI like XO I hope he considers porting to KVM.
-
A co-worker has the same laptop as I do, except the 15" version. Everything else is the exact same.
He's using EXT4 + LVM, and qcow2 for virtualdisks.
I'm using XFS + LVM, and RAW (.img) for virtual disks.
My Win10 VM gets twice the I/O as his. We both had nothing in the background running.
I know this doesn't help with Xen, but food for thought. (we're both using m.2 SSDs) Mine was over 2k MBps reads, his was 1k, mine was 400 MBps writes, his was 200
Edit: We're both running Fedora 26. At that time I was running Gnome and him Cinnamon.
-
@tim_g what would be the comparison speed of a raid 10 off spinning rust to 1 ssd in iops?
