Xenserver and Storage
-
@jrc said in Xenserver and Storage:
@scottalanmiller said in Xenserver and Storage:
@jrc said in Xenserver and Storage:
Then how on earth does that solution scale like they say it does? That means you have a limit of ~32Tb of attached storage (Xen's 16* attached VHD limit and 2Tb per VHD limit). How does the virtual appliance handle getting beyond that?
You have to work around the 2TB limit in another way, but Starwind will use it regardless of how you get it there. So Starwind definitely does not have that limit. But trying to use Xen's 2TB limit system under it will create limits on the Xen side.
I'm sorry of this sounds dense, but what??
(And yeah, I realize when We/I say Xen we mean Xenserver and not pure Xen).
Starwind isn't a bottleneck here. If your goal is to scale to huge sizes, Starwind will do it. But Starwind, as a guest on top of Xen, requires you to provide storage to it to use. If you can't provide the storage, Starwind will just wait on you. You asked how Starwind can scale as large as they claim - but that's not what you are really asking about. Starwind is in no way failing to scale, it's XenServer failing to give Starwind enough storage.
Use something other than local disks on XenServer, switch to Xen, KVM, Hyper-V or ESXi and Starwind will scale beyond any useful sizes for those systems. XenServer has an artificially enforced limitation here, that exists only to cripple its local storage capacity, that cannot be easily worked around. But don't think that Starwind is failing to scale, that's not the issue.
-
Ok, let me take a step back here.
On the Host you install a VSAN controller VM, you then attach storage to this VM which it will then use as it's VSAN storage space and map that over to the host via iSCSI. Am I correct so far?
Allright, so with Xenserver, the max attached VHDs would be 16, at 2Tb each. And since this VSAN VM is to be used to home all your VMs on the host, you'd need it to have a fair bit of space. So having roughly a 32Tb limit could be a problem. Does this mean you'd need to have a second VSAN VM in that host, therefore upping that limit to 64Tb? And does the VSAN OS handle spanning the data across all 16 VHDs?
-
Switching to pure Xen, you lose XAPI which is what makes XenServer useful. Without XAPI tools like Xen Orchestra simply don't exist for the space. At least not to the same extent.
-
@jrc said in Xenserver and Storage:
Ok, let me take a step back here.
On the Host you install a VSAN controller VM, you then attach storage to this VM which it will then use as it's VSAN storage space and map that over to the host via iSCSI. Am I correct so far?
Allright, so with Xenserver, the max attached VHDs would be 16, at 2Tb each. And since this VSAN VM is to be used to home all your VMs on the host, you'd need it to have a fair bit of space. So having roughly a 32Tb limit could be a problem. Does this mean you'd need to have a second VSAN VM in that host, therefore upping that limit to 64Tb? And does the VSAN OS handle spanning the data across all 16 VHDs?
Where are you getting your limits from? I literally just posted them and did the math on what you could provide as storage to a single VM.
-
@dustinb3403 said in Xenserver and Storage:
@jrc said in Xenserver and Storage:
Ok, let me take a step back here.
On the Host you install a VSAN controller VM, you then attach storage to this VM which it will then use as it's VSAN storage space and map that over to the host via iSCSI. Am I correct so far?
Allright, so with Xenserver, the max attached VHDs would be 16, at 2Tb each. And since this VSAN VM is to be used to home all your VMs on the host, you'd need it to have a fair bit of space. So having roughly a 32Tb limit could be a problem. Does this mean you'd need to have a second VSAN VM in that host, therefore upping that limit to 64Tb? And does the VSAN OS handle spanning the data across all 16 VHDs?
Where are you getting your limits from? I literally just posted them and did the math on what you could provide as storage to a single VM.
Xenserver has a limit of 16 VHDs per VM, I know this from experience and it is buried in their docs. I think the 255 you mention is for pure Xen, which I am not running.
EDIT: Apparently the 16 VHD limit is a Xenserver 6.5 and earlier thing. Xenserver 7 is 255. I need to upgrade to 7....
-
Look at this link.
255 disks per VM, with a maximum of 4096 disks per host at the limits. Not 16.
-
@jrc said in Xenserver and Storage:
EDIT: Apparently the 16 VHD limit is a Xenserver 6.5 and earlier thing. Xenserver 7 is 255. I need to upgrade to 7....
Yeah you'd better.
-
Which means you can have an absolutely insane amount of storage space attached to the VSAN VM, and then pass that out to your other guests.
@scottalanmiller do any single server units support up to 521,220 TB worth of raw space?
-
@jrc said in Xenserver and Storage:
@dustinb3403 said in Xenserver and Storage:
@jrc said in Xenserver and Storage:
Ok, let me take a step back here.
On the Host you install a VSAN controller VM, you then attach storage to this VM which it will then use as it's VSAN storage space and map that over to the host via iSCSI. Am I correct so far?
Allright, so with Xenserver, the max attached VHDs would be 16, at 2Tb each. And since this VSAN VM is to be used to home all your VMs on the host, you'd need it to have a fair bit of space. So having roughly a 32Tb limit could be a problem. Does this mean you'd need to have a second VSAN VM in that host, therefore upping that limit to 64Tb? And does the VSAN OS handle spanning the data across all 16 VHDs?
Where are you getting your limits from? I literally just posted them and did the math on what you could provide as storage to a single VM.
Xenserver has a limit of 16 VHDs per VM, I know this from experience and it is buried in their docs. I think the 255 you mention is for pure Xen, which I am not running.
EDIT: Apparently the 16 VHD limit is a Xenserver 6.5 and earlier thing. Xenserver 7 is 255. I need to upgrade to 7....
Ah good, so not perfect, but there is a solution. Made VDIs to one VM is just like small LUNs in the SAN world. Annoying, but fine.
-
@dustinb3403 said in Xenserver and Storage:
@scottalanmiller do any single server units support up to 521,220 TB worth of raw space?
With DAS units, maybe. Some things like large Oracle and IBM chassis can have a single server spanning dozens of racks. So... it's theoretically possible.
-
@dustinb3403 said in Xenserver and Storage:
@dbeato You can completely skip Windows and use the Linux VSAN controllers.
https://www.starwindsoftware.com/announcing-new-linux-based-starwind-virtual-storage-appliance-video
Any idea on how I can download this? When I try all I can seem to find is the Windows installer.
-
@jrc said in Xenserver and Storage:
@dustinb3403 said in Xenserver and Storage:
@dbeato You can completely skip Windows and use the Linux VSAN controllers.
https://www.starwindsoftware.com/announcing-new-linux-based-starwind-virtual-storage-appliance-video
Any idea on how I can download this? When I try all I can seem to find is the Windows installer.
Use the request demo portion here.
Otherwise I'd hit up the folks @StarWind_Software to point you in the right direction.
-
Additionally @Oksana might be able to point you into the right direction.
-
@dustinb3403 said in Xenserver and Storage:
@jrc said in Xenserver and Storage:
@dustinb3403 said in Xenserver and Storage:
@dbeato You can completely skip Windows and use the Linux VSAN controllers.
https://www.starwindsoftware.com/announcing-new-linux-based-starwind-virtual-storage-appliance-video
Any idea on how I can download this? When I try all I can seem to find is the Windows installer.
Use the request demo portion here.
Yeah, I did. It just send me the link to the Windows installer.
Otherwise I'd hit up the folks @StarWind_Software to point you in the right direction.
I'll give that a go.
-
Hmm I see alot of Vsan advice which is the correct way to go, but I also wonder cant he do a simple thing like GlusterFS VM ? as well ? will that work in this case, and be simpler route ?
-
@emad-r said in Xenserver and Storage:
Hmm I see alot of Vsan advice which is the correct way to go, but I also wonder cant he do a simple thing like GlusterFS VM ? as well ? will that work in this case, and be simpler route ?
Yes and No. Would it work, yes. Would it be easier to manage and maintain and setup, no. @olivier can speak more to GlusterFS.
-
@emad-r said in Xenserver and Storage:
Hmm I see alot of Vsan advice which is the correct way to go, but I also wonder cant he do a simple thing like GlusterFS VM ? as well ? will that work in this case, and be simpler route ?
GlusterFS is still RLS, the advice is not really to use a VSAN, but to use RLS. People used to be sloppy and use VSA to refer to RLS, now they use VSAN. Neither is correct as RLS is more than any one connection technology.
GlusterFS will work here, but it requires more nodes and is not practical at this scale. It would be slow and problematic. No advantages that I can think of.
-
Gluster on 2 nodes won't be slow or problematic (which problems?) just a bit complicated without a turnkey deployment method (ie XOSAN).
-
@emad-r said in Xenserver and Storage:
Hmm I see alot of Vsan advice which is the correct way to go, but I also wonder cant he do a simple thing like GlusterFS VM ? as well ? will that work in this case, and be simpler route ?
No simpler if not understood or with a turnkey "layer" on top.
Gluster is not that complicated, but still, you need to grasp some concepts. It's like Xen vs XenServer in short. Second is turnkey and you don't need to get all stuff needed vs learning Xen "alone" on your distro.
-
@olivier official gluster docs say a 2 node config will go readonly if 1 node dies... You need at least an arbiter node afaik
