OS/Filesystem for file server ~ 8Tb
-
@matteo-nunziati said in OS/Filesystem for file server ~ 8Tb:
@Doyler3000 xfs+lvm or zfs. In any case consider an hba and passthru disks/hba to the vm making soft raid if you can manage it.
Definitely don't do that. Passthrough to a VM is terrible. Very complex and it bypasses loads of the critical abstraction.
-
It would also keep ESXi from being able to use those disks in any way as an additional problem. ESXi can't use software RAID in any form. So no way to even share them.
-
@scottalanmiller I was thinking about a dedicated array not something used by esxi.
Does passthru cause all these issues? I've used it some time ago and it was really nice. Anyway it was not esxi -
@matteo-nunziati said in OS/Filesystem for file server ~ 8Tb:
@scottalanmiller I was thinking about a dedicated array not something used by esxi.
Does passthru cause all this issues? I've used it some time ago and it was relly nice. Anyway it was not esxiPassthrough will do things like break backups and snapshotting, for example. It makes the system have two different consistency layers. Requires lots of complexity on the hardware side where you have to know which drives and physically handled in what way.
And then your RAID has to be handled in the VM rather than in the hardware, which isn't horrific, but it isn't great. That's stuff you want at super low latency that putting into a VM means there is more overhead. And things like restores, failovers... become very hard and complex itself of simply restoring from backup.
-
@scottalanmiller Sorry, my choice of terminology didn't make things very clear there. By replicating I mean replicating the functionality rather than the snapshots themselves. At the moment if I developer deletes a file by mistake they can go to the .zfs folder in the root of their home and restore the file from one of the daily snapshots. I think if they were no longer able to do the equivalent of this, that I might get some resistance.
-
@scottalanmiller said in OS/Filesystem for file server ~ 8Tb:
@Doyler3000 said in OS/Filesystem for file server ~ 8Tb:
We're almost entirely a linux operation here though we have a few windows clients.
Just have to mention that this fact makes ESXi a weird choice as you need a range of skills instead of being able to focus on the ones that you have. If you have Linux skills, you are ready for KVM or Xen
In my (shaky) defence I had stronger VMWare skills than Linux skills at the time
-
Thanks all, I very much appreciate lots of great advice.
I've already got a XenServer installed and I'm going to take a look at Xen Orchestra now. As regards OS/Filesystems OpenSuse (or Centos) with XFS and LVM will get some testing in the near future. -
@Doyler3000 said in OS/Filesystem for file server ~ 8Tb:
Thanks all, I very much appreciate lots of great advice.
I've already got a XenServer installed and I'm going to take a look at Xen Orchestra now. As regards OS/Filesystems OpenSuse (or Centos) with XFS and LVM will get some testing in the near future.I'm not sure if LVM will be as convenient for the end users or not. If not, ZFS might make sense still. ZFS on openSuse would likely be a good place to start.... but ZFS on Ubuntu is the most mature at this point.
-
I've not used LVM snapshotting before so it'll be good to experiment with it and understand it's advantages and limitations. It may not keep the end users (almost all developers) happy so I might need to revisit.
If ZFS is a requirement do you think ZFS on Ubuntu rather than ZFS on FreeBSD say?
I'd need to get a lot more familiar with FreeBSD which is the disadvantage but maybe it's worthwhile? -
@Doyler3000 said in OS/Filesystem for file server ~ 8Tb:
I've not used LVM snapshotting before so it'll be good to experiment with it and understand it's advantages and limitations. It may not keep the end users (almost all developers) happy so I might need to revisit.
If ZFS is a requirement do you think ZFS on Ubuntu rather than ZFS on FreeBSD say?
I'd need to get a lot more familiar with FreeBSD which is the disadvantage but maybe it's worthwhile?ZFS on Ubuntu is fine. Especially for a VM. No need for FreeBSD in this case.
