NFS Server...what to build??
-
OBR5 made out of SSD would be perfectly fine, and expected. Splitting the arrays isn't a good idea.
But also don't use consumer SSD and make sure you have some backup plan developed.
-
@fateknollogee said in NFS Server...what to build??:
@obsolesce said in NFS Server...what to build??:
@fateknollogee said in NFS Server...what to build??:
So you want to build an NFS Server to "share" files with other clients.
What o/s would you base this build on...?
Install o/s on bare metal or virtualize?HW is simple:
- 2x SSD for o/s
- 4 - xx SSD for NFS shares
I set one up on Fedora Server to act as a storage repository for ReaR backups. I did it on a VM.
Where is that blog post or it didn't happen? ..jk
I thought I did... Or didn't publish it. I'll check later. I lost track
-
@dustinb3403 said in NFS Server...what to build??:
I like fedora, but I don't know if cutting edge tech is a requirement here. All he needs is a file server, centos would work well here.
While Fedora is a great platform, being on the edge could encounter issues if he updated with a buggy release.
I assume using Fedora instead CentOS would be best if you were wanted to take advantage of NFS v4.
If only using NFS v3, I would probably use CentOS. -
@travisdh1 said in NFS Server...what to build??:
@fateknollogee said in NFS Server...what to build??:
@travisdh1 said in NFS Server...what to build??:
Well, first of all I wouldn't do a split array. OBR (One Big RAID), unless you have a very specific reason to do otherwise.
Easy to do with my SM box, since it has 2x 2.5" sleds on the backside running off the onboard SATA.
Just because it's easy to do, doesn't mean you should. Why not just get two more drives for the main array and not loose all that I/O by splitting things up? It's a serious loss of I/O as well when talking about an additional couple of SSDs!
No, there is no (zero) loss of i/o.
The 2 x 2.5" are connected to the onboard RAID.
The 24 x 2.5" are connected to the LSI raid. -
@fateknollogee You must have typoed your OP because it says 2 and 4 drives, not 24. At 6 drives total, it's a big difference than 26 total
-
@bnrstnr said in NFS Server...what to build??:
@fateknollogee You must have typoed your OP because it says 2 and 4 drives, not 24. At 6 drives total, it's a big difference than 26 total
I typed "4 - xx SSD for NFS shares" - meaning a minimum of 4 to xx (max 24)
-
@fateknollogee ah, I definitely didn't get that lol but it makes sense now that you say it. I probably would have just said 4-24 since we had no way of knowing the max was 24
-
You have a server in a chassi (SC846) just like the pic right? And with the two 2.5" drive bays option in the back next to the PSUs?
When you say sharing files with clients, over what medium? 10Gbe local LAN?
How are the backplane connected to the LSI controller? Is the LSI on the motherboard or PCIe card?The reason I'm asking is to know what speeds we are talking about.
-
@fateknollogee said in NFS Server...what to build??:
So you want to build an NFS Server to "share" files with other clients.
What o/s would you base this build on...?
Install o/s on bare metal or virtualize?Unless there is a reason not to, Fedora. Unless you can prove what you need to do is impossible with virtual, always virtual.
So by those rules (first one is personal, second one is industry best practice), it would be virtualized Fedora.
-
@fateknollogee said in NFS Server...what to build??:
HW is simple:
- 2x SSD for o/s
- 4 - xx SSD for NFS shares
Why would you have drives for the OS? This both breaks standard storage practices AND assumes a physical install which is a 'no no'.
-
@fateknollogee said in NFS Server...what to build??:
@travisdh1 said in NFS Server...what to build??:
Well, first of all I wouldn't do a split array. OBR (One Big RAID), unless you have a very specific reason to do otherwise.
Easy to do with my SM box, since it has 2x 2.5" sleds on the backside running off the onboard SATA.
Even if someone did it for you, it's still bad.
-
@fateknollogee said in NFS Server...what to build??:
@travisdh1 said in NFS Server...what to build??:
@fateknollogee said in NFS Server...what to build??:
@travisdh1 said in NFS Server...what to build??:
Well, first of all I wouldn't do a split array. OBR (One Big RAID), unless you have a very specific reason to do otherwise.
Easy to do with my SM box, since it has 2x 2.5" sleds on the backside running off the onboard SATA.
Just because it's easy to do, doesn't mean you should. Why not just get two more drives for the main array and not loose all that I/O by splitting things up? It's a serious loss of I/O as well when talking about an additional couple of SSDs!
No, there is no (zero) loss of i/o.
The 2 x 2.5" are connected to the onboard RAID.
The 24 x 2.5" are connected to the LSI raid.But there is money thrown away. Tell us "why it isn't SO bad" is in no way the same as tell us "why it is good."
-
@pete-s said in NFS Server...what to build??:
You have a server in a chassi (SC846) just like the pic right? And with the two 2.5" drive bays option in the back next to the PSUs?
When you say sharing files with clients, over what medium? 10Gbe local LAN?
How are the backplane connected to the LSI controller? Is the LSI on the motherboard or PCIe card?The reason I'm asking is to know what speeds we are talking about.
216BE1C-R920LPB
Clients are VM's, sharing could be 10Gbe or 56Gbe
LSI is a PCIe card -
@scottalanmiller said in NFS Server...what to build??:
@fateknollogee said in NFS Server...what to build??:
HW is simple:
- 2x SSD for o/s
- 4 - xx SSD for NFS shares
Why would you have drives for the OS? This both breaks standard storage practices AND assumes a physical install which is a 'no no'.
Why would you assume a physical install ?
I'm installing the hypervisor (in this case FC28) on a Raid1 array of 2x SSDs -
@scottalanmiller said in NFS Server...what to build??:
@fateknollogee said in NFS Server...what to build??:
@travisdh1 said in NFS Server...what to build??:
Well, first of all I wouldn't do a split array. OBR (One Big RAID), unless you have a very specific reason to do otherwise.
Easy to do with my SM box, since it has 2x 2.5" sleds on the backside running off the onboard SATA.
Even if someone did it for you, it's still bad.
No it's not, some folks prefer the one big array, I prefer to keep it separate.
-
Are you considering something like this for your partition scheme?
2x SSD for o/s:
- /boot
- /
- swap partition or swapfile
4 - xx SSD for NFS shares:
- /var/lib/libvirt/images
-
@black3dynamite said in NFS Server...what to build??:
Are you considering something like this for your partition scheme?
2x SSD for o/s:
- /boot
- /
- swap partition or swapfile
4 - xx SSD for NFS shares:
- /var/lib/libvirt/images
Slightly different...UEFI install
2x SSD for o/s:- /
- /boot
- /boot/efi
- swap
4 - xx SSD for NFS shares:
- /data
-
@fateknollogee said in NFS Server...what to build??:
So you want to build an NFS Server to "share" files with other clients.
What o/s would you base this build on...?
Install o/s on bare metal or virtualize?HW is simple:
- 2x SSD for o/s
- 4 - xx SSD for NFS shares
With the high reliability of SSD nowadays, especially certain models why dont you make 1 SSD for OS and make it NVMe drive, and that will leave you SATA ports free, and keep the other as cold spare.
And make the OS well defined and as a state, so even if an issue happens you can run command to rebuild it easily, cause all the data will be on the Shares, and yes the new OS will detect all the RAID volumes automatically.
That said good NVme SSD will last 5-10 years
-
@Emad-R No good reason to pay the premium for nVMe drives just for installing the o/s.
I use Intel S35xx/S36xx - 120GB.
Plenty available on ebay at $50 each! -
@fateknollogee said in NFS Server...what to build??:
@scottalanmiller said in NFS Server...what to build??:
@fateknollogee said in NFS Server...what to build??:
HW is simple:
- 2x SSD for o/s
- 4 - xx SSD for NFS shares
Why would you have drives for the OS? This both breaks standard storage practices AND assumes a physical install which is a 'no no'.
Why would you assume a physical install ?
I'm installing the hypervisor (in this case FC28) on a Raid1 array of 2x SSDsBecause you stated a dedicated array for the OS, not for the hypervisor. I'm only going by what you wrote. If you wanted dedicated for the OS, you'd need it whether you had a hypervisor or not.
