Raid 6 Amateur File Server Setup Questions
-
@wirestyle22 said in Raid 6 Amateur File Server Setup Questions:
@dafyre said in Raid 6 Amateur File Server Setup Questions:
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
I was thinking to eventually add Plex somewhere down the line. Right now both my media pc and work pc are much more powerful than the server.
The server is based on the AM1 platform, I just switched out the terrible 2650 (2x1.45) for a slighlty better 5150 (4x1.60). Should be ok for x264, yet I don't know about x265 and whatever may come.
Building my Kodi library has taken a while do, I'd assume the same process would wait for me with Plex (with foreign language movies not being scrubbed correctly from databases, etc...)Plex should be able to read the media in your Kodi library if it is stored as standard MP4 / AVI files, etc. You shouldn't have to re-rip your entire library just to switch from one to the other.
Not to mention that MKV's (as you mentioned they will be) are natively supported by Roku meaning no transcoding. That dramatically reduces the hardware requirements of your server.
MKV is just a container, it's what's inside of it that may need transcoding.
-
@Dashrender said in Raid 6 Amateur File Server Setup Questions:
@wirestyle22 said in Raid 6 Amateur File Server Setup Questions:
@scottalanmiller said in Raid 6 Amateur File Server Setup Questions:
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
It was an amazon glitch I think. It was only 250€ instead of the 700€ average price in other shops. Went up straight after I bought it. I could actually still return it and go all the other way to upgrade the rest of the hardware for software raid. But I kind of settled for this route already.
Not saying that you should return it, but why would hardware need to be upgraded for software RAID? Unless you are running an overburden Atom processor or are trying to run in only 1GB or less of RAM, I don't see software RAID being hardware hampered.
Blind swap is definitely a thing but does the benefit outweigh the cost for a home server? I don't think so but I'd love to hear your opinions.
In his case he already spent the money. If nothing was spent already - then sure avoid it, save the cash.
I would actually return it. It's still wasted imo. Buy slightly better hardware or an extra hard drive. Take the wife out to a nice dinner. Something.
-
@marcinozga said in Raid 6 Amateur File Server Setup Questions:
@wirestyle22 said in Raid 6 Amateur File Server Setup Questions:
@dafyre said in Raid 6 Amateur File Server Setup Questions:
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
I was thinking to eventually add Plex somewhere down the line. Right now both my media pc and work pc are much more powerful than the server.
The server is based on the AM1 platform, I just switched out the terrible 2650 (2x1.45) for a slighlty better 5150 (4x1.60). Should be ok for x264, yet I don't know about x265 and whatever may come.
Building my Kodi library has taken a while do, I'd assume the same process would wait for me with Plex (with foreign language movies not being scrubbed correctly from databases, etc...)Plex should be able to read the media in your Kodi library if it is stored as standard MP4 / AVI files, etc. You shouldn't have to re-rip your entire library just to switch from one to the other.
Not to mention that MKV's (as you mentioned they will be) are natively supported by Roku meaning no transcoding. That dramatically reduces the hardware requirements of your server.
MKV is just a container, it's what's inside of it that may need transcoding.
Yes but he mentioned MP4 and MKV. Both Native. Both capable of direct play provided the encoding is correct.
-
If I understand correctly, you're looking to set up a "NAS" basically, right? If that's the case, I would recommend looking into something like FreeNAS/NAS4Free/OpenFiler. These are *NIX distributions geared towards the system being a file server. There are other features built in that you may or may not benefit from, but it may be worth it over running Win10 on the box.
I've had very good success with software RAID under linux. mdadm has served me well. I've done RAID 1, RAID 5*, and RAID 10 and all performed nicely.
*Avoid RAID 5 like the plauge. I had an older PPC G5 Xserve running Debian set up in my garage not doing anything important. Those things could only hold three 3.5 inch drives. If I was able to put a 4th drive in I would've totally gone RAID 10.
-
@anthonyh said in Raid 6 Amateur File Server Setup Questions:
If I understand correctly, you're looking to set up a "NAS" basically, right? If that's the case, I would recommend looking into something like FreeNAS/NAS4Free/OpenFiler. These are Linux distributions geared towards the system being a file server. There are other features built in that you may or may not benefit from, but it may be worth it over running Win10 on the box.
I've had very good success with software RAID under linux. mdadm has served me well. I've done RAID 1, RAID 5*, and RAID 10 and all performed nicely.
*Avoid RAID 5 like the plauge. I had an older PPC G5 Xserve running Debian set up in my garage not doing anything important. Those things could only hold three 3.5 inch drives. If I was able to put a 4th drive in I would've totally gone RAID 10.
FreeNAS and NAS4Free and BSD based. OpenFiler is Linux based, however, it's abandoned project. It hasn't been maintained for years. And even then, it wasn't any good.
-
@marcinozga said in Raid 6 Amateur File Server Setup Questions:
@anthonyh said in Raid 6 Amateur File Server Setup Questions:
If I understand correctly, you're looking to set up a "NAS" basically, right? If that's the case, I would recommend looking into something like FreeNAS/NAS4Free/OpenFiler. These are Linux distributions geared towards the system being a file server. There are other features built in that you may or may not benefit from, but it may be worth it over running Win10 on the box.
I've had very good success with software RAID under linux. mdadm has served me well. I've done RAID 1, RAID 5*, and RAID 10 and all performed nicely.
*Avoid RAID 5 like the plauge. I had an older PPC G5 Xserve running Debian set up in my garage not doing anything important. Those things could only hold three 3.5 inch drives. If I was able to put a 4th drive in I would've totally gone RAID 10.
FreeNAS and NAS4Free and BSD based. OpenFiler is Linux based, however, it's abandoned project. It hasn't been maintained for years. And even then, it wasn't any good.
My bad. You're right. My brain erroneously clumps BSD/Linux/UNIX together from time to time.
-
@scottalanmiller has an article about FreeNAS. It's a good read. http://www.smbitjournal.com/2015/07/the-jurassic-park-effect/
-
@coliver said in Raid 6 Amateur File Server Setup Questions:
@scottalanmiller has an article about FreeNAS. It's a good read. http://www.smbitjournal.com/2015/07/the-jurassic-park-effect/
Where's my popcorn? I need it for when Scott comes back and reads that other post.
-
@Dashrender No kidding! lol
-
@scottalanmiller said in Raid 6 Amateur File Server Setup Questions:
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
I do not insinst on Windows if there is a good reason for not using it, at all. I know it's not the best OS by far, although for my normal usage it kind of is (Office Suite, few decoding tools, some Games); but that's not on the server, of course. I wouldn't have bought a licence though.
So the thing with Windows is, beyond it being really expensive, is that its software RAID is kinda craptastic. Software RAID on its own is great, as a concept. And there are great implementations of it like MD RAID (from Linux) and ZFS (from Solaris and FreeBSD.) For home use, whatever, Windows is just fine. But it's also not free. Using Linux with MD or FreeBSD with ZFS would give you a really good software RAID option that Windows does not.
Linux or FreeBSD are also generally considered much better for use as a media server.
There goes my post, but at least I didn't post nearly the same and embarrass myself. I'm can't be bothered to read other people's posts when I get keyed up about answering something.
-
@wirestyle22 said in Raid 6 Amateur File Server Setup Questions:
@scottalanmiller said in Raid 6 Amateur File Server Setup Questions:
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
It was an amazon glitch I think. It was only 250€ instead of the 700€ average price in other shops. Went up straight after I bought it. I could actually still return it and go all the other way to upgrade the rest of the hardware for software raid. But I kind of settled for this route already.
Not saying that you should return it, but why would hardware need to be upgraded for software RAID? Unless you are running an overburden Atom processor or are trying to run in only 1GB or less of RAM, I don't see software RAID being hardware hampered.
Blind swap is definitely a thing but does the benefit outweigh the cost for a home server? I don't think so but I'd love to hear your opinions.
Probably not for home, I was just saying that hardware RAID comes with some important benefits most of the time.
-
@anthonyh said in Raid 6 Amateur File Server Setup Questions:
If I understand correctly, you're looking to set up a "NAS" basically, right? If that's the case, I would recommend looking into something like FreeNAS/NAS4Free/OpenFiler. These are *NIX distributions geared towards the system being a file server. There are other features built in that you may or may not benefit from, but it may be worth it over running Win10 on the box.
FreeNAS and NAS4Free I would generally avoid (re: Jurassic Park Effect) as was mentioned. OpenFiler you need to run far, far away from. It's been out of development for many years, it's based on a system that vanished even longer ago, it's unpatched and was unstable and totally useless even when it was "current." They actually designed in data loss to coerce their users into paying for support or "upgrades" to fix the bugs that they included.
https://community.spiceworks.com/topic/373443-why-we-recommend-against-openfiler
-
@scottalanmiller said in Raid 6 Amateur File Server Setup Questions:
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
It was an amazon glitch I think. It was only 250€ instead of the 700€ average price in other shops. Went up straight after I bought it. I could actually still return it and go all the other way to upgrade the rest of the hardware for software raid. But I kind of settled for this route already.
Not saying that you should return it, but why would hardware need to be upgraded for software RAID? Unless you are running an overburden Atom processor or are trying to run in only 1GB or less of RAM, I don't see software RAID being hardware hampered.
Not that bad excactly, but also not too far away. It's a mini-ITX AM1 with I think a total of 16GB RAM supported; I currently have 4 installed (so not really upgrade, as more replaceable).
(Just in case anyone would be interested/has the similiar requirement of running a server in a flat, rather than a basement; the case is a bitfenix phenom which almost excactly fills "one slot" of a standard ikea expedit bookshelf without really being noticeable. The second batch of hdd's would probably be housed in a second, "empty" phenom case)I was actually planning to upgrade to some form of mini-ITX xeon with ddr4 ecc ram so I could get to 32GB RAM and then using FreeNAS on it. Since Sata ports would have been limited, I would have opted for a cheap extender card (although I don't really know whether that would have been a good option).
But then this card came along and the advice wasn't really unilaterally against it, so I thought this was a quicker way, with the added benefit of getting 20 ports while still having the 4 onboard just in case.Now I feel a bit overwhelmed with oh so many options. I probably won't easily see career benefits in the humanities if my knowledge of operating systems is greater than 1 though
Given my few needs, in what ways would Win10 limit this or be in the way somehow? I'm not trying to be ignorant, just curious what are the advantages in my case (where there's no additional cost for windows). Which one would be the easiest to learn for a beginner from the many examples? Would FreeNas even make sense if I decided to keep the raid controller?Is my assertion correct that the real disadvantage of the raid controller is really the raid controller itself? Obviously if they fail, you need replacement. With a company like Adaptec, can one except that they keep older makes in stock even after they have gone off the market? Or would the best bet be to keep a second card ready at home (perhaps a used one)? And it needs to be excactly the same controller, not just the same series/chipset? Do these card fail often?
-
@Dashrender said in Raid 6 Amateur File Server Setup Questions:
How are you accessing these files? Just using Windows SMB file sharing? You specifically mention there is no other software installed in the OS, so I was assuming it must just be SMB file sharing.
With that in mind, Why pay the Windows tax? Why not install Linux? It's free, requires less system resources, etc.
- I'd personally go with XenServer and then a Linux distro in a VM assuming you can make partitions large enough to handle your file needs
2)The RAID controller is a typical server component, they are designed to run 24/7. Cooling will be your biggest issue here, noise being the second, and power draw the third. Other than saving money on power and your hearing, I see no reason to shut it down.
3)There is no reason to split the OS away from the array - you're wasting drive slots/storage/performance by doing so. As mentioned in #1, I'd install XS on a SD card or USB flash drive, then built a VM for the OS. The VM should have it's own partition for the OS, then a separate partition for the data drive.
4)I agree - you should have both. - because your files are larger, a larger stripe size is fine. 4K seems typical today.
- Quick Init is fine.
- yep, just use the default of the OS you're using - performance isn't critical it seems, so no point in trying to do anything fancy.
8)Well, by default Windows 10 goes into power save mode - though I don't know after what period. I also don't believe it will wake from normal traffic requests, so a WOL would be required or a manual wake up (press power button, etc) - Anything you missed? So you're starting with a 4 drive RAID 6 setup, but you plan to add 6-8 more disks down the road. hmmm.. .@scottalanmiller ?
- No I wouldn't try testing the rebuild, undue, worthless stress on the system.
- RTM (read the manual) - sorry I have no idea.
- I would only grow it once, but frankly, not a fan of growing it at all - and a question, can you add 6-8 disks to a pre existing RAID 6 array all at once? ages ago I could add disks to a RAID 5, but only one at a time. So if I was adding 6 disks, that was 6 different rebuild processes - that's a no go in my book. backup your data and rebuild the array and start over.
12a) what is Utilize the savings of RAID6 over a backup Please Please Please understand that RAID 6 is NOT a backup, not even close! If the RAID array had a URE (Unrecoverable Read Error), the whole array is toast and your data with it. RAID 6 does allow you to loose two drives and yet still have a viable system, but again this is not a backup. If you don't want to have to rerip all the movies, etc, you need to have an actual backup solution for this array. -
- is this still an issue? @scottalanmiller
Regarding cooling I was suprised the heatsink was so poor and no instructions provided. I have a 120mm fan at around 600rpm directed at the 2 heatsinks. Aside from watercoling I could only think of a more powerful fan like a noctua industrial or a more ventilated case.
I'm at least trying to be somewhat eco-sensitive, so if its not bad for the controller or the array, I wouldn't mind switching the server off. On the other hand, I have no idea how much such a thing actually consumes. Before installation power consumption was around 35w in idle.
Thanks for the many clarifications! - I'd personally go with XenServer and then a Linux distro in a VM assuming you can make partitions large enough to handle your file needs
-
FreeNAS makes no sense, IMHO, ever. It's nothing but a crippled version of FreeBSD. FreeBSD I would use rarely, but it has its place. But FreeNAS, never, because FreeBSD, at a minimum is always better. So if something that would only rarely be the best choice is always better than your choice, that choice should be eliminated completely.
FreeNAS isn't the worst thing in the world, it simply is never the best choice. So even considering it represents a bad decision making process. Keeping it in the decision pool just serves to trigger emotional mistakes in decision making (read: Predictably Irrational, they explain a lot of why this happens in there.)
For a hobby/home system, the importance of these decisions is obviously very low. You could even run the worst possible option, OpenFiler, and mostly be okay. But why not do the best for free, since the good options are all free? There isn't any upside to the bad options, so just avoid them.
The reason that people talk about FreeNAS and the like is because they are "easy to get up and running." But that's a tricky sales pitch. In fact, the last thing that you care about with storage is how easy it is to set up. What you care about is how easy it is to maintain. FreeNAS makes it easy to get up and running and then screws you if anything goes wrong and because it is unnecessarily complex, there is more to go wrong.
-
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
Do these card fail often?
Enterprise ones almost never fail.
-
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
Is my assertion correct that the real disadvantage of the raid controller is really the raid controller itself? Obviously if they fail, you need replacement.
That's a big factor. Hardware RAID costs money and expects you to be dedicated to maintaining support, just like any proprietary, black box solution.
-
Is that particular make considered an - obviously older - enterprise one?
I think one of the reasons people like me would jump to FreeNAS is that it's so easy and limited, has a nice graphical interface and doesn't require you to open a shell ever.
So other choices would be Solaris, XenServerVM and something? Except for Solaris, I haven't even heard of these before. I would need to learn a lot; I wouldn't know what a VM (Virtual Machine?) would be good for. Are all of these suggestions for both software raid and with the controller, or under the assumption of returning the controller?
-
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
I think one of the reasons people like me would jump to FreeNAS is that it's so easy and limited, has a nice graphical interface and doesn't require you to open a shell ever.
Ah but it does. The problem is is that the GUI is only useful when everything works. When things break, you are still stuck having to use the CLI, expect the CLI for FreeNAS is harder and more complex than without FreeNAS and you don't know what was done to set it up making it harder for you to know what's going on with your own system as well.
So the very reason you think that FreeNAS is potentially viable is the most important reason why I say that it is not. If you have ANY concern about the CLI, FreeNAS should be eliminated as it has the hardest CLI situation for when it matters.
-
@geertcourmacher said in Raid 6 Amateur File Server Setup Questions:
Are all of these suggestions for both software raid and with the controller, or under the assumption of returning the controller?
Universal suggestions. XenServer or Solaris can both use hardware RAID and they both include enterprise software RAID. So they don't sway the decision beyond any other non-Windows offering.
