Massive Storage Need for Video Project
-
@scottalanmiller does not even have to be huge. It at a minimum would only need to be big enough to handle the uploads.
Once data is uploaded, it could be offloaded elsewhere is that was more economical.
But, an ownCloud system would be my suggestion because you will not have artificial limits set on sizes by a third party.
-
ownCloud might be the answer on a SAM-SD. That way I can easily control the storage pools, use low cost where it makes sense and the only thing that it needs to do is deal with the sync process from ownCloud copying the files.
-
Part of the answer might be that I need a new laptop. I absolutely love my current laptop, an HP Folio 13 running Windows 8.1 Pro. It is fast, small, light and has been an absolute workhorse for me since before we went to Europe in 2012. It will be three years old, though, by the time that we leave for this next trip. Three years is not old and to me it still seems absolutely new and wonderful, but the reality is is that it might be under powered for the tasks that we will be needing it to be doing.
There is some hope that I might be getting a top of the line MacBook Pro and if so, that will be coming with me instead of the Folio 13. That will be a lot more power and, more importantly, a lot more internal drive space but even a terabyte of SSD will only get me so far given the use case here. But it will help.
Also, we will have Dominica's new Lenovo Yoga 2 Pro which will help, but she will be using that mostly so that only helps so much too.
-
A single, external USB drive of ~6TB might be enough to handle the day to day saving and editing. I just hate transporting a spindle drive around.
-
4TB External Drives are already pretty cheap.
http://www.walmart.com/ip/WD-My-Book-4TB-USB-3.0-External-Hard-Drive/29016524
-
Even 5TB is really cheap. Although I'd feel more comfortable with a WD drive than a Toshiba.
http://www.walmart.com/ip/Toshiba-5TB-Canvio-Desktop-External-Hard-Drive/38082759 -
I think that most anyone would. WD has the better name.
-
Really, at those prices, buying two, keeping a backup and shipping a drive back is probably so much cheaper and simpler than any other option. You probably just need to suck it up and do that. The simplest solution is normally the best.
-
Plus the individual external drive approach means that you can invest in storage a little bit at a time rather than a single investment all at once. You can see how your storage usage is going before you spend lots of extra money.
-
That makes good sense. I should probably use a SAM-SD for the large scale storage. That is actually more cost effective than any store-bought NAS unit and more flexible and we are always looking for real world SAM-SD implementations for reference examples. So that gets a double hit for value.
And shipping hard drives is quick and easy and ultimately practical. I can copy files when possible and ship drives when I can't. I can always buy more drives in Europe if I have to, they are just as available there as they are here.
-
@nadnerB said:
I was thinking of a rack mounted server/NAS that you put in a portable rack with wheels/casters.
I have visions of @scottalanmiller wandering around The Coliseum dragging a rack attached to a piece of rope.
What is the project, by the way? It sounds interesting.
-
@Carnival-Boy said:
@nadnerB said:
I was thinking of a rack mounted server/NAS that you put in a portable rack with wheels/casters.
I have visions of @scottalanmiller wandering around The Coliseum dragging a rack attached to a piece of rope.
What is the project, by the way? It sounds interesting.
lol, a bit like this?:
-
This is cool, would love to see a project writeup after all is said and done.
-
@Carnival-Boy said:
What is the project, by the way? It sounds interesting.
It's the video component of this...
-
2x 6TB externals w/ USB3 or eSATA - dump to both (expect 1 to die during all the moving around), up to the cloud when you have the time / bandwidth.
-
This just happened this morning so looking into this. Sadly our current upload speeds are terrible and so will only help so much, but it is a start.
-
There is a three month free trial so I am totally checking it out.
-
First files are uploading now. There does not appear to be a throttle option, though, which sucks. I would really like to have had that.
-
@g.jacobse said:
You really know how to make things difficult don't you!?
Yes, yes he does...LOL
-
@scottalanmiller said:
First files are uploading now. There does not appear to be a throttle option, though, which sucks. I would really like to have had that.
Can you do that on the router level? Throttle all traffic going to AWS? Or do you use Amazon Instant Video and the like?
