What do you use for petabyte storage?
-
@hobbit666 said in What do you use for petabyte storage?:
I'm pretty sure "online" was mentioned in the original question.
@JaredBusch ask "why the need for 3yr online"It was not. I wondered why Jared mentioned that.
-
Who is going to be tasked with changing the tapes if using a single drive? Is that something they are going to keep up with in house??
-
@scottalanmiller said in What do you use for petabyte storage?:
@hobbit666 said in What do you use for petabyte storage?:
I'm pretty sure "online" was mentioned in the original question.
@JaredBusch ask "why the need for 3yr online"It was not. I wondered why Jared mentioned that.
I didn't say it - but I assume live data because the OP specifically posted about a live data solution. Though I think you mentioning tape was likely the best option.
-
@Dashrender said in What do you use for petabyte storage?:
@scottalanmiller said in What do you use for petabyte storage?:
@hobbit666 said in What do you use for petabyte storage?:
I'm pretty sure "online" was mentioned in the original question.
@JaredBusch ask "why the need for 3yr online"It was not. I wondered why Jared mentioned that.
I didn't say it - but I assume live data because the OP specifically posted about a live data solution. Though I think you mentioning tape was likely the best option.
I think, but I'm just guessing, that that was just a solution that he looked at. Most people don't even consider archival systems for something like this.
-
@biggen said in What do you use for petabyte storage?:
Who is going to be tasked with changing the tapes if using a single drive? Is that something they are going to keep up with in house??
Would be weird to farm that out. It's normally like a once a week task if you don't want a robot. It only takes a second. Not a hard thing to do at all, changing a tape once a week. if the company can't organize that simple task, they aren't going to be around for three years to worry about it.
-
@scottalanmiller Yeah I just wonder if this is only surveillance related, do they even have an IT dept that can do it?
That autoloader that was linked above is only double the price of a single deck. Unreal how much decks cost.
-
@biggen said in What do you use for petabyte storage?:
Yeah I just wonder if this is only surveillance related, do they even have an IT dept that can do it?
No need for one, it's not an IT task in any way, it's purely a maintenance task. Literally anyone from a janitor on up (not implying janitors aren't valuable, they are just the typical bottom of the org chart) can do it. Any secretary, receptionist, janitor, electrician, maintenance person, manager, techie, intern, etc.
-
@biggen said in What do you use for petabyte storage?:
That autoloader that was linked above is only double the price of a single deck. Unreal how much decks cost.
Still, I'd struggle to spend $3K more to avoid something so trivial. But on the other hand, only $3K.
-
Having a zoom chat scheduled with Dell regarding to Isilon.
I know, it's meant for high criticality, high performance, always online workloads at crazy high cost. It ain't my choice. -
@Harry-Lui said in What do you use for petabyte storage?:
Having a zoom chat scheduled with Dell regarding to Isilon.
I can make this quick: They will recommend it.
-
@scottalanmiller said in What do you use for petabyte storage?:
@Harry-Lui said in What do you use for petabyte storage?:
Having a zoom chat scheduled with Dell regarding to Isilon.
I can make this quick: They will recommend it.
I hope they do. And I hope they quote me in the billion so I don't have to be involve with this project.
-
@Harry-Lui said in What do you use for petabyte storage?:
I know, it's meant for high criticality, high performance, always online workloads at crazy high cost. It ain't my choice.
Then just buy it and don't worry. If you are the buyer, not the IT person in this situation, and the IT decision maker has already decided, just buy it. Whether or not it is good for the use case or the business doesn't matter one iota.
-
It's not like it isn't a fun gadget to play with. Enjoy that it isn't your money, and no responsibility of yours.
-
An Isilon for surveillance cold storage?! I need to work for a company like this that wastes cash like its toilet paper.
-
@biggen said in What do you use for petabyte storage?:
An Isilon for surveillance cold storage?! I need to work for a company like this that wastes cash like its toilet paper.
Right? lol
In reality, it's a depressing situation because there's no way to do a "good job" in IT because "money doesn't matter", so our jobs have no context. As much as it sounds like it would be fun, it's not.
-
@scottalanmiller said in What do you use for petabyte storage?:
@biggen said in What do you use for petabyte storage?:
An Isilon for surveillance cold storage?! I need to work for a company like this that wastes cash like its toilet paper.
Right? lol
In reality, it's a depressing situation because there's no way to do a "good job" in IT because "money doesn't matter", so our jobs have no context. As much as it sounds like it would be fun, it's not.
Even worse - they're showing that they likely aren't WILLING to spend money in the right places, that makes IT even worse.
-
I just use the empty space in between Obsolece's ears
-
@DustinB3403 Forget to take your meds again?
-
@Danp I have meds?
-
@Harry-Lui said in What do you use for petabyte storage?:
A company is wanted 3 years of footage of NVR and I calculated they needed about 1.5PB of storage.
I see Dell EMC has a Isilon Scale-Out NAS Storage line that looks nice.
What devices do you use?1.5 PB per 3 year, is 500 TB/year, 1370 GB/day, 57 GB/h which is 16 MB/sec.
Dell EMC has the ML3 tape library which fits 40x12 TB raw data per 3U and can be expanded to hold roughly 3 PB.
I would be inclined to use disk storage for say 30 days (~40TB) and then archive to tape.
I think a tape library is a must. Just keeping track of the tapes manually is too much of a hassle. The tape library also identifies the tapes by their unique bar codes when you insert them. The tapes sits in a magazine so if you have a few spare magazines you can remove them and put them in storage if you want to archive them longer.
With the data rate above you will fill up one magazine (20 tapes) on a single ML3 in half a year.
https://www.dell.com/en-us/work/shop/dell-emc-data-storage-and-backup/dell-emc-ml3-ml3e/spd/ml3-tape-library/