ML
    • Register
    • Login
    • Search
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups

    Designing for tech startup: Network, AD, Backup etc

    IT Discussion
    server 2012 server 2016 server 2019 nas san cisco dell design planning
    9
    37
    793
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • scottalanmiller
      scottalanmiller @IRJ last edited by

      @IRJ said in Designing for tech startup: Network, AD, Backup etc:

      Can you get some clarity of why they think they need that much storage? How much storage are they currently using?

      The background is that the system design is all politically motivated and not rooted in business or technical needs. We spent some time on that. There's not even a known use case for the storage (it's unclear if it will be object, block/SAN, file/NAS, etc.) The need is to have "petabyte storage" without any other specification.

      1 Reply Last reply Reply Quote 0
      • F
        Francesco Provino last edited by

        Hi @gjacobse , consider something like a tiered approach to the problem. 1Pb are a lot of data.
        Maybe 5-10Tb of fast SSD for caching, 50-100Tb of spinning disks for caching/capacity and the rest will go to the cloud.
        For instance, a single AWS Storage Gateway appliance could be the solution if you have good internet uplink.
        Another solution could be Azure Stack.
        Feel free to contact me if need advices about that kind of setup.

        1 Reply Last reply Reply Quote 0
        • Obsolesce
          Obsolesce last edited by

          If this is something that just has to happen for whatever reason, political, technical, whatever, then the only real way to do it is as Scott mentioned... RAIN. It's the only way to do it that is truly scalable and manageable to sizes like that, even if starting out with much lower storage capacity. You can start with a few nodes of several hundred TBs, and add more nodes to scale as required.

          Maybe look at something like DataOn.

          1 Reply Last reply Reply Quote 0
          • gjacobse
            gjacobse last edited by

            RAIN over RAID

            This is likely the answer. I found this: Drath of RAID and am reading it.

            I don’t see many diagrams on it, or much on it really- maybe I’m not searching the right term(s).

            DustinB3403 scottalanmiller 2 Replies Last reply Reply Quote 0
            • DustinB3403
              DustinB3403 @gjacobse last edited by

              @gjacobse said in Designing for tech startup: Network, AD, Backup etc:

              RAIN over RAID

              This is likely the answer. I found this: Drath of RAID and am reading it.

              I don’t see many diagrams on it, or much on it really- maybe I’m not searching the right term(s).

              Of course there are no diagrams, ML is to discuss, not a hand book on how to setup an exact system. Everything you're being asked to do is going to require RAIN, but the specifics of how it's setup is going to be completely unique to this environment.

              1 Reply Last reply Reply Quote -1
              • DustinB3403
                DustinB3403 last edited by DustinB3403

                Reading the documentation for gluster, there is nothing particularly difficult to understand here. Since RAIN is what you're going to be using, might be worth reading. https://docs.gluster.org/en/latest/Quick-Start-Guide/Quickstart/

                gjacobse 1 Reply Last reply Reply Quote 0
                • gjacobse
                  gjacobse @DustinB3403 last edited by

                  @DustinB3403 said in Designing for tech startup: Network, AD, Backup etc:

                  Reading the documentation for gluster, there is nothing particularly difficult to understand here. Since RAIN is what you're going to be using, might be worth reading. https://docs.gluster.org/en/latest/Quick-Start-Guide/Quickstart/

                  Doesn’t meet the requested OS-
                  They only want Windows.

                  DustinB3403 1 Reply Last reply Reply Quote 0
                  • DustinB3403
                    DustinB3403 @gjacobse last edited by

                    @gjacobse said in Designing for tech startup: Network, AD, Backup etc:

                    @DustinB3403 said in Designing for tech startup: Network, AD, Backup etc:

                    Reading the documentation for gluster, there is nothing particularly difficult to understand here. Since RAIN is what you're going to be using, might be worth reading. https://docs.gluster.org/en/latest/Quick-Start-Guide/Quickstart/

                    Doesn’t meet the requested OS-
                    They only want Windows.

                    Well they clearly don't know what they want and how it works.

                    My assumption is they want a Windows File Server, they shouldn't care how the underlying environment is setup so long as they are presented with the interface to "manage the files" that they are used to.

                    1 Reply Last reply Reply Quote 0
                    • DustinB3403
                      DustinB3403 last edited by

                      I suppose you could use Storage Spaces Direct (all windows across the entire thing) but I wouldn't consider SSD at all mature nor production ready, especially at this scale.

                      gjacobse 1 Reply Last reply Reply Quote 0
                      • gjacobse
                        gjacobse @DustinB3403 last edited by

                        @DustinB3403 said in Designing for tech startup: Network, AD, Backup etc:

                        I suppose you could use Storage Spaces Direct (all windows across the entire thing) but I wouldn't consider SSD at all mature nor production ready, especially at this scale.

                        Thanks, had not heard of this.

                        DustinB3403 Obsolesce 2 Replies Last reply Reply Quote 0
                        • DustinB3403
                          DustinB3403 @gjacobse last edited by

                          @gjacobse said in Designing for tech startup: Network, AD, Backup etc:

                          @DustinB3403 said in Designing for tech startup: Network, AD, Backup etc:

                          I suppose you could use Storage Spaces Direct (all windows across the entire thing) but I wouldn't consider SSD at all mature nor production ready, especially at this scale.

                          Thanks, had not heard of this.

                          You'd not heard of Storage Spaces Direct?

                          1 Reply Last reply Reply Quote 0
                          • scottalanmiller
                            scottalanmiller @gjacobse last edited by

                            @gjacobse said in Designing for tech startup: Network, AD, Backup etc:

                            RAIN over RAID

                            This is likely the answer. I found this: Drath of RAID and am reading it.

                            I don’t see many diagrams on it, or much on it really- maybe I’m not searching the right term(s).

                            RAIN is used pretty much everywhere. But it's not something you normally implement yourself. So you aren't going to find much on it because almost no one works with it.

                            1 Reply Last reply Reply Quote 0
                            • Obsolesce
                              Obsolesce @gjacobse last edited by

                              @gjacobse said in Designing for tech startup: Network, AD, Backup etc:

                              @DustinB3403 said in Designing for tech startup: Network, AD, Backup etc:

                              I suppose you could use Storage Spaces Direct (all windows across the entire thing) but I wouldn't consider SSD at all mature nor production ready, especially at this scale.

                              Thanks, had not heard of this.

                              DataOn solutions fully support this and vice versa. They are experienced with this kind of scale and much larger.

                              1 Reply Last reply Reply Quote 1
                              • First post
                                Last post