ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Proposed server purchase for GitLab.com

    IT Discussion
    gitlab supermicro
    8
    39
    4.7k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • scottalanmillerS
      scottalanmiller
      last edited by

      Performance Issues on the Cloud

      "By choosing to use the cloud, we are by default sharing infrastructure with a lot of other people. The cloud is timesharing, i.e. you share the machine with others on the providers resources. As such, the provider has to ensure that everyone gets a fair slice of the time share. To do this, providers place performance limits and thresholds on the services they provide."

      Basically they heard some buzzwords and made the typical knee jerk "we don't listen to IT and we know best" management decisions. They didn't understand what cloud computing was and are having an emotional reaction. This is the problem with people thinking that software engineers are IT, very different skill sets.

      1 Reply Last reply Reply Quote 2
      • stacksofplatesS
        stacksofplates
        last edited by

        I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

        travisdh1T scottalanmillerS 2 Replies Last reply Reply Quote 1
        • travisdh1T
          travisdh1 @stacksofplates
          last edited by

          @stacksofplates said in Proposed server purchase for GitLab.com:

          I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

          Yeah, and with that much cpu/ram for only 3 drives per node? Using blade servers, but sound like they think it's not blade servers in the document. Not doing math in my head well at the moment, is it possible a single blade chassis going down could take the entire cluster down?

          scottalanmillerS 1 Reply Last reply Reply Quote 0
          • scottalanmillerS
            scottalanmiller @stacksofplates
            last edited by

            @stacksofplates said in Proposed server purchase for GitLab.com:

            I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

            Good point as well.

            1 Reply Last reply Reply Quote 0
            • scottalanmillerS
              scottalanmiller @travisdh1
              last edited by

              @travisdh1 said in Proposed server purchase for GitLab.com:

              @stacksofplates said in Proposed server purchase for GitLab.com:

              I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

              Yeah, and with that much cpu/ram for only 3 drives per node? Using blade servers, but sound like they think it's not blade servers in the document. Not doing math in my head well at the moment, is it possible a single blade chassis going down could take the entire cluster down?

              Could yeah, depending on a lot of things, but losing 8-16 nodes at a single go can easily kill a cluster.

              travisdh1T 1 Reply Last reply Reply Quote 1
              • travisdh1T
                travisdh1 @scottalanmiller
                last edited by

                @scottalanmiller said in Proposed server purchase for GitLab.com:

                @travisdh1 said in Proposed server purchase for GitLab.com:

                @stacksofplates said in Proposed server purchase for GitLab.com:

                I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

                Yeah, and with that much cpu/ram for only 3 drives per node? Using blade servers, but sound like they think it's not blade servers in the document. Not doing math in my head well at the moment, is it possible a single blade chassis going down could take the entire cluster down?

                Could yeah, depending on a lot of things, but losing 8-16 nodes at a single go can easily kill a cluster.

                Well, at least these are only 2U, 4 node boxes, but still, yuck.

                scottalanmillerS 1 Reply Last reply Reply Quote 0
                • scottalanmillerS
                  scottalanmiller @travisdh1
                  last edited by

                  @travisdh1 said in Proposed server purchase for GitLab.com:

                  @scottalanmiller said in Proposed server purchase for GitLab.com:

                  @travisdh1 said in Proposed server purchase for GitLab.com:

                  @stacksofplates said in Proposed server purchase for GitLab.com:

                  I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

                  Yeah, and with that much cpu/ram for only 3 drives per node? Using blade servers, but sound like they think it's not blade servers in the document. Not doing math in my head well at the moment, is it possible a single blade chassis going down could take the entire cluster down?

                  Could yeah, depending on a lot of things, but losing 8-16 nodes at a single go can easily kill a cluster.

                  Well, at least these are only 2U, 4 node boxes, but still, yuck.

                  Like Dell FX?

                  travisdh1T 1 Reply Last reply Reply Quote 0
                  • scottalanmillerS
                    scottalanmiller
                    last edited by

                    GitLab is sounding like a very silly endeavor, indeed.

                    stacksofplatesS 1 Reply Last reply Reply Quote 0
                    • stacksofplatesS
                      stacksofplates @scottalanmiller
                      last edited by

                      @scottalanmiller said in Proposed server purchase for GitLab.com:

                      GitLab is sounding like a very silly endeavor, indeed.

                      Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                      scottalanmillerS 2 Replies Last reply Reply Quote 0
                      • scottalanmillerS
                        scottalanmiller @stacksofplates
                        last edited by

                        @stacksofplates said in Proposed server purchase for GitLab.com:

                        @scottalanmiller said in Proposed server purchase for GitLab.com:

                        GitLab is sounding like a very silly endeavor, indeed.

                        Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                        You can be the best software engineer and know nothing about IT.

                        travisdh1T 1 Reply Last reply Reply Quote 2
                        • travisdh1T
                          travisdh1 @scottalanmiller
                          last edited by

                          @scottalanmiller said in Proposed server purchase for GitLab.com:

                          @travisdh1 said in Proposed server purchase for GitLab.com:

                          @scottalanmiller said in Proposed server purchase for GitLab.com:

                          @travisdh1 said in Proposed server purchase for GitLab.com:

                          @stacksofplates said in Proposed server purchase for GitLab.com:

                          I also don't get why the jump from 96 TB to over 400. The whole point of distributed file systems is linear growth. If you don't have that much data right now, why are you paying for that much?

                          Yeah, and with that much cpu/ram for only 3 drives per node? Using blade servers, but sound like they think it's not blade servers in the document. Not doing math in my head well at the moment, is it possible a single blade chassis going down could take the entire cluster down?

                          Could yeah, depending on a lot of things, but losing 8-16 nodes at a single go can easily kill a cluster.

                          Well, at least these are only 2U, 4 node boxes, but still, yuck.

                          Like Dell FX?

                          Not quite, they're using Supermicro. The only shared piece in the chassis is the power supply. 3 3.5" drive bays per node. They're also talking about having a DOM for the OS and PCIE storage card in each. I'm not familiar with the Dell FX line, so it could be the same sort of thing.

                          1 Reply Last reply Reply Quote 0
                          • travisdh1T
                            travisdh1 @scottalanmiller
                            last edited by

                            @scottalanmiller said in Proposed server purchase for GitLab.com:

                            @stacksofplates said in Proposed server purchase for GitLab.com:

                            @scottalanmiller said in Proposed server purchase for GitLab.com:

                            GitLab is sounding like a very silly endeavor, indeed.

                            Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                            You can be the best software engineer and know nothing about IT.

                            Github seems insistent on proving this for you in grand scale and fashion.

                            scottalanmillerS 1 Reply Last reply Reply Quote 1
                            • mlnewsM
                              mlnews @Ambarishrh
                              last edited by

                              @Ambarishrh said in Proposed server purchase for GitLab.com:

                              Gitlab leaving cloud and getting their own servers.
                              https://about.gitlab.com/2016/12/11/proposed-server-purchase-for-gitlab-com/

                              And... disaster: https://www.theregister.co.uk/2017/02/01/gitlab_data_loss/

                              dafyreD 1 Reply Last reply Reply Quote 3
                              • dafyreD
                                dafyre @mlnews
                                last edited by

                                @mlnews said in Proposed server purchase for GitLab.com:

                                @Ambarishrh said in Proposed server purchase for GitLab.com:

                                Gitlab leaving cloud and getting their own servers.
                                https://about.gitlab.com/2016/12/11/proposed-server-purchase-for-gitlab-com/

                                And... disaster: https://www.theregister.co.uk/2017/02/01/gitlab_data_loss/

                                This one was operator error combined with untested backups...

                                scottalanmillerS 1 Reply Last reply Reply Quote 0
                                • scottalanmillerS
                                  scottalanmiller @dafyre
                                  last edited by

                                  @dafyre said in Proposed server purchase for GitLab.com:

                                  @mlnews said in Proposed server purchase for GitLab.com:

                                  @Ambarishrh said in Proposed server purchase for GitLab.com:

                                  Gitlab leaving cloud and getting their own servers.
                                  https://about.gitlab.com/2016/12/11/proposed-server-purchase-for-gitlab-com/

                                  And... disaster: https://www.theregister.co.uk/2017/02/01/gitlab_data_loss/

                                  This one was operator error combined with untested backups...

                                  Yup, pretty much exactly what you would expect from a company with the kind of hubris that they showed when they went physical claiming that their people were better than those at the cloud hosts.

                                  1 Reply Last reply Reply Quote 0
                                  • scottalanmillerS
                                    scottalanmiller @travisdh1
                                    last edited by

                                    @travisdh1 said in Proposed server purchase for GitLab.com:

                                    @scottalanmiller said in Proposed server purchase for GitLab.com:

                                    @stacksofplates said in Proposed server purchase for GitLab.com:

                                    @scottalanmiller said in Proposed server purchase for GitLab.com:

                                    GitLab is sounding like a very silly endeavor, indeed.

                                    Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                                    You can be the best software engineer and know nothing about IT.

                                    Github seems insistent on proving this for you in grand scale and fashion.

                                    And... proven 🙂

                                    1 Reply Last reply Reply Quote 1
                                    • scottalanmillerS
                                      scottalanmiller @stacksofplates
                                      last edited by

                                      @stacksofplates said in Proposed server purchase for GitLab.com:

                                      @scottalanmiller said in Proposed server purchase for GitLab.com:

                                      GitLab is sounding like a very silly endeavor, indeed.

                                      Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                                      LOL, you called that one!

                                      dafyreD stacksofplatesS 2 Replies Last reply Reply Quote 1
                                      • dafyreD
                                        dafyre @scottalanmiller
                                        last edited by

                                        @scottalanmiller said in Proposed server purchase for GitLab.com:

                                        @stacksofplates said in Proposed server purchase for GitLab.com:

                                        @scottalanmiller said in Proposed server purchase for GitLab.com:

                                        GitLab is sounding like a very silly endeavor, indeed.

                                        Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                                        LOL, you called that one!

                                        From what I have been able to gather, it was issues and bug tracking stuff.

                                        scottalanmillerS 1 Reply Last reply Reply Quote 0
                                        • scottalanmillerS
                                          scottalanmiller @dafyre
                                          last edited by

                                          @dafyre said in Proposed server purchase for GitLab.com:

                                          @scottalanmiller said in Proposed server purchase for GitLab.com:

                                          @stacksofplates said in Proposed server purchase for GitLab.com:

                                          @scottalanmiller said in Proposed server purchase for GitLab.com:

                                          GitLab is sounding like a very silly endeavor, indeed.

                                          Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                                          LOL, you called that one!

                                          From what I have been able to gather, it was issues and bug tracking stuff.

                                          Thankfully the GIT protocol keeps distributed copies. So chances are, most people have retained the most important data no matter what happens to GitLab.

                                          dafyreD 1 Reply Last reply Reply Quote 2
                                          • dafyreD
                                            dafyre @scottalanmiller
                                            last edited by

                                            @scottalanmiller said in Proposed server purchase for GitLab.com:

                                            @dafyre said in Proposed server purchase for GitLab.com:

                                            @scottalanmiller said in Proposed server purchase for GitLab.com:

                                            @stacksofplates said in Proposed server purchase for GitLab.com:

                                            @scottalanmiller said in Proposed server purchase for GitLab.com:

                                            GitLab is sounding like a very silly endeavor, indeed.

                                            Ya it sucks because I use their stuff. Hopefully they don't lose everything.

                                            LOL, you called that one!

                                            From what I have been able to gather, it was issues and bug tracking stuff.

                                            Thankfully the GIT protocol keeps distributed copies. So chances are, most people have retained the most important data no matter what happens to GitLab.

                                            No Git Repos were affected, only the bug tracking and issues was the last thing I heard.

                                            Did they lose the repos too?

                                            scottalanmillerS 1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 1 / 2
                                            • First post
                                              Last post