ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    KVM Snapshot/Backup Script

    Scheduled Pinned Locked Moved IT Discussion
    kvmsnapshotsqcow2linuxvirtualization
    48 Posts 7 Posters 12.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stacksofplatesS
      stacksofplates @Romo
      last edited by

      @Romo said in KVM Snapshot/Backup Script:

      @stacksofplates said in KVM Snapshot/Backup Script:

      @Romo said in KVM Snapshot/Backup Script:

      @stacksofplates said in KVM Snapshot/Backup Script:

      @Romo said in KVM Snapshot/Backup Script:

      @stacksofplates said in KVM Snapshot/Backup Script:

      @Romo said in KVM Snapshot/Backup Script:

      Are you using external snapshots to thin provision any vms? Is there a performance hit on doing this?

      No. I have a template that uses a qcow2 disk. It's only a 15GB disk, but since it's thin provisioned it's only around 1.5GB. I can clone it in about 1-2 seconds so I haven't bothered with doing externals for that.

      My clones take 30-40 seconds, how do you thin provision? Using virt-sparsify on an image?

      No, qcow2 is thin by default. But all of my templates are RHEL systems. So the OS doesn't use hardly any space. Are you cloning Windows machines?

      No, no windows

      Hmm, I don't have anything special. Some 300G 10K SAS drives in RAID 10.

      Here's a video I did for Dash:
      Youtube Video

      And another of a script I wrote that names the VM and spins up how many instances you tell it:
      Youtube Video

      I want that speed!! I am on 4 500GB 7200 SATA in RAID 10

      How big is your template?

      2.0G -rw-------. 1 root root  16G Feb 13 03:37 template.qcow2
      

      That's what I have.

      RomoR 1 Reply Last reply Reply Quote 0
      • stacksofplatesS
        stacksofplates
        last edited by

        Also it's not virt-sysprep --update it's virt-customize --update. I didn't think that was right, so I just went back and looked.

        I have a daily cron job that runs this

        /bin/virt-customize --update --selinux-relabel -a /data/VMs/template.qcow2
        
        1 Reply Last reply Reply Quote 1
        • RomoR
          Romo @stacksofplates
          last edited by

          @stacksofplates said in KVM Snapshot/Backup Script:

          @Romo said in KVM Snapshot/Backup Script:

          @stacksofplates said in KVM Snapshot/Backup Script:

          @Romo said in KVM Snapshot/Backup Script:

          @stacksofplates said in KVM Snapshot/Backup Script:

          @Romo said in KVM Snapshot/Backup Script:

          @stacksofplates said in KVM Snapshot/Backup Script:

          @Romo said in KVM Snapshot/Backup Script:

          Are you using external snapshots to thin provision any vms? Is there a performance hit on doing this?

          No. I have a template that uses a qcow2 disk. It's only a 15GB disk, but since it's thin provisioned it's only around 1.5GB. I can clone it in about 1-2 seconds so I haven't bothered with doing externals for that.

          My clones take 30-40 seconds, how do you thin provision? Using virt-sparsify on an image?

          No, qcow2 is thin by default. But all of my templates are RHEL systems. So the OS doesn't use hardly any space. Are you cloning Windows machines?

          No, no windows

          Hmm, I don't have anything special. Some 300G 10K SAS drives in RAID 10.

          Here's a video I did for Dash:
          Youtube Video

          And another of a script I wrote that names the VM and spins up how many instances you tell it:
          Youtube Video

          I want that speed!! I am on 4 500GB 7200 SATA in RAID 10

          How big is your template?

          2.0G -rw-------. 1 root root  16G Feb 13 03:37 template.qcow2
          

          That's what I have.

          Way bigger, apparently its not thing provisioned at all

          1 root root 2.9G Oct 26 17:39 centos7-clone.qcow2
          1 root root  26G Feb  8 15:35 centos-7.qcow2
          
          stacksofplatesS 1 Reply Last reply Reply Quote 0
          • RomoR
            Romo
            last edited by

            I use this to create my image and the use virt-manager to finish the install

            qemu-img create -f qcow2 -o preallocation=metadata centos-7.qcow2 25G
            
            stacksofplatesS 1 Reply Last reply Reply Quote 1
            • stacksofplatesS
              stacksofplates @Romo
              last edited by

              @Romo said in KVM Snapshot/Backup Script:

              @stacksofplates said in KVM Snapshot/Backup Script:

              @Romo said in KVM Snapshot/Backup Script:

              @stacksofplates said in KVM Snapshot/Backup Script:

              @Romo said in KVM Snapshot/Backup Script:

              @stacksofplates said in KVM Snapshot/Backup Script:

              @Romo said in KVM Snapshot/Backup Script:

              @stacksofplates said in KVM Snapshot/Backup Script:

              @Romo said in KVM Snapshot/Backup Script:

              Are you using external snapshots to thin provision any vms? Is there a performance hit on doing this?

              No. I have a template that uses a qcow2 disk. It's only a 15GB disk, but since it's thin provisioned it's only around 1.5GB. I can clone it in about 1-2 seconds so I haven't bothered with doing externals for that.

              My clones take 30-40 seconds, how do you thin provision? Using virt-sparsify on an image?

              No, qcow2 is thin by default. But all of my templates are RHEL systems. So the OS doesn't use hardly any space. Are you cloning Windows machines?

              No, no windows

              Hmm, I don't have anything special. Some 300G 10K SAS drives in RAID 10.

              Here's a video I did for Dash:
              Youtube Video

              And another of a script I wrote that names the VM and spins up how many instances you tell it:
              Youtube Video

              I want that speed!! I am on 4 500GB 7200 SATA in RAID 10

              How big is your template?

              2.0G -rw-------. 1 root root  16G Feb 13 03:37 template.qcow2
              

              That's what I have.

              Way bigger, apparently its not thing provisioned at all

              1 root root 2.9G Oct 26 17:39 centos7-clone.qcow2
              1 root root  26G Feb  8 15:35 centos-7.qcow2
              

              was that with ls -lsh? It should give you the actual size on the left before the permissions.

              I use a minimal image by default, then just add what I need after the clone.

              RomoR 1 Reply Last reply Reply Quote 1
              • RomoR
                Romo @stacksofplates
                last edited by

                @stacksofplates I only did a ls -lh

                output of ls -lsh

                2.9G -rw-r--r--. 1 root root 2.9G Oct 26 17:39 centos7-clone.qcow2
                1.1G -rw-r--r--. 1 root root  26G Feb  8 15:35 centos-7.qcow2
                
                stacksofplatesS 1 Reply Last reply Reply Quote 0
                • stacksofplatesS
                  stacksofplates @Romo
                  last edited by

                  @Romo said in KVM Snapshot/Backup Script:

                  I use this to create my image and the use virt-manager to finish the install

                  qemu-img create -f qcow2 -o preallocation=metadata centos-7.qcow2 25G
                  

                  I preallocated the original template, and then when I clone with Virt-Manager or cli I don't usually change it after. I did some tests and didn't see any difference between running the preallocation on the clone and not. I'm not sure if it copies the preallocation flag when you clone, but like I said, I haven't seen much of a read/write difference.

                  1 Reply Last reply Reply Quote 0
                  • stacksofplatesS
                    stacksofplates @Romo
                    last edited by

                    @Romo said in KVM Snapshot/Backup Script:

                    @stacksofplates I only did a ls -lh

                    output of ls -lsh

                    2.9G -rw-r--r--. 1 root root 2.9G Oct 26 17:39 centos7-clone.qcow2
                    1.1G -rw-r--r--. 1 root root  26G Feb  8 15:35 centos-7.qcow2
                    

                    Ya so it's thin provisioned. I wonder why it's taking so long. I don't think the disk speeds would make that much of a difference.

                    1 Reply Last reply Reply Quote 2
                    • stacksofplatesS
                      stacksofplates
                      last edited by

                      What's your host specs? Mine is a DL380 G6. Dual 4 core Xeons and 96GB RAM. Don't think the RAM would have much to do with it. I had 24 originally and I'm pretty sure it cloned at the same speed.

                      RomoR 1 Reply Last reply Reply Quote 0
                      • RomoR
                        Romo @stacksofplates
                        last edited by

                        @stacksofplates said in KVM Snapshot/Backup Script:

                        What's your host specs? Mine is a DL380 G6. Dual 4 core Xeons and 96GB RAM. Don't think the RAM would have much to do with it. I had 24 originally and I'm pretty sure it cloned at the same speed.

                        Its tiny 😃

                        ML110 G7 8GB RAM , Single 4 core Xeon

                        stacksofplatesS 1 Reply Last reply Reply Quote 0
                        • stacksofplatesS
                          stacksofplates @Romo
                          last edited by

                          @Romo said in KVM Snapshot/Backup Script:

                          @stacksofplates said in KVM Snapshot/Backup Script:

                          What's your host specs? Mine is a DL380 G6. Dual 4 core Xeons and 96GB RAM. Don't think the RAM would have much to do with it. I had 24 originally and I'm pretty sure it cloned at the same speed.

                          Its tiny 😃

                          ML110 G7 8GB RAM , Single 4 core Xeon

                          Hmm. Do you have anything else running while you clone? You would think 4 cores would be enough as long as you're not way over provisioned.

                          RomoR 1 Reply Last reply Reply Quote 0
                          • RomoR
                            Romo @stacksofplates
                            last edited by

                            @stacksofplates said in KVM Snapshot/Backup Script:

                            @Romo said in KVM Snapshot/Backup Script:

                            @stacksofplates said in KVM Snapshot/Backup Script:

                            What's your host specs? Mine is a DL380 G6. Dual 4 core Xeons and 96GB RAM. Don't think the RAM would have much to do with it. I had 24 originally and I'm pretty sure it cloned at the same speed.

                            Its tiny 😃

                            ML110 G7 8GB RAM , Single 4 core Xeon

                            Hmm. Do you have anything else running while you clone? You would think 4 cores would be enough as long as you're not way over provisioned.

                            3 vms

                            virsh # list 
                             Id    Name                           State
                            ----------------------------------------------------
                             111   FreePBX                        running
                             144   rocket-chat                    running
                             160   ubt-ans-ininja                 running
                            

                            This is a clone on the centos image.

                            [root@kvm2 ~]# virt-clone -o centos-7 -n clone-test -f /vmrepo/clone-test.qcow2
                            Allocating 'clone-test.qcow2'                                                  |  25 GB  00:00:33     
                            
                            Clone 'clone-test' created successfully.
                            
                            stacksofplatesS 1 Reply Last reply Reply Quote 0
                            • stacksofplatesS
                              stacksofplates @Romo
                              last edited by

                              @Romo said in KVM Snapshot/Backup Script:

                              @stacksofplates said in KVM Snapshot/Backup Script:

                              @Romo said in KVM Snapshot/Backup Script:

                              @stacksofplates said in KVM Snapshot/Backup Script:

                              What's your host specs? Mine is a DL380 G6. Dual 4 core Xeons and 96GB RAM. Don't think the RAM would have much to do with it. I had 24 originally and I'm pretty sure it cloned at the same speed.

                              Its tiny 😃

                              ML110 G7 8GB RAM , Single 4 core Xeon

                              Hmm. Do you have anything else running while you clone? You would think 4 cores would be enough as long as you're not way over provisioned.

                              3 vms

                              virsh # list 
                               Id    Name                           State
                              ----------------------------------------------------
                               111   FreePBX                        running
                               144   rocket-chat                    running
                               160   ubt-ans-ininja                 running
                              

                              This is a clone on the centos image.

                              [root@kvm2 ~]# virt-clone -o centos-7 -n clone-test -f /vmrepo/clone-test.qcow2
                              Allocating 'clone-test.qcow2'                                                  |  25 GB  00:00:33     
                              
                              Clone 'clone-test' created successfully.
                              

                              Maybe it is hw limitations. I'm not sure. Still, 33 seconds is much faster than building by hand 😛

                              RomoR 1 Reply Last reply Reply Quote 1
                              • RomoR
                                Romo @stacksofplates
                                last edited by

                                @stacksofplates yeah it must be my hardware, and indeed it is way faster than building by hand. I will still be jealous of your cloning times =).

                                stacksofplatesS 1 Reply Last reply Reply Quote 1
                                • stacksofplatesS
                                  stacksofplates @Romo
                                  last edited by

                                  @Romo said in KVM Snapshot/Backup Script:

                                  @stacksofplates yeah it must be my hardware, and indeed it is way faster than building by hand. I will still be jealous of your cloning times =).

                                  Oh mine is nothing. Google can spin up thousands with Kubernetes in seconds. That's something to be jealous of.

                                  RomoR 1 Reply Last reply Reply Quote 2
                                  • RomoR
                                    Romo @stacksofplates
                                    last edited by

                                    @stacksofplates said in KVM Snapshot/Backup Script:

                                    @Romo said in KVM Snapshot/Backup Script:

                                    @stacksofplates yeah it must be my hardware, and indeed it is way faster than building by hand. I will still be jealous of your cloning times =).

                                    Oh mine is nothing. Google can spin up thousands with Kubernetes in seconds. That's something to be jealous of.

                                    But they spin up containers don't they.

                                    stacksofplatesS 1 Reply Last reply Reply Quote 1
                                    • stacksofplatesS
                                      stacksofplates @Romo
                                      last edited by

                                      @Romo said in KVM Snapshot/Backup Script:

                                      @stacksofplates said in KVM Snapshot/Backup Script:

                                      @Romo said in KVM Snapshot/Backup Script:

                                      @stacksofplates yeah it must be my hardware, and indeed it is way faster than building by hand. I will still be jealous of your cloning times =).

                                      Oh mine is nothing. Google can spin up thousands with Kubernetes in seconds. That's something to be jealous of.

                                      But they spin up containers don't they.

                                      True, good point but I would think it's relative. For example I could probably only spin up a handful in a few seconds. With their equipment they have to be able to spin up a ton of full VMs pretty quickly.

                                      Plus there are the really trimmed down cloud versions of these OSs that spin up even faster.

                                      1 Reply Last reply Reply Quote 1
                                      • A
                                        Alex Sage
                                        last edited by

                                        Thanks.

                                        1 Reply Last reply Reply Quote 0
                                        • ntoxicatorN
                                          ntoxicator
                                          last edited by

                                          @stacksofplates

                                          Very nice!

                                          Question:

                                          I'm looking to setup a oVIRT engine + node setup. I think this script will help, as Ideally, i do not want to store my snapshots on the primary VM storage (iSCSI). Would rather have them be saved to a secondary storage location (NFS) location.

                                          how would I modify your script to specify another storage location? I do not see the argument where to modify the snap location

                                          matteo nunziatiM 1 Reply Last reply Reply Quote 0
                                          • matteo nunziatiM
                                            matteo nunziati @ntoxicator
                                            last edited by

                                            @ntoxicator I think he is grabbing a temp snapshot and then he tar.gz's the snap to the destination (e.g. an NFS mount). Then the snap is destroyed, otherwise you get worse and worse on performance.

                                            stacksofplatesS 1 Reply Last reply Reply Quote 2
                                            • 1
                                            • 2
                                            • 3
                                            • 2 / 3
                                            • First post
                                              Last post