ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    No way to create larger than 2TB virtual disk with Xen or XCP-NG?

    IT Discussion
    10
    49
    11.8k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DanpD
      Danp @DustinB3403
      last edited by

      @DustinB3403 said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

      I do recall the xcp-ng team working on getting zsf into xcp-ng thought

      I think you mean ZFS. 😉

      It's already in the release of 8.0, but this doesn't address the 2TB limit AFAIK.

      DustinB3403D 1 Reply Last reply Reply Quote 0
      • DustinB3403D
        DustinB3403 @Danp
        last edited by

        @Danp said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

        @DustinB3403 said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

        I do recall the xcp-ng team working on getting zsf into xcp-ng thought

        I think you mean ZFS. 😉

        It's already in the release of 8.0, but this doesn't address the 2TB limit AFAIK.

        Mobile but yes

        1 Reply Last reply Reply Quote 0
        • B
          biggen
          last edited by biggen

          There must be some other limitation than just “ext3” restricting us to 2TB. According to the wiki, ext3 can use a max file system size between 4TiB and 32TiB depending on the block size.

          https://en.m.wikipedia.org/wiki/Ext3

          black3dynamiteB scottalanmillerS 2 Replies Last reply Reply Quote 0
          • black3dynamiteB
            black3dynamite @biggen
            last edited by

            @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

            There must be some other limitation than just “ext3” restricting us to 2TB. According to the wiki, ext3 can use a max file system size between 4TiB and 32TiB depending on the block size.

            https://en.m.wikipedia.org/wiki/Ext3

            Thin provisioning uses vhd and that has a 2TB limitation.

            https://en.wikipedia.org/wiki/VHD_(file_format)
            75fb3469-0e9c-4187-bd3d-81f9a0979d72-image.png

            B 1 Reply Last reply Reply Quote 0
            • B
              biggen @black3dynamite
              last edited by

              @black3dynamite said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

              @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

              There must be some other limitation than just “ext3” restricting us to 2TB. According to the wiki, ext3 can use a max file system size between 4TiB and 32TiB depending on the block size.

              https://en.m.wikipedia.org/wiki/Ext3

              Thin provisioning uses vhd and that has a 2TB limitation.

              https://en.wikipedia.org/wiki/VHD_(file_format)
              75fb3469-0e9c-4187-bd3d-81f9a0979d72-image.png

              Ok. Thanks for that. I may play with that experimental ext4 drivers.

              scottalanmillerS 1 Reply Last reply Reply Quote 0
              • scottalanmillerS
                scottalanmiller @biggen
                last edited by

                @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                There must be some other limitation than just “ext3” restricting us to 2TB. According to the wiki, ext3 can use a max file system size between 4TiB and 32TiB depending on the block size.

                https://en.m.wikipedia.org/wiki/Ext3

                Right, but it's files, not filesystems that are the limitation.

                Screenshot from 2019-08-03 09-17-44.png

                1 Reply Last reply Reply Quote 0
                • scottalanmillerS
                  scottalanmiller @biggen
                  last edited by

                  @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                  @black3dynamite said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                  @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                  There must be some other limitation than just “ext3” restricting us to 2TB. According to the wiki, ext3 can use a max file system size between 4TiB and 32TiB depending on the block size.

                  https://en.m.wikipedia.org/wiki/Ext3

                  Thin provisioning uses vhd and that has a 2TB limitation.

                  https://en.wikipedia.org/wiki/VHD_(file_format)
                  75fb3469-0e9c-4187-bd3d-81f9a0979d72-image.png

                  Ok. Thanks for that. I may play with that experimental ext4 drivers.

                  Why they don't use XFS we just can't understand.

                  1 Reply Last reply Reply Quote 1
                  • 1
                    1337 @biggen
                    last edited by

                    @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                    Is there no way to just pass the whole disk right to a VM?

                    Yes, there is. You need to edit a config file on the host. Then the disk will show up as removable storage in xenserver/xcp-ng and you can assign it to the VM you want.

                    1 1 Reply Last reply Reply Quote 0
                    • B
                      biggen
                      last edited by biggen

                      Well I went ahead and used the "Experimental" EXT4/XFS drivers. They work fine from what I can tell. I actually used XFS and not EXT4. I haven't installed an OS on EXT4 in years.

                      But you are still limited to 2TB for the VHD size no matter the underlying file system. So I had to create multiple 2TB vhds with xcp-ng for that SR, attach those vhds to the VM, and then span the volumes in the VM guest to create one large fat drive. It's not quite an elegant approach but I guess it works nonetheless.

                      One thing I don't like is xcp-ng doesn't make it very easy to figure out how to use all the available space on the SR when creating the vhds. For example, after I added my 6TB SR, I needed to break that up into 3 vhds. So I created two 2TB vhds and needed one more to use the remaining space. However, you have to do some math here to figure out how much space you have left as I noticed xcp-ng will let you overprovision the SR to your heart's content. I could have created a dozen 2TB vhds on the single 6TB storage repo if I wanted to. Also, when creating vhds, it asks you how large you want the vhd to be in GB (Gigabyte) but after you create it, its shows you the size in TiB (Tebibytes).

                      scottalanmillerS 2 Replies Last reply Reply Quote 0
                      • 1
                        1337 @1337
                        last edited by 1337

                        @Pete-S said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                        @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                        Is there no way to just pass the whole disk right to a VM?

                        Yes, there is. You need to edit a config file on the host. Then the disk will show up as removable storage in xenserver/xcp-ng and you can assign it to the VM you want.

                        BTW, it's the block device that you will pass from the hypervisor to the guest. So it can be any size and any file system that the guest supports.

                        It also works with drives that are already formatted, for instance if you insert an NTFS drive full of files to your xenserver host you can pass it to a windows guest VM.

                        B 1 Reply Last reply Reply Quote 1
                        • B
                          biggen @1337
                          last edited by biggen

                          @Pete-S
                          Pete, I actually found your post (at least I think it was from you, I was tired last night) from a year ago or so on here about doing exactly that. I may test that method out as well.

                          1 Reply Last reply Reply Quote 1
                          • scottalanmillerS
                            scottalanmiller @biggen
                            last edited by

                            @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                            Well I went ahead and used the "Experimental" EXT4/XFS drivers. They work fine from what I can tell. I actually used XFS and not EXT4. I haven't installed an OS on EXT4 in years.

                            Hey awesome, that's way better.

                            1 Reply Last reply Reply Quote 0
                            • scottalanmillerS
                              scottalanmiller @biggen
                              last edited by

                              @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                              But you are still limited to 2TB for the VHD size no matter the underlying file syste

                              Lame

                              1 Reply Last reply Reply Quote 0
                              • ObsolesceO
                                Obsolesce @black3dynamite
                                last edited by

                                @black3dynamite said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                2TB limit is because of ext3.

                                Wow, I haven't used ext3 in ages lol.

                                scottalanmillerS 1 Reply Last reply Reply Quote 0
                                • scottalanmillerS
                                  scottalanmiller @Obsolesce
                                  last edited by

                                  @Obsolesce said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                  @black3dynamite said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                  2TB limit is because of ext3.

                                  Wow, I haven't used ext3 in ages lol.

                                  It's still what XO uses. (shakes head)

                                  DanpD travisdh1T 2 Replies Last reply Reply Quote 0
                                  • DanpD
                                    Danp @scottalanmiller
                                    last edited by

                                    @scottalanmiller said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                    @Obsolesce said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                    @black3dynamite said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                    2TB limit is because of ext3.

                                    Wow, I haven't used ext3 in ages lol.

                                    It's still what XO uses. (shakes head)

                                    I think you meant XS/XCP-ng, correct?

                                    scottalanmillerS 1 Reply Last reply Reply Quote 0
                                    • B
                                      biggen
                                      last edited by biggen

                                      Yeah its strange that Xen's base file system is still ext3. I mean, that is very very old. Wonder what the holdup is to move it to at the very least ext4?

                                      scottalanmillerS 1 Reply Last reply Reply Quote 1
                                      • scottalanmillerS
                                        scottalanmiller @biggen
                                        last edited by

                                        @biggen said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                        Yeah its strange that Xen's base file system is still ext3. I mean, that is very very old. Wonder what the holdup is to move it to at the very least ext4?

                                        yeah, for sure.

                                        1 Reply Last reply Reply Quote 0
                                        • scottalanmillerS
                                          scottalanmiller @Danp
                                          last edited by

                                          @Danp said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                          @scottalanmiller said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                          @Obsolesce said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                          @black3dynamite said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                          2TB limit is because of ext3.

                                          Wow, I haven't used ext3 in ages lol.

                                          It's still what XO uses. (shakes head)

                                          I think you meant XS/XCP-ng, correct?

                                          Sorry, XCP-NG I meant. Made by XO

                                          DanpD 1 Reply Last reply Reply Quote 0
                                          • DanpD
                                            Danp @scottalanmiller
                                            last edited by

                                            @scottalanmiller said in No way to create larger than 2TB virtual disk with Xen or XCP-NG?:

                                            Sorry, XCP-NG I meant. Made by Vates, the creator of XO

                                            FTFY! 😛

                                            1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 3
                                            • 1 / 3
                                            • First post
                                              Last post