ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s

    Scheduled Pinned Locked Moved IT Discussion
    56 Posts 9 Posters 4.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B
      bnrstnr
      last edited by

      I would poke around https://xcp-ng.org/forum/category/2/storage a little and maybe there are other suggestions for tweaking your storage performance. I know it comes up a lot over there.

      1 Reply Last reply Reply Quote 0
      • black3dynamiteB
        black3dynamite @krisleslie
        last edited by

        @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

        @black3dynamite Scott has been begging me for a while to switch over to KVM 🙂 I have enough servers at home to give it a try. What are you using for host management? Last I saw, Kimichi(sp?) was hot.

        For host management, it will be Cockpit. Just make sure cockpit-machines plugin is installed.
        sudo dnf install cockpit cockpit-storaged cockpit-machines

        K 1 Reply Last reply Reply Quote 2
        • K
          krisleslie @bnrstnr
          last edited by

          @bnrstnr well hate to tell you but you hit the nail on the head. It's literally 1000's of small files between 100-500k.

          DashrenderD 1 Reply Last reply Reply Quote 0
          • K
            krisleslie @black3dynamite
            last edited by

            @black3dynamite thats why you the man, I sure will.

            1 Reply Last reply Reply Quote 0
            • DashrenderD
              Dashrender @krisleslie
              last edited by

              @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

              @bnrstnr well hate to tell you but you hit the nail on the head. It's literally 1000's of small files between 100-500k.

              Try zipping them into a single, or multiple large files, then transfer.

              I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.

              B 1 Reply Last reply Reply Quote 1
              • B
                bnrstnr @Dashrender
                last edited by

                @Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.

                I use Robocopy, I believe it's more powerful, but I think it's a little more complex too. Either will be way better at handling all of those small files than copying them in explorer.

                DashrenderD 1 Reply Last reply Reply Quote 1
                • DashrenderD
                  Dashrender @bnrstnr
                  last edited by

                  @bnrstnr said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                  @Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                  I have found that transferring via xcopy is much faster for small files than just drag and drop in windows.

                  I use Robocopy, I believe it's more powerful, but I think it's a little more complex too. Either will be way better at handling all of those small files than copying them in explorer.

                  yeah, xcopy when it's a simple copy.. Robo when you need more power.

                  K 1 Reply Last reply Reply Quote 1
                  • K
                    krisleslie @Dashrender
                    last edited by

                    @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                    DashrenderD B 2 Replies Last reply Reply Quote 0
                    • DashrenderD
                      Dashrender @krisleslie
                      last edited by

                      @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                      @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                      well, small files.

                      Now, make 500 1 GB files and see how fast it goes.

                      scottalanmillerS 1 Reply Last reply Reply Quote 2
                      • scottalanmillerS
                        scottalanmiller @Dashrender
                        last edited by

                        @Dashrender said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                        @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                        @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                        well, small files.

                        Now, make 500 1 GB files and see how fast it goes.

                        Or 1 500GB file. Even better.

                        1 Reply Last reply Reply Quote 0
                        • B
                          bnrstnr @krisleslie
                          last edited by

                          @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                          @Dashrender I actually started the job off with Robocopy. :0) 500 GB got transferred after about 12 hours or so. Thats SLOW.

                          Did you add the switch to use Multiple CPU threads?

                          1 Reply Last reply Reply Quote 0
                          • K
                            krisleslie
                            last edited by

                            The data is from one of my Ubiquiti UniFi Video (NVR) server. So the files are not really big. So are you proposing like maybe zipping the files into one file then transferring?

                            scottalanmillerS 1 Reply Last reply Reply Quote 0
                            • K
                              krisleslie
                              last edited by

                              @bnrstnr That I did not, I'll look back over the command tomorrow. I have one of my servers home and will be testing the BIOS settings change.

                              1 Reply Last reply Reply Quote 0
                              • scottalanmillerS
                                scottalanmiller @krisleslie
                                last edited by

                                @krisleslie said in Using XCP-NG latest release, Windows 2019 Server VM file copies are pegged at 10 MB/s:

                                The data is from one of my Ubiquiti UniFi Video (NVR) server. So the files are not really big. So are you proposing like maybe zipping the files into one file then transferring?

                                If they are pre-compressed, then just tar them, don't zip them.

                                1 Reply Last reply Reply Quote 1
                                • 1
                                • 2
                                • 3
                                • 3 / 3
                                • First post
                                  Last post