ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    KVM VM Replication

    Scheduled Pinned Locked Moved IT Discussion
    kvmreplicationvirtualizationstoragehypervisorlinuxdrbdglustercephhyper-v
    31 Posts 11 Posters 8.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • FATeknollogeeF
      FATeknollogee
      last edited by

      @Tim_G any updates ?

      ObsolesceO 1 Reply Last reply Reply Quote 0
      • ObsolesceO
        Obsolesce @Francesco Provino
        last edited by

        @francesco-provino said in KVM VM Replication:

        @tim_g said in KVM VM Replication:

        @brianlittlejohn said in KVM VM Replication:

        I may be asking this prematurely, I'm about to start playing around with KVM. Is there a replication feature similar to HyperV replication baked into KVM natively?

        Yes 🙂

        Do you mean DRBD?

        Yes it is with using DRBD.

        scottalanmillerS 1 Reply Last reply Reply Quote 1
        • scottalanmillerS
          scottalanmiller @Obsolesce
          last edited by

          @tim_g said in KVM VM Replication:

          @francesco-provino said in KVM VM Replication:

          @tim_g said in KVM VM Replication:

          @brianlittlejohn said in KVM VM Replication:

          I may be asking this prematurely, I'm about to start playing around with KVM. Is there a replication feature similar to HyperV replication baked into KVM natively?

          Yes 🙂

          Do you mean DRBD?

          Yes it is with using DRBD.

          Little different than replication. Hyper-V is async. DRBD is Network RAID 1, with delayed async only as an additional option.

          1 Reply Last reply Reply Quote 0
          • scottalanmillerS
            scottalanmiller
            last edited by

            Basically, DRBD is way more advanced, and way faster, but has some fragility issues, too.

            1 Reply Last reply Reply Quote 0
            • ObsolesceO
              Obsolesce @FATeknollogee
              last edited by

              @fateknollogee said in KVM VM Replication:

              What did you think?
              How does it compare to Hyper-V replication?

              @Tim_G any updates ?

              Sorry, Very busy day today.

              It seems like a slight pain (but doable) to set up.

              OVirt does it easy, so I'd go that route. Doing it that way at least looks better than Hyper-V, but Hyper-V is definitely easier than doing DRBD.

              1 Reply Last reply Reply Quote 0
              • ObsolesceO
                Obsolesce
                last edited by

                When all is said and done, I'd rather use KVM... if that answers your question.

                1 Reply Last reply Reply Quote 0
                • black3dynamiteB
                  black3dynamite
                  last edited by black3dynamite

                  http://yallalabs.com/linux/how-to-install-and-configure-drbd-cluster-on-rhel7-centos7/
                  http://www.learnitguide.net/2016/07/how-to-install-and-configure-drbd-on-linux.html

                  Now this instruction is based on Proxmox. Its a Debian system so if you were do this on Fedora you will have to make several changes.
                  https://pve.proxmox.com/wiki/DRBD

                  1 Reply Last reply Reply Quote 0
                  • ObsolesceO
                    Obsolesce
                    last edited by

                    I'm not so focused on replication with KVM. It's not really needed. It's only hardware redundancy, and there is guaranteed data loss if you need to spin up a replica.

                    With Hyper-V, you can do replication of a VM every 30 seconds to 15 minutes. You could potentially lose 15 minutes of data.

                    If a server part went bad and the server died, I'd rather let the VMs on it be down for a few minutes to replace the part, and then bring everything back up again... rather than failover every VM to the replica and lose all that data.

                    With KVM, it's like Scott said... you can do replication but it's meant to be a network RAID1. That's HA. It's better to go that route instead. With Linux, it's free (if you exclude hardware costs because you may re-use something you already have).

                    1 Reply Last reply Reply Quote 3
                    • FATeknollogeeF
                      FATeknollogee
                      last edited by

                      Any improvements on the KVM + Replication front?

                      scottalanmillerS 1 Reply Last reply Reply Quote 0
                      • scottalanmillerS
                        scottalanmiller @FATeknollogee
                        last edited by scottalanmiller

                        @FATeknollogee said in KVM VM Replication:

                        Any improvements on the KVM + Replication front?

                        Improvements? What would you want improved? Where do you perceive it not having met any potential need all along?

                        Where this thread went was... KVM was so good at replication that it didn't need the fall back methods popular on Hyper-V that exist to make up for the lack of HA full sync replication that KVM and Xen had.

                        1 Reply Last reply Reply Quote 0
                        • FATeknollogeeF
                          FATeknollogee
                          last edited by

                          @scottalanmiller You aren't talking about the DRBD in HA-Lizard?

                          scottalanmillerS 1 Reply Last reply Reply Quote 0
                          • FATeknollogeeF
                            FATeknollogee
                            last edited by

                            Scratch my last post, Lizard is XS only.

                            1 Reply Last reply Reply Quote 0
                            • scottalanmillerS
                              scottalanmiller @FATeknollogee
                              last edited by

                              @FATeknollogee said in KVM VM Replication:

                              @scottalanmiller You aren't talking about the DRBD in HA-Lizard?

                              DRBD is part of the Linux kernel, so KVM has it natively. Xen typically gets it, but Xen isn't tied to Linux, so not always. But KVM and DRBD are always linked. So KVM always has DRBD no matter how it is installed unless you compile it out on purpose, and no one does that.

                              1 Reply Last reply Reply Quote 0
                              • scottalanmillerS
                                scottalanmiller
                                last edited by

                                DRBD has way more than that, though. All normal KVM installs have options like Gluster and CEPH, too. And that's just the included replication options.

                                If you want to go commercial, there are options like Starwinds VSAN.

                                So KVM replication is essentially the market leader with the most and best integrated features, and the most and best commercially available features.

                                Basically anything you want, KVM does as well or better than everyone else.

                                1 Reply Last reply Reply Quote 0
                                • FATeknollogeeF
                                  FATeknollogee
                                  last edited by

                                  Who amongst us is doing is currently doing KVM replication?

                                  scottalanmillerS 2 Replies Last reply Reply Quote 0
                                  • scottalanmillerS
                                    scottalanmiller @FATeknollogee
                                    last edited by

                                    @FATeknollogee said in KVM VM Replication:

                                    Who amongst us is doing is currently doing KVM replication?

                                    We do it with SCRIBE on our Scale HC3 system.

                                    1 Reply Last reply Reply Quote 0
                                    • scottalanmillerS
                                      scottalanmiller @FATeknollogee
                                      last edited by

                                      @FATeknollogee said in KVM VM Replication:

                                      KVM replication

                                      I think calling it this adds to the confusion. Hyper-V includes a product called Hyper-V Replication. This makes it seem like it is both a part of the hypervisor (it is not) and something we should be looking for as a feature (it is not.)

                                      No other platform has a thing called "platform replication". It's just not an appropriate concept. And Hyper-V only had it to overcome storage layer shortcomings that were pretty dramatic compared to the competition. And now in Hyper-V, you basically never use it because it's not a good idea, there are free add ons that make it essentially (but not absolutely totally) useless.

                                      In KVM, Xen, or ESXi we should simply be asking about replication strategies. How do you want to replicate, and why? How do you do that with your specific KVM? KVM is just the hypervisor and nothing else, but Hyper-V is the name for the entire ecosystem around a hypervisor. So asking about KVM as if it were similar doesn't make sense.

                                      If what you want to ask about is DRBD, ask about DRBD, not KVM. If you want to know about Gluster, ask about that. Asking about a storage feature concept, but only in the context of a non-storage system, will result in confusing and very limited answers.

                                      S 1 Reply Last reply Reply Quote 0
                                      • S
                                        StorageNinja Vendor @scottalanmiller
                                        last edited by

                                        @scottalanmiller said in KVM VM Replication:

                                        No other platform has a thing called "platform replication".

                                        vSphere Replication is most certainly a product/feature, and other ecosystem replication solutions out there like Recovery Point, RP4VM, Veeam Backup and Replication and Zerto. Couple things...

                                        1. DRDB is a kernel driver. There's positives (It's low overhead) but also negatives vs stuff like VAIO that loopback to userspace (if it borks it takes down the host). For async you don't want WAN backups or other issues to cause problems, and how you deal with resume from the replication being borked without having something like CBT or WAN acceleration can change hugely how the stuff is operationally managed.

                                        2. Compression/Deduplication/WAN efficiency. In theory I could run DRDB through a WAN optimizer, but this is a standard function in a number of replication products. If your on metered connections this can get expessive. (vSphere Replication uses LZFast for compression, Veeam lets you tune what compression you want etc). Honestly don't remember what compression Hyper-V uses other than that they do it.

                                        3. Encryption. A lot of other async replication products/features support TLS encryption at the transport layer for this connection. In theory you could IPSEC DRDB.

                                        4. Does the product support GFS retention of the async replica's? Can I keep snapshots on the other side and is merging them out to age out old ones a zero overhead operation.

                                        5. Application and guest quiescence etc tied to recovery points. What does management for this look like?

                                        6. Can I target 1 cluster to another cluster without having to manually pair hosts and volumes? (IE can I just target a resource pool etc on the other side, or am I manually deciding target hosts and volumes every time).

                                        Some other nice to have's is something that manages orchestration of testing, failover, failback with full runbooks, replication of network firewall rules, handling BGP failover, network overlay stuff etc.

                                        Saying "It's cool DRDB can do async replication" may be TECHNICALLY true, but there's a rabbit whole of features people tend to look for with async replication

                                        1 Reply Last reply Reply Quote 0
                                        • Emad RE
                                          Emad R @brianlittlejohn
                                          last edited by

                                          @brianlittlejohn said in KVM VM Replication:

                                          I may be asking this prematurely, I'm about to start playing around with KVM. Is there a replication feature similar to HyperV replication baked into KVM natively?

                                          Many times we soo those questions, Perhaps if we can PIN KVM as topic as well as (pbx) freepbx some how

                                          scottalanmillerS 1 Reply Last reply Reply Quote 0
                                          • DustinB3403D
                                            DustinB3403
                                            last edited by

                                            @scottalanmiller tags please

                                            scottalanmillerS 1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 1 / 2
                                            • First post
                                              Last post