ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    CloudatCost and Fibernetics April to May Outage

    News
    fibernetics cloudatcost
    14
    59
    16.1k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ?
      A Former User @scottalanmiller
      last edited by

      @scottalanmiller said:

      Online here I mean, no word on being online for the datacenter.

      Bahahah.

      1 Reply Last reply Reply Quote 0
      • mlnewsM
        mlnews
        last edited by

        https://twitter.com/cloudatcost/status/594156214067466240

        1 Reply Last reply Reply Quote 0
        • mlnewsM
          mlnews
          last edited by

          https://members.cloudatcost.com/index.php?fuse=admin&view=Announcements&ann_id=73

          This is the official link for the network status.

          ? 1 Reply Last reply Reply Quote 0
          • ?
            A Former User @mlnews
            last edited by A Former User

            @mlnews said:

            https://members.cloudatcost.com/index.php?fuse=admin&view=Announcements&ann_id=73

            This is the official link for the network status.

            Lies...There's no way anyone is believing that.

            1 Reply Last reply Reply Quote 0
            • dafyreD
              dafyre
              last edited by

              They Seriously need to be using Zabbix or something for monitoring their links...

              ? 1 Reply Last reply Reply Quote 0
              • ?
                A Former User @dafyre
                last edited by

                @dafyre said:

                They Seriously need to be using Zabbix or something for monitoring their links...

                But then they couldn't always blame outages on someone else.

                1 Reply Last reply Reply Quote 1
                • AmanBhogalA
                  AmanBhogal Vendor
                  last edited by

                  Hey everybody,

                  In the past 24 hours we have experienced multiple fiber splices which have caused a lot of downtime at our data center.

                  As many of you have mentioned, we are not completely offline and there are servers still online during this outage.

                  The most recent update I received from Rogers outlines that techs have been dispatched and that the issue has been escalated to management at Rogers.

                  The crew is currently trying to resolve the issue but Rogers has not provided an ETR.

                  I will do my best to keep everybody posted on a regular basis.

                  Reid CooperR 1 Reply Last reply Reply Quote -3
                  • Reid CooperR
                    Reid Cooper @AmanBhogal
                    last edited by Reid Cooper

                    @AmanBhogal said:

                    Hey everybody,

                    In the past 24 hours we have experienced multiple fiber splices which have caused a lot of downtime at our data center.

                    As many of you have mentioned, we are not completely offline and there are servers still online during this outage.

                    The most recent update I received from Rogers outlines that techs have been dispatched and that the issue has been escalated to management at Rogers.

                    The crew is currently trying to resolve the issue but Rogers has not provided an ETR.

                    I will do my best to keep everybody posted on a regular basis.

                    What does Rogers have to do with it? You have redundant connections, why have you chosen not to failover? The issue is with you, not with Rogers. That there is a loss of redundancy, a loss of capacity, that might be Rogers. But the downtime issue is not Rogers and mentioning them is an excuse.

                    Rogers has nothing to do with the downtime. Why are you DOWN is the question and why is no attempt at resolving it being made?

                    ? 1 Reply Last reply Reply Quote 1
                    • ?
                      A Former User @Reid Cooper
                      last edited by

                      @Reid-Cooper said:

                      @AmanBhogal said:

                      Hey everybody,

                      In the past 24 hours we have experienced multiple fiber splices which have caused a lot of downtime at our data center.

                      As many of you have mentioned, we are not completely offline and there are servers still online during this outage.

                      The most recent update I received from Rogers outlines that techs have been dispatched and that the issue has been escalated to management at Rogers.

                      The crew is currently trying to resolve the issue but Rogers has not provided an ETR.

                      I will do my best to keep everybody posted on a regular basis.

                      What does Rogers have to do with it? You have redundant connections, why have you chosen not to failover? The issue is with you, not with Rogers. That there is a loss of redundancy, a loss of capacity, that might be Rogers. But the downtime issue is not Rogers and mentioning them is an excuse.

                      Rogers has nothing to do with the downtime. Why are you DOWN is the question and why is no attempt at resolving it being made?

                      Exactly. How does a Datacenter not know how to advertise it's routes and subnets over multiple connections? people run more reliable and redundant hosting out of their houses.

                      1 Reply Last reply Reply Quote 0
                      • mlnewsM
                        mlnews
                        last edited by

                        https://twitter.com/cloudatcost/status/594169115939475456

                        ? 1 Reply Last reply Reply Quote 0
                        • ?
                          A Former User @mlnews
                          last edited by A Former User

                          @mlnews said:

                          https://twitter.com/cloudatcost/status/594169115939475456

                          So about 30 hrs for a failover that should be automatic.

                          1 Reply Last reply Reply Quote 0
                          • scottalanmillerS
                            scottalanmiller
                            last edited by

                            Back up here.

                            1 Reply Last reply Reply Quote 0
                            • ?
                              A Former User
                              last edited by

                              Up here. going to get some stuff off of it. then never use it again. Still waiting on the paypal disputes.

                              1 Reply Last reply Reply Quote 0
                              • thanksajdotcomT
                                thanksajdotcom
                                last edited by

                                Finally back!

                                1 Reply Last reply Reply Quote 0
                                • dafyreD
                                  dafyre
                                  last edited by

                                  I'm back online as well.

                                  I won't hold this against them... I have seen and been part of (both the cause and on the repair team) network issues like this (although at a much smaller scale). I just signed up about halfway through April for one of the Dev 2 instances, I think.

                                  Stuff does happen, but if they have failover links, then everything should fail over, or they should make it apparent in the feature list on the pricing page that the Dev & Big Dog instances are not part of the failover links if that is the way they want to go.

                                  1 Reply Last reply Reply Quote 0
                                  • thegillionT
                                    thegillion
                                    last edited by

                                    This is just my 2 cents but I have been using Vultr from beta and they are great.

                                    1 Reply Last reply Reply Quote 0
                                    • scottalanmillerS
                                      scottalanmiller
                                      last edited by

                                      Here is my IOWait from one of the boxes that just got brought back up...

                                      01:53:57 PM     all     12.47      0.00      9.12     26.66      0.00     51.75
                                      01:55:07 PM     all     23.65      0.00     14.91     37.25      0.00     24.20
                                      

                                      26% and 37%, those are crazy numbers!

                                      thegillionT 1 Reply Last reply Reply Quote 1
                                      • thegillionT
                                        thegillion
                                        last edited by

                                        Im just going to leave this right here

                                        "2) Service Interruption Credits
                                        If Services are interrupted for a period of at least 24 hours after notice by the Customer to CloudatCost, an allowance equal to 1/30th of any fixed billing cycle charges for the affected Service shall apply to each full 24 hour period during which the interruption continues. Credit in any billing period shall not exceed the total average monthly charges for that period for the affected Service. No allowance shall apply to any non-recurring or usage charges. The Customer's sole and exclusive remedy for Service interruption shall be the credit outlined above
                                        The Customer must request credit within thirty (30) days of the validated interruption, failing which the Customer forever waives its right to any credit for such outage. CloudatCost reserves the right to determine in its sole and absolute discretion if an interruption is considered a validated interruption.
                                        At no time will multiple remedies be provided to the Customer for same, similar or related troubles for the same service. Customer payables must be current prior to the Customer receiving any credits
                                        No credit shall be provided for interruptions due to the following:
                                        the failure of any component, software, network or system provided by the Customer or a third party;
                                        network maintenance by CloudatCost;
                                        Force Majeure events;
                                        acts or omissions, negligent or otherwise, of the Customer or a third party, or any breach of any term or condition by the Customer of the Master Services Agreement or any schedules or addenda attached thereto."

                                        http://www.cloudatcost.com/terms.php

                                        ? 1 Reply Last reply Reply Quote 0
                                        • ?
                                          A Former User @thegillion
                                          last edited by A Former User

                                          "2) Service Interruption Credits
                                          If Services are interrupted for a period of at least 24 hours after notice by the Customer to CloudatCost, an allowance equal to 1/30th of any fixed billing cycle charges for the affected Service shall apply to each full 24 hour period during which the interruption continues. Credit in any billing period shall not exceed the total average monthly charges for that period for the affected Service. No allowance shall apply to any non-recurring or usage charges. The Customer's sole and exclusive remedy for Service interruption shall be the credit outlined above
                                          The Customer must request credit within thirty (30) days of the validated interruption, failing which the Customer forever waives its right to any credit for such outage. CloudatCost reserves the right to determine in its sole and absolute discretion if an interruption is considered a validated interruption.
                                          At no time will multiple remedies be provided to the Customer for same, similar or related troubles for the same service. Customer payables must be current prior to the Customer receiving any credits
                                          No credit shall be provided for interruptions due to the following:
                                          the failure of any component, software, network or system provided by the Customer or a third party;
                                          network maintenance by CloudatCost;
                                          Force Majeure events;
                                          acts or omissions, negligent or otherwise, of the Customer or a third party, or any breach of any term or condition by the Customer of the Master Services Agreement or any schedules or addenda attached thereto."

                                          http://www.cloudatcost.com/terms.php

                                          edit: emphasis added

                                          1 Reply Last reply Reply Quote 0
                                          • thegillionT
                                            thegillion @scottalanmiller
                                            last edited by

                                            @scottalanmiller said:

                                            Here is my IOWait from one of the boxes that just got brought back up...

                                            01:53:57 PM     all     12.47      0.00      9.12     26.66      0.00     51.75
                                            01:55:07 PM     all     23.65      0.00     14.91     37.25      0.00     24.20
                                            

                                            26% and 37%, those are crazy numbers!

                                            02:20:01 PM CPU %user %nice %system %iowait %steal %idle
                                            02:30:01 PM all 0.20 0.00 0.34 0.06 0.07 99.34
                                            Average: all 0.20 0.00 0.34 0.06 0.07 99.34
                                            ^^SSD server with 2 CPU and 2GB of ram

                                            06:20:01 PM CPU %user %nice %system %iowait %steal %idle
                                            06:30:02 PM all 0.28 0.00 0.15 0.69 0.03 98.84
                                            06:40:01 PM all 0.36 0.00 0.20 0.82 0.05 98.57
                                            Average: all 0.32 0.00 0.18 0.75 0.04 98.71

                                            ^^SATA backup server with 512mb of ram and 1CPU

                                            1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 3
                                            • 2 / 3
                                            • First post
                                              Last post