Can You Get to the Spiceworks Community?
-
Ok, who broke it? Someone fess up NOW.
-
I can't get it to load either.
-
@ChrisL said in Can You Get to the Spiceworks Community?:
Ok, who broke it? Someone fess up NOW.
I think that they know who broke it
Century Link / Level 3 has nowhere to hide. -
@RojoLoco How else will you drive the stock price down for an acquisition? Gosh guys, get with the times.
-
@ChrisL said in Can You Get to the Spiceworks Community?:
Ok, who broke it? Someone fess up NOW.
We have our own conspiracy theory over here...
-
@thanksajdotcom said in Can You Get to the Spiceworks Community?:
I can't get it to load either.
Nearly two hours down. We have internal confirmation from several sources that they are fully offline. It's bad. But it's a CL/L3 issue.
-
@SamieWalters said in Can You Get to the Spiceworks Community?:
@ChrisL said in Can You Get to the Spiceworks Community?:
Ok, who broke it? Someone fess up NOW.
We have our own conspiracy theory over here...
If only they had moved to a nationally disparate tier IV colocation facility this might have been avoided.
-
From IRC just now, haven't tested myself
[14:55] <Keo-w> spiceworks support said
[14:55] <Keo-w> you can try blocking frontend.spiceworks.com -
@Coloradogeek said in Can You Get to the Spiceworks Community?:
From IRC just now, haven't tested myself
[14:55] <Keo-w> spiceworks support said
[14:55] <Keo-w> you can try blocking frontend.spiceworks.comIs that only for the local installs?
-
@scottalanmiller Yeah, reading more into the context, I believe so.
But bottom line, don't log out if you're logged into your local helpdesk or you may not get back in again until after this blows over.
-
@Coloradogeek said in Can You Get to the Spiceworks Community?:
@scottalanmiller Yeah, reading more into the context, I believe so.
But bottom line, don't log out if you're logged into your local helpdesk or you may not get back in again until after this blows over.
That would be expected as that's where the authentication is. No surprises there. But good for people who might not know.
-
It seems to be that having failovers is best practices in most instances. I would think/hope that SW would have thought far enough ahead to have a failover location in a location that is geographically separate from their main systems. Maybe a place like...lets say...London? Hmmm....Now who do we know in London? Oh, wait. SW is in London as well. Well how about that? Now the question is, why didn't they utilize their London office as a failover site?
-
@NerdyDad Yeah, going to be a lot of questions like that I think. I feel for them - after suffering two such outages that shut us down last week for two days, I know a little of what they're feeling like right now...
-
@NerdyDad said in Can You Get to the Spiceworks Community?:
It seems to be that having failovers is best practices in most instances. I would think/hope that SW would have thought far enough ahead to have a failover location in a location that is geographically separate from their main systems. Maybe a place like...lets say...London? Hmmm....Now who do we know in London? Oh, wait. SW is in London as well. Well how about that? Now the question is, why didn't they utilize their London office as a failover site?
Well because they don't host web infrastructure from their offices. Also, do they have a London office? I thought that people worked from home. Having a failover location at someone's house is not practical. And they don't use NoSQL for the database layer so doing a failover of the full database is not as simple as it sounds. How do you replicate a database of that magnitude that isn't designed for that kind of use case? The community application is not architected for this, Kris gave a talk about that a few years ago. I provided solutions in the talk, but they aren't easily to implement and he wasn't interested and felt that the RDBMS approach was fine. But this is one of the limitations, having the database be geographically disparate is effectively impossible.
Having a failover location is of no concern here, though. The issue here is that they need a second ISP. Any normal ISP redundancy would have solved the issue.
-
@Coloradogeek said in Can You Get to the Spiceworks Community?:
@NerdyDad Yeah, going to be a lot of questions like that I think. I feel for them - after suffering two such outages that shut us down last week for two days, I know a little of what they're feeling like right now...
Did you take standard precautions and still get taken down? Or was it decided not to take them and then went down because of a lack of standard design?
It might have been in your post, but I've not seen all of it.
-
They figured out that the main Twitter feed lacked the info.
-
OH wait, Level 3 is throwing them under the bus.
-
@scottalanmiller Oh boy. Where's the popcorn? This is going to get good here in a minute.
-
@NerdyDad said in Can You Get to the Spiceworks Community?:
@scottalanmiller Oh boy. Where's the popcorn? This is going to get good here in a minute.
Given that everyone in Texas knows that something is wrong with the ISPs right now AND that the outage maps show Level 3 as having lost the entire Texaplex, I'm not sure what plausible deniability Level 3 has.
-
2.5 hours now.
