What Are You Doing Right Now
-
Got home a couple of hours ago exhausted.
Went to the colo this morning to setup our new IPOD and we started by booting up hosts. In the middle of the boot process, the whole rack goes dark, like anti-Christmas, no lights, no joy dark. This includes all of the vm servers that are currently in production.
After a series of trying to bring the servers back online and it goes dark again, we concluded that we were pulling too many amps. So we unplugged all non-critical gear to get the most critical up and running. Rack still goes dark.
After more digging, it was discovered that our redundant power was never really redundant. Both legs were plugged into one outlet for the entire rack. That was the colo's responsibility to take care of for us. We then also discovered that we were allocated 4 30-amp outlets. We got more power strips and plugged them into the additional outlets and began moving equipment to the new strips while still partially relying on the old. I still don't have full faith in the old strips.
Lessons learned today
- Before you deploy new equipment, make sure you have enough amps to power all of the equipment.
- Make sure your redundant power is truly redundant.
-
Wondering why some people are such idiots....
https://community.spiceworks.com/topic/1978807-what-are-the-consequences-of-running-cat5e-at-a-length-of-say-150m"I know I shouldn't, but what if I do it anyway?"
-
@NerdyDad said in What Are You Doing Right Now:
Got home a couple of hours ago exhausted.
Went to the colo this morning to setup our new IPOD and we started by booting up hosts. In the middle of the boot process, the whole rack goes dark, like anti-Christmas, no lights, no joy dark. This includes all of the vm servers that are currently in production.
After a series of trying to bring the servers back online and it goes dark again, we concluded that we were pulling too many amps. So we unplugged all non-critical gear to get the most critical up and running. Rack still goes dark.
After more digging, it was discovered that our redundant power was never really redundant. Both legs were plugged into one outlet for the entire rack. That was the colo's responsibility to take care of for us. We then also discovered that we were allocated 4 30-amp outlets. We got more power strips and plugged them into the additional outlets and began moving equipment to the new strips while still partially relying on the old. I still don't have full faith in the old strips.
Lessons learned today
- Before you deploy new equipment, make sure you have enough amps to power all of the equipment.
- Make sure your redundant power is truly redundant.
And three....
-
Is SW having issues this morning? It is so hard to tell from here because everything is so slow and their site is so heavy that it fails often even when other things work, but it is just normal. But I'm not seeing any issues at all on other sites and I've getting constant page failures there, no ability to post or load threads. Is it just me?
-
@scottalanmiller said in What Are You Doing Right Now:
Is SW having issues this morning? It is so hard to tell from here because everything is so slow and their site is so heavy that it fails often even when other things work, but it is just normal. But I'm not seeing any issues at all on other sites and I've getting constant page failures there, no ability to post or load threads. Is it just me?
I wouldn't notice only visit once a day
mainly in the afternoon
But yeah seems slow -
@hobbit666 said in What Are You Doing Right Now:
@scottalanmiller said in What Are You Doing Right Now:
Is SW having issues this morning? It is so hard to tell from here because everything is so slow and their site is so heavy that it fails often even when other things work, but it is just normal. But I'm not seeing any issues at all on other sites and I've getting constant page failures there, no ability to post or load threads. Is it just me?
I wouldn't notice only visit once a day
mainly in the afternoon
But yeah seems slowNot slow, but nearly continuous "Secure Connection Failed" errors here.
-
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
-
@scottalanmiller no issues on my side posting has been fine at least from mobile and desktop.
-
Just took the long walk to the grocery store. Well stocked now though.
-
I need a walk after the way this mornings already gone.
So much so that I can't even!
-
@DustinB3403 said in What Are You Doing Right Now:
I need a walk after the way this mornings already gone.
So much so that I can't even!
I haven't got to use this one in a while...
-
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
-
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That's why you set up Salt / Ansible or some other CM system to make it painless.
-
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That would be a good project for me to work on
-
@dafyre said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That's why you set up Salt / Ansible or some other CM system to make it painless.
Yeah, I'll be getting around to that, probably Salt to start with. I've tried Ansible in the past, but never really put the time in with it that's needed.
-
@wirestyle22 said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That would be a good project for me to work on
Very, very good. Ansible is definitely the one with the more momentum.
-
@scottalanmiller said in What Are You Doing Right Now:
@wirestyle22 said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That would be a good project for me to work on
Very, very good. Ansible is definitely the one with the more momentum.
Looking between the two of them, the salt config files make more sense to me, but I have not worked with Ansible any yet.
-
@dafyre said in What Are You Doing Right Now:
@scottalanmiller said in What Are You Doing Right Now:
@wirestyle22 said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That would be a good project for me to work on
Very, very good. Ansible is definitely the one with the more momentum.
Looking between the two of them, the salt config files make more sense to me, but I have not worked with Ansible any yet.
Ansible + Tower looks downright amazing, at least without having used them yet. What I've seen of the Salt config files so far, which is what @scottalanmiller has posted here, do look easier to read.
-
@dafyre said in What Are You Doing Right Now:
@scottalanmiller said in What Are You Doing Right Now:
@wirestyle22 said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
@stacksofplates said in What Are You Doing Right Now:
@travisdh1 said in What Are You Doing Right Now:
Spending all evening making a new template and deploying basic assets in my lab. Not nearly so productive as I hopped.
That's the nice thing about libvirt. If you forget something just run virt-customize later and install something or edit something with virt-edit (or guestfish).
It's XenServer, and I hadn't even setup a base CentOS image for it yet. Got the template made tho, so every "new" machine will only take a minute (or less) to deploy. It's always the specific service being setup that takes all the time.
That would be a good project for me to work on
Very, very good. Ansible is definitely the one with the more momentum.
Looking between the two of them, the salt config files make more sense to me, but I have not worked with Ansible any yet.
I prefer Salt myself, but lots of people prefer Ansible. Both are very good.
-
@scottalanmiller said in What Are You Doing Right Now:
I prefer Salt myself, but lots of people prefer Ansible. Both are very good.
Might have to put these on my "project" list to have a look and play with
