httpd dead but pid file exists
-
@wirestyle22 said in httpd dead but pid file exists:
@DustinB3403 said in httpd dead but pid file exists:
No one has asked yet (and I'm assuming this) but why haven't you restored to a known working condition?
I need to understand why this happened in order to prevent it from happening in the future. Nothing has turned up any answers.
It's always nice to know root cause, but sometimes it is very difficult to replicate an issue like this.
-
@IRJ said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
@DustinB3403 said in httpd dead but pid file exists:
No one has asked yet (and I'm assuming this) but why haven't you restored to a known working condition?
I need to understand why this happened in order to prevent it from happening in the future. Nothing has turned up any answers.
It's always nice to know root cause, but sometimes it is very difficult to replicate an issue like this.
And not worth your time. On Wall St. we had things like this happen from time to time and the question was always... what's the value of getting the system back online vs. the cost of downtime and resources to try to track down something that might never be an issue again?
Almost never did root cause analysis make the cut when actual business value was applied. It sounds great, it sounds like something IT should be doing. But when we put on our real IT hats and do our proper cost analysis, it's rarely a good idea. And to do it on a RHEL 5 system slated for decommission? Essentially zero chance that any investigation could be justified.
-
is there a way I can ignore
/usr/lib/php/modules/oci8.sojust to verify apache will start if this file is not in play? I actually think a file level restore of this file will fix it but I want to test that before I offer it as a solution -
@wirestyle22 said in httpd dead but pid file exists:
is there a way I can ignore
/usr/lib/php/modules/oci8.sojust to verify apache will start if this file is not in play? I actually think a file level restore of this file will fix it but I want to test that before I offer it as a solutionYou'd "ignore" it by removing any PHP app that tries to use it.
-
@wirestyle22 said in httpd dead but pid file exists:
is there a way I can ignore
/usr/lib/php/modules/oci8.sojust to verify apache will start if this file is not in play? I actually think a file level restore of this file will fix it but I want to test that before I offer it as a solutionAre you unable to take a backup of this system?
Seems like an odd thing to try and do when solutions exist for this very case of "just in case"
-
@DustinB3403 said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
is there a way I can ignore
/usr/lib/php/modules/oci8.sojust to verify apache will start if this file is not in play? I actually think a file level restore of this file will fix it but I want to test that before I offer it as a solutionAre you unable to take a backup of this system?
Seems like an odd thing to try and do when solutions exist for this very case of "just in case"
I don't manage the backups, they are managed in France. So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
-
@wirestyle22 said in httpd dead but pid file exists:
I don't manage the backups, they are managed in France. So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
If they don't get back to you, just ask "do you still need this system, I was told it was in the process of being decommed, seems like that's been accomplished." And if they take weeks, not your problem.
Why are you even working on their system if they manage it?
-
@wirestyle22 said in httpd dead but pid file exists:
@DustinB3403 said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
is there a way I can ignore
/usr/lib/php/modules/oci8.sojust to verify apache will start if this file is not in play? I actually think a file level restore of this file will fix it but I want to test that before I offer it as a solutionAre you unable to take a backup of this system?
Seems like an odd thing to try and do when solutions exist for this very case of "just in case"
I don't manage the backups, they are managed in France.
The hell?
@wirestyle22 said in httpd dead but pid file exists:
So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
Okay. . . well then I guess the system really doesn't matter if your recovery team says it'll take a week to just respond to a request.
-
@DustinB3403 said in httpd dead but pid file exists:
Okay. . . well then I guess the system really doesn't matter if your recovery team says it'll take a week to just respond to a request.
For real, this seems like THE answer. Is there just no other work to be done? Tell the business "backup team can't restore for now" and leave it. If "no restores" is the system design, sounds like they already decommissioned it and didn't inform you.
-
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
I don't manage the backups, they are managed in France. So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
If they don't get back to you, just ask "do you still need this system, I was told it was in the process of being decommed, seems like that's been accomplished." And if they take weeks, not your problem.
Why are you even working on their system if they manage it?
They manage the backups, not the application server.
-
@wirestyle22 said in httpd dead but pid file exists:
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
I don't manage the backups, they are managed in France. So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
If they don't get back to you, just ask "do you still need this system, I was told it was in the process of being decommed, seems like that's been accomplished." And if they take weeks, not your problem.
Why are you even working on their system if they manage it?
They manage the backups, not the application server.
Ah, that makes slightly more sense. But sounds like they have placed a priority on this differently than you. If they are allowed to take that long to respond, I think that that is telling you a lot about what the expectation of you working on this is... zero.
-
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
I don't manage the backups, they are managed in France. So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
If they don't get back to you, just ask "do you still need this system, I was told it was in the process of being decommed, seems like that's been accomplished." And if they take weeks, not your problem.
Why are you even working on their system if they manage it?
They manage the backups, not the application server.
Ah, that makes slightly more sense. But sounds like they have placed a priority on this differently than you. If they are allowed to take that long to respond, I think that that is telling you a lot about what the expectation of you working on this is... zero.
I'm going to be working on this every day until it's resolved, so it doesn't matter either way. I think this is likely due to a corrupt file, but I don't know how to ignore it to test apache in a realistic way.
-
@wirestyle22 said in httpd dead but pid file exists:
I'm going to be working on this every day until it's resolved,
So tell your recovery team to restore this system as at a separate instance and leave the dead one how it is so you can poke at it.
And just wait a week until they get back to you.
-
@wirestyle22 said in httpd dead but pid file exists:
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
I don't manage the backups, they are managed in France. So far they have gotten back to me within a week. I don't want to wait that long to have them just delay what I want to do anyway.
If they don't get back to you, just ask "do you still need this system, I was told it was in the process of being decommed, seems like that's been accomplished." And if they take weeks, not your problem.
Why are you even working on their system if they manage it?
They manage the backups, not the application server.
Ah, that makes slightly more sense. But sounds like they have placed a priority on this differently than you. If they are allowed to take that long to respond, I think that that is telling you a lot about what the expectation of you working on this is... zero.
I'm going to be working on this every day until it's resolved, so it doesn't matter either way. I think this is likely due to a corrupt file, but I don't know how to ignore it to test apache in a realistic way.
You can't just ignore corrupt files, you have to remove any functionality that needs that file.
-
@wirestyle22 said in httpd dead but pid file exists:
I'm going to be working on this every day until it's resolved,
Why? Would the business be happy if they knew this was getting focus? This sounds like AJ Syndrome. The business absolutely, clear as day, doesn't care about this system, at all. Why do you?
-
@scottalanmiller said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
I'm going to be working on this every day until it's resolved,
Why? Would the business be happy if they knew this was getting focus? This sounds like AJ Syndrome. The business absolutely, clear as day, doesn't care about this system, at all. Why do you?
French HQ doesn't move quickly. We are treated like a colony. They don't care about us to the degree that we care about ourselves. My boss has tasked me with working on this.
How is this AJ Syndrome?
-
@wirestyle22 said in httpd dead but pid file exists:
My boss has tasked me with working on this.
So can you tell your boss you're limited on what you can do, but you've asked corporate to restore to a separate instance. When they get back to you (and have these two systems) can you then poke and prod this system.
Why try to do this in the dark?
-
@wirestyle22 said in httpd dead but pid file exists:
How is this AJ Syndrome?
@scottalanmiller would state because you're making it sound as if this system is your only goal in life and that you have to fix it, or else you'll go mad.
-
@DustinB3403 said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
How is this AJ Syndrome?
@scottalanmiller would state because you're making it sound as if this system is your only goal in life and that you have to fix it, or else you'll go mad.
It's just a problem I am working on. Anything else gathered from this is wrong. If my boss tells me to install a printer, i install it. If my boss tells me to try to diagnose a problem on a server, I do it. If he comes out and tells me to stop I will stop.
When am I just doing my job?
-
@wirestyle22 said in httpd dead but pid file exists:
@DustinB3403 said in httpd dead but pid file exists:
@wirestyle22 said in httpd dead but pid file exists:
How is this AJ Syndrome?
@scottalanmiller would state because you're making it sound as if this system is your only goal in life and that you have to fix it, or else you'll go mad.
It's just a problem I am working on. Anything else gathered from this is wrong. If my boss tells me to install a printer, i install it. If my boss tells me to try to diagnose a problem on a server, I do it. If he comes out and tells me to stop I will stop.
When am i just doing my job?
I get it, I would take the same stance with the addition of "boss this system is ancient, I can't get documentation anywhere. The best thing I can do at this time is to ask the recovery team to do their job and restore this system. Once that is done can I then investigate what may have happened"
