httpd dead but pid file exists

black3dynamite

Another tip for finding out what’s happening.
https://serverfault.com/a/174041

black3dynamite

Have you already tried temporarily disabling SELinux too?

wirestyle22

@black3dynamite Someone already had it disabled. Cardinal sin

wirestyle22

Rebooted last night. Same error.

wirestyle22

cat httpd.pid
1848

 ps aux | grep 1848
root      3017  0.0  0.0   4024   672 pts/0    S+   09:16   0:00 grep 1848

wirestyle22

Turned on debug mode, haven't seen any debug entries yet

wirestyle22

[Tue Oct 22 10:03:19 2019] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Tue Oct 22 10:03:19 2019] [notice] Digest: generating secret for digest authentication ...
[Tue Oct 22 10:03:19 2019] [notice] Digest: done
[Tue Oct 22 10:03:19 2019] [info] APR LDAP: Built with OpenLDAP LDAP SDK
[Tue Oct 22 10:03:19 2019] [info] LDAP: SSL support available

stacksofplates

@wirestyle22 said in httpd dead but pid file exists:

I cannot stop the service

Did you try killing the pid, ensuring the pid file is removed and then restarting?

scottalanmiller

Do this...

systemctl restart httpd ; tail -f /var/log/messages

And collect about a screen's worth. Let's see if anything is reported immediately following the start up.

stacksofplates

@scottalanmiller said in httpd dead but pid file exists:

Do this...
systemctl restart httpd ; tail -f /var/log/messages
And collect about a screen's worth. Let's see if anything is reported immediately following the start up.

It's RHEL 5

scottalanmiller

@stacksofplates said in httpd dead but pid file exists:

It's RHEL 5

Ouch

wirestyle22

host (root) php -v
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/modules/oci8.so' - libclntsh.so.11.1: cannot open shared object file: No such file or directory in Unknown on line 0
PHP 5.1.6 (cli) (built: May 22 2018 10:25:39)
Copyright (c) 1997-2006 The PHP Group
Zend Engine v2.1.0, Copyright (c) 1998-2006 Zend Technologies
host (root)[ /home/root ] ldd /usr/lib/php/modules/oci8.so
        linux-gate.so.1 =>  (0x0087d000)
        libclntsh.so.11.1 => not found
        libc.so.6 => /lib/libc.so.6 (0x00960000)
        /lib/ld-linux.so.2 (0x00567000)

libclntsh.so.11.1 => not found

wat

stacksofplates

@wirestyle22 said in httpd dead but pid file exists:

host (root) php -v
PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/modules/oci8.so' - libclntsh.so.11.1: cannot open shared object file: No such file or directory in Unknown on line 0
PHP 5.1.6 (cli) (built: May 22 2018 10:25:39)
Copyright (c) 1997-2006 The PHP Group
Zend Engine v2.1.0, Copyright (c) 1998-2006 Zend Technologies
host (root)[ /home/root ] ldd /usr/lib/php/modules/oci8.so
        linux-gate.so.1 =>  (0x0087d000)
        libclntsh.so.11.1 => not found
        libc.so.6 => /lib/libc.so.6 (0x00960000)
        /lib/ld-linux.so.2 (0x00567000)

libclntsh.so.11.1 => not found wat

that was in your error log before:

@wirestyle22 said in httpd dead but pid file exists:

I am seeing a new entry in the logs:

PHP Warning:  PHP Startup: Unable to load dynamic library '/usr/lib/php/modules/oci8.so' - libclntsh.so.11.1: cannot open shared object file: No such file or directory in Unknown on line 0

Did you kill the pid and remove the pid file before restarting it?

wirestyle22

@stacksofplates said in httpd dead but pid file exists:

Did you kill the pid and remove the pid file before restarting it?

Yes I did. It just re-creates the file and gives the same error.

scottalanmiller

Is oracle-lib-compat installed?

wirestyle22

@scottalanmiller said in httpd dead but pid file exists:

oracle-lib-compat

No it's not

scottalanmiller

@wirestyle22 said in httpd dead but pid file exists:

@scottalanmiller said in httpd dead but pid file exists:

oracle-lib-compat

No it's not

That's what provides that file.

scottalanmiller

Try removing the app that Apache runs and see if Apache will start when clean before looking further.

scottalanmiller

Also, consider just moving to a maintained server. RHEL 6 is one thing today, a stretch, but one thing. RHEL 5 constitutes and abandoned server of no value. Why bother with trying to fix a workload deemed "not important enough to run?"

wirestyle22

@scottalanmiller said in httpd dead but pid file exists:

Also, consider just moving to a maintained server. RHEL 6 is one thing today, a stretch, but one thing. RHEL 5 constitutes and abandoned server of no value. Why bother with trying to fix a workload deemed "not important enough to run?"

We've been told we are phasing it out but if history is any indicator that could mean years. They like to tell us what we want to hear and then not doing anything about it.