Apache -- Analyzing core dump?

[Chris Maness]

Chris Maness wrote:
> I used to analyze core dumps with tnos to debug.  It has been a coon's 
> age since I've done such.  I am having apache crash and core dump.  
> There isn't any error info in the log files.
>
> Where is the core dumped to (the main log tells me the core has been 
> dumped)?
>
> How do I analyze this dump file to find out what went wrong?
>
> Do I have to compile apache with debug features turned on to do this?
>
> I am referring to my previous thread:
>
> apache+mod_ssl-1.3.41+2.8.31 crashing with mod_php5
>
I was able to find my old e-mails on debugging tnos.  I used gdb.

Per the gdb man page I was able to figure out how to check the core 
file.  Here is the output:


GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain 
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-marcel-freebsd"...(no debugging symbols 
found)...
Core was generated by `httpd'.
Program terminated with signal 11, Segmentation fault.
Reading symbols from /lib/libcrypt.so.4...(no debugging symbols 
found)...done.
Loaded symbols for /lib/libcrypt.so.4
Reading symbols from /usr/local/lib/libmm.so.14...(no debugging symbols 
found)...done.
Loaded symbols for /usr/local/lib/libmm.so.14
Reading symbols from /usr/local/lib/libexpat.so.6...(no debugging 
symbols found)...done.
Loaded symbols for /usr/local/lib/libexpat.so.6
Reading symbols from /lib/libc.so.7...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.7
Reading symbols from /usr/local/libexec/apache/mod_mmap_static.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_mmap_static.so
Reading symbols from /usr/local/libexec/apache/mod_vhost_alias.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_vhost_alias.so
Reading symbols from /usr/local/libexec/apache/mod_env.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_env.so
Reading symbols from /usr/local/libexec/apache/mod_define.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_define.so
Reading symbols from /usr/local/libexec/apache/mod_log_config.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_log_config.so
Reading symbols from /usr/local/libexec/apache/mod_mime_magic.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_mime_magic.so
Reading symbols from /usr/local/libexec/apache/mod_mime.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_mime.so
Reading symbols from /usr/local/libexec/apache/mod_negotiation.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_negotiation.so
Reading symbols from /usr/local/libexec/apache/mod_status.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_status.so
Reading symbols from /usr/local/libexec/apache/mod_info.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_info.so
Reading symbols from /usr/local/libexec/apache/mod_include.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_include.so
Reading symbols from /usr/local/libexec/apache/mod_autoindex.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_autoindex.so
Reading symbols from /usr/local/libexec/apache/mod_dir.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_dir.so
Reading symbols from /usr/local/libexec/apache/mod_cgi.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_cgi.so
Reading symbols from /usr/local/libexec/apache/mod_asis.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_asis.so
Reading symbols from /usr/local/libexec/apache/mod_imap.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_imap.so
Reading symbols from /usr/local/libexec/apache/mod_actions.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_actions.so
Reading symbols from /usr/local/libexec/apache/mod_speling.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_speling.so
Reading symbols from /usr/local/libexec/apache/mod_userdir.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_userdir.so
Reading symbols from /usr/local/libexec/apache/mod_alias.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_alias.so
Reading symbols from /usr/local/libexec/apache/mod_rewrite.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_rewrite.so
Reading symbols from /usr/local/libexec/apache/mod_access.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_access.so
Reading symbols from /usr/local/libexec/apache/mod_auth.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_auth.so
Reading symbols from /usr/local/libexec/apache/mod_auth_anon.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_auth_anon.so
Reading symbols from /usr/local/libexec/apache/mod_auth_db.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_auth_db.so
Reading symbols from /usr/local/libexec/apache/mod_digest.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_digest.so
Reading symbols from /usr/local/libexec/apache/libproxy.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/libproxy.so
Reading symbols from /usr/local/libexec/apache/mod_cern_meta.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_cern_meta.so
Reading symbols from /usr/local/libexec/apache/mod_expires.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_expires.so
Reading symbols from /usr/local/libexec/apache/mod_headers.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_headers.so
Reading symbols from /usr/local/libexec/apache/mod_usertrack.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_usertrack.so
Reading symbols from /usr/local/libexec/apache/mod_log_forensic.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_log_forensic.so
Reading symbols from /usr/local/libexec/apache/mod_unique_id.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_unique_id.so
Reading symbols from /usr/local/libexec/apache/mod_setenvif.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/mod_setenvif.so
Reading symbols from /usr/local/libexec/apache/libssl.so...(no debugging 
symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/libssl.so
Reading symbols from /usr/lib/libssl.so.5...(no debugging symbols 
found)...done.
Loaded symbols for /usr/lib/libssl.so.5
Reading symbols from /lib/libcrypto.so.5...(no debugging symbols 
found)...done.
Loaded symbols for /lib/libcrypto.so.5
Reading symbols from /usr/local/libexec/apache/libphp5.so...(no 
debugging symbols found)...done.
Loaded symbols for /usr/local/libexec/apache/libphp5.so
Reading symbols from /lib/libm.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.5
Reading symbols from /usr/local/lib/libxml2.so.5...(no debugging symbols 
found)...done.
Loaded symbols for /usr/local/lib/libxml2.so.5
Reading symbols from /lib/libz.so.4...(no debugging symbols found)...done.
Loaded symbols for /lib/libz.so.4
Reading symbols from /usr/local/lib/libiconv.so.3...(no debugging 
symbols found)...done.
Loaded symbols for /usr/local/lib/libiconv.so.3
Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols 
found)...done.
Loaded symbols for /libexec/ld-elf.so.1
#0  0x28ccda00 in ?? ()
(gdb) quit

#####################################################################################

Earlier this week I was having problems compiling gtk-2.  The macro was 
complaining that I did not have ld-elf.so.1.

The output of the script was:

iqr.la im-multipress.la  > gtk.immodules
> /libexec/ld-elf.so.1: Shared object "libm.so.4" not found, required by
> "libgdk_pixbuf-2.0.so.0"
> gmake[3]: *** [gtk.immodules] Error 1
> gmake[3]: Leaving directory
> `/usr/ports/x11-toolkits/gtk20/work/gtk+-2.12.8/modules/input'
> gmake[2]: *** [all-recursive] Error 1
> gmake[2]: Leaving directory
> `/usr/ports/x11-toolkits/gtk20/work/gtk+-2.12.8/modules'
> gmake[1]: *** [all-recursive] Error 1
> gmake[1]: Leaving directory
> `/usr/ports/x11-toolkits/gtk20/work/gtk+-2.12.8' gmake: *** [all] Error 2
> ** Command failed [exit code 1]: /usr/bin/script -qa
> /tmp/portupgrade.13565.39 env UPGRADE_TOOL=portupgrade
> UPGRADE_PORT=gtk-2.12.3 UPGRADE_PORT_VER=2.12.3 make BATCH=yes
> ** Fix the problem and try again.
> ** Listing the failed packages (-:ignored / *:skipped / !:failed)
>         ! x11-toolkits/gtk20 (gtk-2.12.3)       (new compiler error)

looks like I am missing libm.so.4.  If I do a locate libm.so.4 it turns 
up nothing.  However, my FreeBSD 6.3 box has the library.  I upgraded by 
compiling with everything set as default and GENERIC.  What happened to 
libm.so.4?  Is it possible that ld-elf.so.1  (the last library loaded) 
caused apache to crash because it could not find a library like when I 
was trying to compile gtk-2?

Any suggestions?

-- 
Chris Maness
(909) 223-9179
http://www.chrismaness.com