JVM crash when building an application with Atlassian Bamboo
Nick Barkas
snb at threerings.net
Thu Dec 18 15:08:00 PST 2008
Periodically we've been experiencing JVM crashes while Bamboo builds
one of our applications. Bamboo itself does not crash. Rather, it is a
JVM invoked by Bamboo to run JUnit tests that crashes. It doesn't
happen every time, only about once a week for the last three weeks.
We're using java/jdk15 on an AMD64 FreeBSD 6.3 machine. After this
happened a couple of times I enabled debugging symbols with the port,
but I could not figure out how to make Bamboo invoke $JAVA_HOME/bin/
java_g instead of $JAVA_HOME/bin/java. So, the JVM that crashed is one
that seems to be lacking those symbols. Is there any way I can build
the java/jdk15 port to install *only* the unstripped binaries so that
$JAVA_HOME/bin/java will have the proper symbols?
Here's the crash log left behind:
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# Internal Error (53484152454432554E54494D450E43505001A8), pid=80816,
tid=0xc02800
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.5.0_14-p8-
root_11_dec_2008_16_33 mixed mode)
--------------- T H R E A D ---------------
Current thread (0x0000000000c02400): JavaThread "pool-1-
thread-2" [_thread_in_Java, id=12593152]
Stack: [0x00007ffffe6ec000,0x00007ffffe7ec000),
sp=0x00007ffffe7ea500, free space=1017k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code,
C=native code)
V [libjvm.so+0x693e49]
V [libjvm.so+0x2f7136]
V [libjvm.so+0x60c85f]
V [libjvm.so+0x5a1cb2]
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
=>0x0000000000c02400 JavaThread "pool-1-thread-2" [_thread_in_Java,
id=12593152]
0x0000000000772c00 JavaThread "Low Memory Detector" daemon
[_thread_blocked, id=7841792]
0x000000000076cc00 JavaThread "CompilerThread1" daemon
[_thread_in_vm, id=7809024]
0x0000000000767c00 JavaThread "CompilerThread0" daemon
[_thread_blocked, id=7784448]
0x0000000000758c00 JavaThread "AdapterThread" daemon
[_thread_blocked, id=7763968]
0x000000000074dc00 JavaThread "Signal Dispatcher" daemon
[_thread_blocked, id=7702528]
0x000000000074d000 JavaThread "Finalizer" daemon [_thread_blocked,
id=7657472]
0x000000000066d800 JavaThread "Reference Handler" daemon
[_thread_blocked, id=6740992]
0x000000000052b000 JavaThread "main" [_thread_blocked, id=5332992]
Other Threads:
0x000000000065be00 VMThread [id=6738944]
0x000000000051cc00 WatcherThread [id=7866368]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGen total 74688K, used 30761K [0x0000000078190000,
0x000000007d4e0000, 0x000000008d6e0000)
eden space 64064K, 48% used
[0x0000000078190000,0x0000000079f9a448,0x000000007c020000)
from space 10624K, 0% used
[0x000000007ca80000,0x000000007ca80000,0x000000007d4e0000)
to space 10624K, 0% used
[0x000000007c020000,0x000000007c020000,0x000000007ca80000)
PSOldGen total 170688K, used 0K [0x000000004d6e0000,
0x0000000057d90000, 0x0000000078190000)
object space 170688K, 0% used
[0x000000004d6e0000,0x000000004d6e0000,0x0000000057d90000)
PSPermGen total 21248K, used 7804K [0x00000000482e0000,
0x00000000497a0000, 0x000000004d6e0000)
object space 21248K, 36% used
[0x00000000482e0000,0x0000000048a7f318,0x00000000497a0000)
Dynamic libraries:
0x0000000000400000 /usr/local/debug-jdk/jdk1.5.0/jre/bin/java
0x000000004063b000 /lib/libz.so.3
0x000000004074f000 /lib/libpthread.so.2
0x000000004087a000 /lib/libc.so.6
0x0000000040a8b000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
server/libjvm.so
0x00000000413c6000 /usr/lib/libstdc++.so.5
0x00000000415bd000 /lib/libm.so.4
0x00000000416d9000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
native_threads/libhpi.so
0x00000000417e5000 /usr/local/lib/nss_ldap.so.1
0x0000000041904000 /usr/local/lib/libldap-2.3.so.2
0x0000000041a3e000 /usr/local/lib/liblber-2.3.so.2
0x0000000041b4c000 /usr/local/lib/libsasl2.so.2
0x0000000041c64000 /usr/lib/libssl.so.4
0x0000000041d9c000 /lib/libcrypto.so.4
0x0000000041fe3000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libverify.so
0x00000000420f2000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libjava.so
0x000000004221a000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libzip.so0x000000008f74f000 /usr/local/debug-jdk/jdk1.5.0/jre/lib/
amd64/libnet.so
0x000000004050a000 /libexec/ld-elf.so.1VM Arguments:jvm_args: -
Dpanopticon.test.migration.file=/export/bamboo/bamboo-home/xml-data/
build-dir/PANOPTICON-DEVEL/etc/panopticon-ddl.xml -eajava_command:
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner
testsfile=/export/bamboo/bamboo-home/xml-data/b
uild-dir/PANOPTICON-DEVEL/junittestcases835921828.properties
filtertrace=true haltOnError=false haltOnFailure=false showou
tput=false outputtoformatters=true logtestlistenerevents=true
formatter=org.apache.tools.ant.taskdefs.optional.junit.XMLJU
nitResultFormatter,/export/bamboo/bamboo-home/xml-data/build-dir/
PANOPTICON-DEVEL/dist/tmp/IGNORETHIS.xml crashfile=/expor
t/bamboo/bamboo-home/xml-data/build-dir/PANOPTICON-DEVEL/
junitvmwatcher228899536.properties propsfile=/export/bamboo/bambo
o-home/xml-data/build-dir/PANOPTICON-DEVEL/
junit2040459509.propertiesLauncher Type: SUN_STANDARD
Environment Variables:JAVA_HOME=/usr/local/debug-jdk/jdk1.5.0PATH=/usr/
local/debug-jdk/jdk1.5.0/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/
usr/local/sbin:/usr/local/bin:/usr/X11R6/
bin:/home/jayme/bin:/home/jayme/bin
USERNAME=root
LD_LIBRARY_PATH=/usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server:/
usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64:/usr/local/
debug-jdk/jdk1.5.0/jre/../lib/amd64:/usr/local/jdk1.5.0/jre/lib/amd64/
server:/usr/local/jdk1.5.0/jre/lib/amd64:/usr/local/
jdk1.5.0/jre/../lib/amd64
SHELL=/usr/local/bin/bash
HOSTTYPE=FreeBSD
OSTYPE=FreeBSD
MACHTYPE=unknown
Signal Handlers:
SIGSEGV: [libjvm.so+0x694850], sa_mask[0]=0xffffffff,
sa_flags=0x00000002
SIGBUS: [libjvm.so+0x694850], sa_mask[0]=0xffffffff, sa_flags=0x00000002
SIGFPE: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff, sa_flags=0x00000042
SIGPIPE: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff,
sa_flags=0x00000042
SIGILL: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff, sa_flags=0x00000042
SIGUSR1: [libjvm.so+0x5a0750], sa_mask[0]=0x00000000,
sa_flags=0x00000040
SIGUSR2: [libjvm.so+0x5a06c0], sa_mask[0]=0xffffffff,
sa_flags=0x00000042
SIGHUP: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff, sa_flags=0x00000002
SIGINT: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff, sa_flags=0x00000002
SIGQUIT: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff,
sa_flags=0x00000002
SIGTERM: [libjvm.so+0x59f130], sa_mask[0]=0xffffffff,
sa_flags=0x00000002
--------------- S Y S T E M ---------------
OS:FreeBSD
uname:FreeBSD 6.3-RELEASE-p4 FreeBSD 6.3-RELEASE-p4 #8: Fri Sep 5
10:07:45 PDT 2008 root at build1.earth.threerings.net:/usr/obj/usr/
src/sys/SMP amd64
rlimit: STACK 524288k, CORE infinity, NOFILE 11095
CPU:total 8 em64t ht
Memory: 4k page, physical 16380812k
vm_info: Java HotSpot(TM) 64-Bit Server VM (1.5.0_14-p8-
root_11_dec_2008_16_33) for freebsd-amd64, built on Dec 11 2008
16:55:01 by root with gcc 3.4.6 [FreeBSD] 20060305
And here is what I got from gdb on the core file:
> sudo gdb -c 1000-80816-java.core /usr/local/debug-jdk/jdk1.5.0/bin/
java
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and
you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for
details.
This GDB was configured as "amd64-marcel-freebsd"...(no debugging
symbols found)...
Attaching to program: /usr/local/debug-jdk/jdk1.5.0/bin/java, process
1000
ptrace: No such process.
Core was generated by `java'.
Program terminated with signal 6, Aborted.
Reading symbols from /lib/libz.so.3...(no debugging symbols
found)...done.
Loaded symbols for /lib/libz.so.3
Reading symbols from /lib/libpthread.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/libpthread.so.2
Reading symbols from /lib/libc.so.6...(no debugging symbols
found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
server/libjvm.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/
libjvm.so
Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libstdc++.so.5
Reading symbols from /lib/libm.so.4...(no debugging symbols
found)...done.
Loaded symbols for /lib/libm.so.4
Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
native_threads/libhpi.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
native_threads/libhpi.so
Reading symbols from /usr/local/lib/nss_ldap.so.1...(no debugging
symbols found)...done.
Loaded symbols for /usr/local/lib/nss_ldap.so.1
Reading symbols from /usr/local/lib/libldap-2.3.so.2...(no debugging
symbols found)...done.
Loaded symbols for /usr/local/lib/libldap-2.3.so.2
Reading symbols from /usr/local/lib/liblber-2.3.so.2...(no debugging
symbols found)...done.
Loaded symbols for /usr/local/lib/liblber-2.3.so.2
Reading symbols from /usr/local/lib/libsasl2.so.2...(no debugging
symbols found)...done.
Loaded symbols for /usr/local/lib/libsasl2.so.2
Reading symbols from /usr/lib/libssl.so.4...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/libssl.so.4
Reading symbols from /lib/libcrypto.so.4...(no debugging symbols
found)...done.
Loaded symbols for /lib/libcrypto.so.4
Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libverify.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libverify.so
Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libjava.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libjava.so
Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libzip.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/libzip.so
Reading symbols from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/
libnet.so...(no debugging symbols found)...done.
Loaded symbols for /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/libnet.so
Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols
found)...done.
Loaded symbols for /libexec/ld-elf.so.1
#0 0x000000004076e91c in pthread_testcancel () from /lib/
libpthread.so.2
[New Thread 0xc02800 (LWP 100644)]
[New Thread 0x780800 (sleeping)]
[New Thread 0x77a800 (sleeping)]
[New Thread 0x772800 (sleeping)]
[New Thread 0x76c800 (sleeping)]
[New Thread 0x767800 (sleeping)]
[New Thread 0x758800 (sleeping)]
[New Thread 0x74d800 (sleeping)]
[New Thread 0x66dc00 (sleeping)]
[New Thread 0x66d400 (sleeping)]
[New Thread 0x5f6000 (sleeping)]
[New Thread 0x5f1400 (sleeping)]
[New Thread 0x5ed800 (sleeping)]
[New Thread 0x5e5c00 (sleeping)]
[New Thread 0x5e5000 (sleeping)]
[New Thread 0x5e1400 (sleeping)]
[New Thread 0x5dd800 (sleeping)]
[New Thread 0x5a6c00 (sleeping)]
[New Thread 0x5a6800 (LWP 100605)]
[New Thread 0x516000 (sleeping)]
(gdb) bt
#0 0x000000004076e91c in pthread_testcancel () from /lib/
libpthread.so.2
#1 0x000000004075c5e3 in sigaction () from /lib/libpthread.so.2
#2 0x000000004075e102 in sigaction () from /lib/libpthread.so.2
#3 0x0000000040757db6 in pthread_kill () from /lib/libpthread.so.2
#4 0x0000000040757633 in raise () from /lib/libpthread.so.2
#5 0x000000004094a49d in abort () from /lib/libc.so.6
#6 0x0000000041028df9 in os::abort ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#7 0x000000004111f097 in VMError::report_and_die ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#8 0x0000000040d82136 in report_fatal ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#9 0x000000004109785f in
SharedRuntime::continuation_for_implicit_exception ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#10 0x000000004102ccb2 in JVM_handle_bsd_signal ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#11 0x000000004075dc0f in sigaction () from /lib/libpthread.so.2
#12 0x000000004075e015 in sigaction () from /lib/libpthread.so.2
#13 0x000000004075de73 in sigaction () from /lib/libpthread.so.2
#14 0x0000000040765fa9 in pthread_mutexattr_init () from /lib/
libpthread.so.2
#15 0x000000004076600b in pthread_mutexattr_init () from /lib/
libpthread.so.2
#16 0x00000000408bdf77 in signalcontext () from /lib/libc.so.6
#17 0x00007ffffe7eb5d0 in ?? ()
#18 0x00007ffffe7eb5b0 in ?? ()
#19 0x0000000000000000 in ?? ()
#20 0x00007ffffe7eb570 in ?? ()
#21 0x00007ffffe7eb5c0 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000000000000000 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000004 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000010 in ?? ()
#37 0x0000000000000003 in ?? ()
#38 0x00007ffffe7eb908 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x000000007962d2b0 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x00007ffffe7eb980 in ?? ()
#43 0x00007ffffe7eba40 in ?? ()
#44 0x00000000413b7000 in AbstractInterpreter::_active_table ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#45 0x000000007962d2e0 in ?? ()
#46 0x0000000000000001 in ?? ()
---Type <return> to continue, or q <return> to quit---
#47 0x0000000048a7b422 in ?? ()
<snip a whole bunch more stack frames with nothing>
#193 0x00007ffffe7ebb60 in ?? ()
#194 0x00000000413be720 in StubRoutines::_catch_exception_entry ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
#195 0x0000000000000001 in ?? ()
#196 0x0000000000c02400 in ?? ()
#197 0x00000000452122a9 in ?? ()
#198 0x00007ffffe7ebb90 in ?? ()
#199 0x00007ffffe7ebdb8 in ?? ()
#200 0x000000000000000a in ?? ()
#201 0x00000000483205f8 in ?? ()
#202 0x000000004521cb60 in ?? ()
#203 0x00007ffffe7ebd08 in ?? ()
#204 0x00007ffffe7ebc10 in ?? ()
#205 0x0000000040e26bf3 in JavaCalls::call_helper ()
from /usr/local/debug-jdk/jdk1.5.0/jre/lib/amd64/server/libjvm.so
Previous frame inner to this frame (corrupt stack?)
-------------- next part --------------
A non-text attachment was scrubbed...
Name: PGP.sig
Type: application/pgp-signature
Size: 194 bytes
Desc: This is a digitally signed message part
Url : http://lists.freebsd.org/pipermail/freebsd-java/attachments/20081218/a59101bf/PGP.pgp
More information about the freebsd-java
mailing list