java/140002: jconsole dumps tomcat when contacting jmxrmi service

Jason Helfman jhelfman at e-e.com
Mon Oct 26 22:30:02 UTC 2009


>Number:         140002
>Category:       java
>Synopsis:       jconsole dumps tomcat when contacting jmxrmi service
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    freebsd-java
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Mon Oct 26 22:30:01 UTC 2009
>Closed-Date:
>Last-Modified:
>Originator:     Jason Helfman
>Release:        7.2-RELEASE-p4
>Organization:
Experts Exchange
>Environment:
FreeBSD xxx.xxxx.experts-exchange.com 7.2-RELEASE-p4 FreeBSD 7.2-RELEASE-p4 #0: Tue Oct 13 01:00:30 UTC 2009     root at amd64.experts-exhange.com:/usr/obj/usr/src/sys/CUSTOM  amd64
>Description:
When launching jconsole on my local machine and connecting to the remote jmx service, tomcat dumps core.

Java is:
java version "1.6.0_03-p4"
Java(TM) SE Runtime Environment (build 1.6.0_03-p4-root_18_nov_2008_12_28-b00)
Java HotSpot(TM) 64-Bit Server VM (build 1.6.0_03-p4-root_18_nov_2008_12_28-b00, mixed mode)

>How-To-Repeat:
Add the following to catalina.sh under CATALINA_OPTS

-Dcom.sun.management.jmxremote.port=7090
-Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false

and restart tomcat.

start jconsole and use the service address of:
service:jmx:rmi:///jndi/rmi://192.168.100.100:7090/jmxrmi

>Fix:
Not known.

Patch attached with submission follows:

#
# An unexpected error has been detected by Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x0000000801e595af, pid=1559, tid=0x5042ba10
#
# Java VM: Diablo Java HotSpot(TM) 64-Bit Server VM (10.0-b23 mixed mode bsd-amd64)
# Problematic frame:
# v  ~BufferBlob::Interpreter
#
# Please submit bug reports to freebsd-java at FreeBSD.org
#

---------------  T H R E A D  ---------------

Current thread (0x0000000804ffc800):  JavaThread "RMI TCP Connection(26)-192.168.1.154" daemon [_thread_in_Java, id=1346550288, stack(0x00007ffffd1d6000,0x00007ffffd2d6000)]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x00007ffeffffffc0

Registers:
RAX=0x00000001ff8ce000, RBX=0x000000093dc11ca8, RCX=0x000000080094c37c, RDX=0x0000000000000001
RSP=0x00007ffffd2d3d40, RBP=0x00007fff00000000, RSI=0x0000000000000002, RDI=0x00007ffffd2d3d30
R8 =0xffffff01d3e646e0, R9 =0x00007ffffd2d3d28, R10=0x0000000000000002, R11=0x0000000000000206
R12=0x0000000801e580db, R13=0x000000093dc11ca8, R14=0x00007ffffd2d3dc8, R15=0x0000000804ffc800
RIP=0x0000000801e595af, EFL=0x0000000000000008, ERR=0x0000000000000004
  TRAPNO=0x000000000000000c

Top of Stack: (sp=0x00007ffffd2d3d40)
0x00007ffffd2d3d40:   00000001ff8ce000 0000000801e5b72d
0x00007ffffd2d3d50:   000000003f400000 0000000801e5b878
0x00007ffffd2d3d60:   0000000000000000 00007ffffd2d3d68
0x00007ffffd2d3d70:   000000093dc11ca8 00007ffffd2d3dc8
0x00007ffffd2d3d80:   000000093dc13310 0000000000000000
0x00007ffffd2d3d90:   000000093dc11ca8 0000000000000000
0x00007ffffd2d3da0:   00007ffffd2d3dc8 00007ffffd2d3e30
0x00007ffffd2d3db0:   0000000801e4d3ea 0000000000000000
0x00007ffffd2d3dc0:   0000000801e580d7 000000080f6aa190
0x00007ffffd2d3dd0:   0000000900001fa0 0000000801e4d369
0x00007ffffd2d3de0:   00007ffffd2d40d0 0000000000000001
0x00007ffffd2d3df0:   0000000804ffc800 0000000804f494a0
0x00007ffffd2d3e00:   00007ffffd2d3e80 00007ffffd2d41e8
0x00007ffffd2d3e10:   000000080000000b 000000093dc11ca8
0x00007ffffd2d3e20:   0000000801e5b600 00007ffffd2d40d8
0x00007ffffd2d3e30:   00007ffffd2d3f20 0000000800f4dcd5
0x00007ffffd2d3e40:   0000000800000001 0000000804ffc800
0x00007ffffd2d3e50:   000000093de5f5c8 00007ffffd2d3e80
0x00007ffffd2d3e60:   00007ffffd2d3ec0 00007ffffd2d41e8
0x00007ffffd2d3e70:   0000000801e5b600 000000090000000b
0x00007ffffd2d3e80:   0000000804ffc800 000000094ff05380
0x00007ffffd2d3e90:   000000093dc11ca8 000000080f6aa190
0x00007ffffd2d3ea0:   00007ffffd2d4330 0000000801e5b84c
0x00007ffffd2d3eb0:   00007ffffd2d4388 00007ffffd2d41e0
0x00007ffffd2d3ec0:   0000000804ffc800 000000094e0d6340
0x00007ffffd2d3ed0:   0000000804f49400 0000000804f494a8
0x00007ffffd2d3ee0:   0000000804f497e8 00007ffffd2d4f00
0x00007ffffd2d3ef0:   0000000804f49488 0000000000000001
0x00007ffffd2d3f00:   00007ffffd2d41e0 0000000804f49468
0x00007ffffd2d3f10:   0000000804f49450 0000000804ffc800
0x00007ffffd2d3f20:   00007ffffd2d3f40 0000000800f4ce48
0x00007ffffd2d3f30:   0000000804f49450 0000000804f494a0 

Instructions: (pc=0x0000000801e595af)
0x0000000801e5959f:   00 00 e9 8a 3d ff ff 4c 8b 6d c8 4c 8b 75 d0 c3
0x0000000801e595af:   48 8b 65 c0 48 c7 45 f0 00 00 00 00 48 be c8 59 

Stack: [0x00007ffffd1d6000,0x00007ffffd2d6000],  sp=0x00007ffffd2d3d40,  free space=1015k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
v  ~BufferBlob::Interpreter

[error occurred during error reporting (printing native stack), id 0xb]


---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x0000000804ffd000 JavaThread "RMI TCP Connection(27)-192.168.1.154" daemon [_thread_blocked, id=1319458544, stack(0x00007ffffc0c5000,0x00007ffffc1c5000)]
=>0x0000000804ffc800 JavaThread "RMI TCP Connection(26)-192.168.1.154" daemon [_thread_in_Java, id=1346550288, stack(0x00007ffffd1d6000,0x00007ffffd2d6000)]
  0x000000094ff13800 JavaThread "JMX server connection timeout 81" daemon [_thread_blocked, id=1346549888, stack(0x00007ffffc2c7000,0x00007ffffc3c7000)]
  0x0000000804ffc000 JavaThread "RMI TCP Connection(25)-192.168.1.154" daemon [_thread_in_native, id=1346549488, stack(0x00007ffffc3c8000,0x00007ffffc4c8000)]
  0x0000000804ffb800 JavaThread "RMI TCP Connection(24)-192.168.1.154" daemon [_thread_in_native, id=1346550688, stack(0x00007ffffc4c9000,0x00007ffffc5c9000)]
  0x000000094ea73000 JavaThread "com.ee.site.DynamicHeader$HeaderMonitorThread" daemon [_thread_blocked, id=1346547888, stack(0x00007ffffccd1000,0x00007ffffcdd1000)]
  0x000000094ea54800 JavaThread "com.ee.ta.VolunteerDisplayCache$MemberGroupTypeMapCacheMonitor" daemon [_thread_blocked, id=1319460944, stack(0x00007ffffc5ca000,0x00007ffffc6ca000)]
  0x000000094ea53000 JavaThread "com.ee.season.Season$SeasonCacheMonitor" daemon [_thread_blocked, id=1319460544, stack(0x00007ffffc6cb000,0x00007ffffc7cb000)]
  0x000000094ea51000 JavaThread "com.ee.common.stat.StatLocalCache$StatCacheMonitor" daemon [_thread_blocked, id=1319460144, stack(0x00007ffffc7cc000,0x00007ffffc8cc000)]
  0x000000094ea52800 JavaThread "com.ee.common.ta.TopRootTATagCache$TopRootTATagCacheMonitor" daemon [_thread_blocked, id=1319459744, stack(0x00007ffffc8cd000,0x00007ffffc9cd000)]
  0x000000094ea52000 JavaThread "com.ee.stat.ZoneStat$StatCacheMonitor" daemon [_thread_blocked, id=1346549088, stack(0x00007ffffc9ce000,0x00007ffffcace000)]
  0x000000094ff14000 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=1346548688, stack(0x00007ffffcacf000,0x00007ffffcbcf000)]
  0x000000094ea50800 JavaThread "com.ee.common.member.OverallExpertPointsCache$OverallExpertPointsCacheMonitor" daemon [_thread_blocked, id=1346548288, stack(0x00007ffffcbd0000,0x00007ffffccd0000)]
  0x000000094ea4f800 JavaThread "com.ee.search.core.EEIndex$IndexMonitorThread" daemon [_thread_blocked, id=1319459344, stack(0x00007ffffcdd2000,0x00007ffffced2000)]
  0x000000094cbe0000 JavaThread "http-127.0.0.1-8079-2" daemon [_thread_blocked, id=1294420096, stack(0x00007ffffced3000,0x00007ffffcfd3000)]
  0x000000094ea50000 JavaThread "com.ee.common.season.TopContributorCache$TopContributorCacheMonitor" daemon [_thread_blocked, id=1319458944, stack(0x00007ffffcfd4000,0x00007ffffd0d4000)]
  0x000000094ea4e000 JavaThread "com.ee.site.Logo$LogoMonitorThread" daemon [_thread_blocked, id=1319458144, stack(0x00007ffffd0d5000,0x00007ffffd1d5000)]
  0x000000094ea4f000 JavaThread "com.ee.common.ta.TACache$TACacheMonitor" daemon [_thread_blocked, id=1319457744, stack(0x00007ffffd2d7000,0x00007ffffd3d7000)]
  0x000000094ea4e800 JavaThread "com.ee.util.IPLocator$IPLocatorCacheMonitor" daemon [_thread_blocked, id=1319457344, stack(0x00007ffffd3d8000,0x00007ffffd4d8000)]
  0x000000094ea4d800 JavaThread "com.ee.common.member.LoginFailure$LoginFailureCacheMonitor" daemon [_thread_blocked, id=1319456944, stack(0x00007ffffd4d9000,0x00007ffffd5d9000)]
  0x000000094f403800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon [_thread_blocked, id=1329714128, stack(0x00007ffffd5da000,0x00007ffffd6da000)]
  0x000000094f403000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon [_thread_blocked, id=1329713728, stack(0x00007ffffd6db000,0x00007ffffd7db000)]
  0x000000094f402800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon [_thread_blocked, id=1329713328, stack(0x00007ffffd7dc000,0x00007ffffd8dc000)]
  0x000000094cb1e800 JavaThread "Timer-0" daemon [_thread_blocked, id=1294419296, stack(0x00007ffffd8dd000,0x00007ffffd9dd000)]
  0x000000094cb1c000 JavaThread "C3P0DBManager Monitor" [_thread_blocked, id=1294418896, stack(0x00007ffffd9de000,0x00007ffffdade000)]
  0x000000094d1f0000 JavaThread "http-127.0.0.1-8079-1" daemon [_thread_blocked, id=1294418496, stack(0x00007ffffdadf000,0x00007ffffdbdf000)]
  0x000000094cadd800 JavaThread "http-127.0.0.1-8079-Sendfile-0" daemon [_thread_blocked, id=26354352, stack(0x00007ffffdbe0000,0x00007ffffdce0000)]
  0x000000094cadd000 JavaThread "http-127.0.0.1-8079-Poller-0" daemon [_thread_blocked, id=26353952, stack(0x00007ffffdce1000,0x00007ffffdde1000)]
  0x000000094cadc800 JavaThread "http-127.0.0.1-8079-Acceptor-0" daemon [_thread_in_native, id=26353552, stack(0x00007ffffdde2000,0x00007ffffdee2000)]
  0x000000094cada800 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=26353152, stack(0x00007ffffdee3000,0x00007ffffdfe3000)]
  0x000000094e50a000 JavaThread "com.ee.filter.SpiderFilter$SpiderFilterMonitor" [_thread_blocked, id=26352752, stack(0x00007ffffdfe4000,0x00007ffffe0e4000)]
  0x000000094e509800 JavaThread "com.ee.filter.FileUploadLimiter$FileUploadCheckMonitor" [_thread_blocked, id=26352352, stack(0x00007ffffe0e5000,0x00007ffffe1e5000)]
  0x000000094cae1800 JavaThread "com.ee.filter.DOSFilter$DOSThreadCheckMonitor" [_thread_blocked, id=26351952, stack(0x00007ffffe1e6000,0x00007ffffe2e6000)]
  0x000000094cae1000 JavaThread "com.ee.filter.DOSFilter$DOSHashCheckMonitor" [_thread_blocked, id=26351552, stack(0x00007ffffe2e7000,0x00007ffffe3e7000)]
  0x0000000946eea800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=26350752, stack(0x00007ffffe4e9000,0x00007ffffe5e9000)]
  0x0000000946eea000 JavaThread "RMI TCP Accept-7090" daemon [_thread_in_native, id=26350352, stack(0x00007ffffe5ea000,0x00007ffffe6ea000)]
  0x0000000946ee7000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=26349952, stack(0x00007ffffe6eb000,0x00007ffffe7eb000)]
  0x0000000946ee9800 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=26349552, stack(0x00007ffffe7ec000,0x00007ffffe8ec000)]
  0x0000000946ee9000 JavaThread "CompilerThread1" daemon [_thread_blocked, id=26349152, stack(0x00007ffffe8ed000,0x00007ffffe9ed000)]
  0x0000000946ee8800 JavaThread "CompilerThread0" daemon [_thread_blocked, id=26348752, stack(0x00007ffffe9ee000,0x00007ffffeaee000)]
  0x0000000946ee8000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=26348352, stack(0x00007ffffeaef000,0x00007ffffebef000)]
  0x0000000946ee7800 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=26347952, stack(0x00007ffffebf0000,0x00007ffffecf0000)]
  0x0000000946ee6000 JavaThread "Finalizer" daemon [_thread_blocked, id=26347552, stack(0x00007ffffecf1000,0x00007ffffedf1000)]
  0x0000000946ee5800 JavaThread "Reference Handler" daemon [_thread_blocked, id=26347152, stack(0x00007ffffedf2000,0x00007ffffeef2000)]
  0x0000000801926800 JavaThread "main" [_thread_in_native, id=11543104, stack(0x00007fffffaff000,0x00007fffffbff000)]

Other Threads:
  0x0000000946ee5000 VMThread [stack: 0x00007ffffeef3000,0x00007ffffeff3000] [id=26346752]
  0x0000000946eeb000 WatcherThread [stack: 0x00007ffffe3e8000,0x00007ffffe4e8000] [id=26345152]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap
 par new generation   total 153344K, used 76143K [0x0000000805000000, 0x000000080f660000, 0x000000080f660000)
  eden space 136320K,  43% used [0x0000000805000000, 0x00000008089bbf88, 0x000000080d520000)
  from space 17024K, 100% used [0x000000080d520000, 0x000000080e5c0000, 0x000000080e5c0000)
  to   space 17024K,   0% used [0x000000080e5c0000, 0x000000080e5c0000, 0x000000080f660000)
 concurrent mark-sweep generation total 4949632K, used 593279K [0x000000080f660000, 0x000000093d800000, 0x000000093d800000)
 concurrent-mark-sweep perm gen total 65536K, used 33919K [0x000000093d800000, 0x0000000941800000, 0x0000000945800000)

Dynamic libraries:
0x0000000000400000 	/usr/local/openjdk6/bin/java
0x000000080063c000 	/lib/libz.so.4
0x0000000800750000 	/lib/libthr.so.3
0x0000000800868000 	/lib/libc.so.7
0x0000000800c00000 	/usr/local/openjdk6/jre/lib/amd64/server/libjvm.so
0x00000008014a4000 	/usr/lib/libstdc++.so.6
0x00000008016b0000 	/lib/libm.so.5
0x00000008017ca000 	/lib/libgcc_s.so.1
0x0000000801a00000 	/usr/local/openjdk6/jre/lib/amd64/native_threads/libhpi.so
0x0000000801b0c000 	/usr/local/openjdk6/jre/lib/amd64/libverify.so
0x0000000801c1b000 	/usr/local/openjdk6/jre/lib/amd64/libjava.so
0x0000000801d46000 	/usr/local/openjdk6/jre/lib/amd64/libzip.so
0x000000094cc00000 	/usr/local/openjdk6/jre/lib/amd64/libmanagement.so
0x000000094cd06000 	/usr/local/openjdk6/jre/lib/amd64/libnet.so
0x000000094d400000 	/var/ee/java/lib/libtcnative-1.so
0x000000094d520000 	/usr/lib/libssl.so.5
0x000000094d66a000 	/lib/libcrypto.so.5
0x000000094d8fc000 	/usr/local/lib/libapr-1.so.2
0x000000094da22000 	/lib/libcrypt.so.4
0x000000094f900000 	/usr/local/openjdk6/jre/lib/amd64/libnio.so
0x0000000950700000 	/usr/local/openjdk6/jre/lib/amd64/librmi.so
0x0000000950b00000 	/usr/local/openjdk6/jre/lib/amd64/libawt.so
0x0000000950cc6000 	/usr/local/openjdk6/jre/lib/amd64/headless/libmawt.so
0x000000080050a000 	/libexec/ld-elf.so.1

VM Arguments:
jvm_args: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/home/ee/tomcat/conf/logging.properties -Xmx5000M -Xms5000M -XX:+DisableExplicitGC -XX:PermSize=64M -XX:MaxPermSize=128M -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode -Xloggc:/home/ee/tomcat/logs/gc.2009-10-26_14:44:29.log -XX:+PrintGCDetails -Dorg.apache.lucene.FSDirectory.class=org.apache.lucene.store.NIOFSDirectory -Dcom.sun.management.jmxremote.port=7090 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djava.endorsed.dirs=/var/tomcat/current/common/endorsed -Dcatalina.base=/home/ee/tomcat -Dcatalina.home=/var/tomcat/current -Djava.io.tmpdir=/home/ee/tomcat/temp 
java_command: org.apache.catalina.startup.Bootstrap start
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/usr/local/openjdk6
PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin://bin
LD_LIBRARY_PATH=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/var/ee/java/lib
HOSTTYPE=FreeBSD
OSTYPE=FreeBSD
MACHTYPE=unknown

Signal Handlers:
SIGSEGV: [libjvm.so+0x617aa0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGBUS: [libjvm.so+0x617aa0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGFPE: [libjvm.so+0x4e17a0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGPIPE: [libjvm.so+0x4e17a0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGXFSZ: [libjvm.so+0x4e17a0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGILL: [libjvm.so+0x4e17a0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGUSR1: SIG_DFL, sa_mask[0]=0xfffefeff, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x4e3fa0], sa_mask[0]=0x00000000, sa_flags=0x00000042
SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGTERM: [libjvm.so+0x4e2ca0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042
SIGQUIT: [libjvm.so+0x4e2ca0], sa_mask[0]=0xfffefeff, sa_flags=0x00000042


---------------  S Y S T E M  ---------------

OS:Bsd
uname:FreeBSD 7.2-RELEASE-p4 FreeBSD 7.2-RELEASE-p4 #0: Tue Oct 13 01:00:30 UTC 2009     root at amd64.experts-exhange.com:/usr/obj/usr/src/sys/EEGENERIC amd64
rlimit: STACK 524288k, CORE infinity, NPROC 5547, NOFILE 11095
CPU:total 8 (4 cores per cpu, 1 threads per core) family 6 model 7 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

Memory: 4k page, physical 8267988k(2066997k free)

vm_info: Diablo Java HotSpot(TM) 64-Bit Server VM (10.0-b23) for bsd-amd64 JRE (1.6.0_07-b02), built on May 12 2008 20:56:50 by "truk" with gcc 4.2.1 20070719  [FreeBSD]

time: Mon Oct 26 15:12:13 2009
elapsed time: 1663 seconds



>Release-Note:
>Audit-Trail:
>Unformatted:


More information about the freebsd-java mailing list