java/112595: Java appletviewer frequently hangs (kse_release loop)

[Jedrzej Nasiadek]

>Number:         112595
>Category:       java
>Synopsis:       Java appletviewer frequently hangs (kse_release loop)
>Confidential:   no
>Severity:       critical
>Priority:       medium
>Responsible:    freebsd-java
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Fri May 11 10:00:12 GMT 2007
>Closed-Date:
>Last-Modified:
>Originator:     Jedrzej Nasiadek
>Release:        
>Organization:
Polska Telefonia Cyfrowa
>Environment:
FreeBSD czajnik.aaa.bbb.pl 6.2-STABLE FreeBSD 6.2-STABLE #2: Thu May 10 13:33:14 CEST 2007     root at czajnik.aaa.bbb.pl:/usr/obj/usr/src/sys/CZAJNIK  i386

java full version "diablo-1.5.0-b01"
Java is build diablo-jdk1.5.0_07 downloaded from freebsdfoundation.org

>Description:
Running (quite big) an applet using appletviewer hangs and appletviewer goes
into a loop. Truss shows what follows:

kse_release({0.045944457})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.043950069})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.041198044})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.038948596})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.036920964})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.034937192})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.032871566})                       = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.030884163})                       = 383 (0x17f)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
kse_release({0.028880836})                       = 383 (0x17f)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
(null)()                                         = 383 (0x17f)
(null)()                                         = 0 (0x0)
truss: Cannot malloc -80090560 bytes for pollfd array: Cannot allocate memory

backtrace from gdb:
(gdb) bt
#0  0x281724f7 in pthread_testcancel () from /lib/libpthread.so.2
#1  0x2816b80f in pthread_mutexattr_init () from /lib/libpthread.so.2
#2  0x080e2680 in ?? ()

Searching the net revealed that similiar problem was in older java in FreeBSD 5.x and mapping libpthread to libc_r in libmap.conf helped. I tried this but unfortunately failed.

Some smaller applets work ok. Can't yet find out which applets work and which do not.

Any ideas how to solve or track down problem are welcome.

And one more thing: the problem appeared only after upgrading from 6.1-RELEASE to 6.2
>How-To-Repeat:
It's a proprietary HP app: HP OVO Performance Monitor: com.hp.ov.pm.client.InsightApplet
>Fix:

>Release-Note:
>Audit-Trail:
>Unformatted: