make buildkernel hang with SCHED_ULE

[Adam Migus]

Folks,
While doing some performance analysis (doing make -j5 buildkernel)
on a set of 14 kernels I've hit one using the SCHED_ULE scheduler
that hangs.   It happens every time but not necessarily in the same
place in the make.

When it happens the processes involved in the make are hopping in
and out of the "select," "RUN," etc. states but don't go anywhere
and the system is otherwise responsive, ie. you can login, run "ps,"
"top," etc.

The hardware is a dual Xeon box.  The kernel is SMP w/ SCHED_ULE
instead of SCHED_4BSD, the options required for diskless and the
following two options:

options         CPU_FASTER_5X86_FPU
options         CPU_UPGRADE_HW_CACHE

I've attached the kernel configuration, the output of "dmesg," "ps
-axuww," and "sysctl -A" prior to the start of the test as well as
the output of "make" up to the time it hung.

I don't have any experience debugging scheduler problems but if
someone wants to tell me what to do I'd be happy to try.

--
Adam - Migus Dot Org (http://www.migus.org)
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stdout.dmesg_pre
Type: application/octet-stream
Size: 9241 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/stdout-0004.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stdout.ps_pre
Type: application/octet-stream
Size: 3213 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/stdout-0005.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stdout.sysctl_pre
Type: application/octet-stream
Size: 31753 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/stdout-0006.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stdout.make
Type: application/octet-stream
Size: 85289 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/stdout-0007.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: DISKLESS_SMP_FAST_ULE
Type: application/octet-stream
Size: 110 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/DISKLESS_SMP_FAST_ULE-0001.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: SMP_FAST_ULE
Type: application/octet-stream
Size: 178 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/SMP_FAST_ULE-0001.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: FAST_ULE
Type: application/octet-stream
Size: 9589 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-current/attachments/20030811/18e748ef/FAST_ULE-0001.obj