kernel panic on Xserve G4 -CURRENT
Ross Gohlke
ross at grinz.com
Thu Nov 13 10:39:23 PST 2008
panic: mutex vm page queue mutex not owned at /usr/src/powerpc/a...
cpuid = 0
KDB: enter: panic
[thread pic 48347 tid 100099 ]
Stopped at 0x2cc194: addi r0, r0, 0x0
db>
Unfortunately I don't get to see the rest of the panic line.
Next directory has to be aim, don't know past that.
I have resynched my source, rebuilt/reinstalled the kernel, reinstalled
world, deinstalled ports with kernel modules (fusefs-kmod) and
reinstalled via ports all software configured to run with rc.d/.
link_elf: symbol dev2unit undefined
This error went away with deinstallation of fusefs-*.
Below are results for both SMP and UP kernels (older).
## SMP
% dmesg
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.0-CURRENT #0: Thu Nov 13 07:22:29 CST 2008
root at rorty.grinz.com:/usr/obj/usr/src/sys/RORTY.8
WARNING: WITNESS option enabled, expect reduced performance.
cpu0: Motorola PowerPC 7455 revision 2.1, 1000.00 MHz
cpu0: HID0 8450c0bc<EMCP,TBEN,NAP,DPM,ICE,DCE,SGE,BTIC,LRSTK,FOLD,BHT>
real memory = 2135232512 (2036 MB)
avail memory = 2067054592 (1971 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0: dev=ff87f908 (BSP)
cpu1: dev=ff880bc8
...
lock order reversal:
1st 0xc44048 user map (user map) @ /usr/src/sys/vm/vm_map.c:3115
2nd 0xe1cafc ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2047
KDB: stack backtrace:
0xe08cf930: at kdb_backtrace+0x4c
0xe08cf950: at _witness_debugger+0x3c
0xe08cf970: at witness_checkorder+0x8d0
0xe08cf9d0: at __lockmgr_args+0x23c
0xe08cfa50: at ffs_lock+0x9c
0xe08cfa80: at VOP_LOCK1_APV+0xec
0xe08cfaa0: at _vn_lock+0x84
0xe08cfaf0: at vget+0xdc
0xe08cfb30: at vnode_pager_lock+0x20c
0xe08cfb90: at vm_fault+0x218
0xe08cfca0: at trap_pfault+0x128
0xe08cfce0: at trap+0x1ac
0xe08cfda0: at powerpc_interrupt+0x15c
0xe08cfdd0: user ISI trap by 0x1818f4c: srr1=0x4000d032
r1=0x7fffded0 cr=0x24000048 xer=0 ctr=0
WARNING: /mnt/disk2 was not properly dismounted
lock order reversal:
1st 0xd9d27558 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
2nd 0xe59800 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:263
KDB: stack backtrace:
0xe50ada20: at kdb_backtrace+0x4c
0xe50ada40: at _witness_debugger+0x3c
0xe50ada60: at witness_checkorder+0x8d0
0xe50adac0: at _sx_xlock+0x90
0xe50adaf0: at ufsdirhash_acquire+0x40
0xe50adb10: at ufsdirhash_remove+0x2c
0xe50adb40: at ufs_dirremove+0x100
0xe50adb80: at ufs_remove+0x8c
0xe50adbc0: at VOP_REMOVE_APV+0xe0
0xe50adbe0: at kern_unlinkat+0x1b4
0xe50adca0: at kern_unlink+0x24
0xe50adcc0: at unlink+0x1c
0xe50adce0: at trap+0x460
0xe50adda0: at powerpc_interrupt+0x15c
0xe50addd0: user SC trap by 0x21940198: srr1=0xd032
r1=0x7fffd570 cr=0x40000042 xer=0 ctr=0x21940190
lock order reversal:
1st 0x41866bc ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1064
2nd 0x418438c devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2047
KDB: stack backtrace:
0xe50ad7f0: at kdb_backtrace+0x4c
0xe50ad810: at _witness_debugger+0x3c
0xe50ad830: at witness_checkorder+0x8d0
0xe50ad890: at __lockmgr_args+0xaf8
0xe50ad910: at vop_stdlock+0x48
0xe50ad930: at VOP_LOCK1_APV+0xec
0xe50ad950: at _vn_lock+0x84
0xe50ad9a0: at vget+0xdc
0xe50ad9e0: at devfs_allocv+0x11c
0xe50ada20: at devfs_root+0x5c
0xe50ada60: at vfs_donmount+0x1458
0xe50adca0: at nmount+0xd8
0xe50adce0: at trap+0x460
0xe50adda0: at powerpc_interrupt+0x15c
0xe50addd0: user SC trap by 0x218d2788: srr1=0xd032
r1=0x7fffcd10 cr=0x20000044 xer=0 ctr=0x218d2780
lock order reversal:
1st 0x783be2c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:420
2nd 0xd9e4aad0 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
3rd 0xf719ec ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:541
KDB: stack backtrace:
0xe50c65b0: at kdb_backtrace+0x4c
0xe50c65d0: at _witness_debugger+0x3c
0xe50c65f0: at witness_checkorder+0x8d0
0xe50c6650: at __lockmgr_args+0xaf8
0xe50c66d0: at ffs_lock+0x9c
0xe50c6700: at VOP_LOCK1_APV+0xec
0xe50c6720: at _vn_lock+0x84
0xe50c6770: at ffs_snapshot+0x12ec
0xe50c6970: at ffs_mount+0x10a4
0xe50c6a60: at vfs_donmount+0x108c
0xe50c6ca0: at nmount+0xd8
0xe50c6ce0: at trap+0x460
0xe50c6da0: at powerpc_interrupt+0x15c
0xe50c6dd0: user SC trap by 0x218d8788: srr1=0xf032
r1=0x7fffdb90 cr=0x20004044 xer=0 ctr=0x218d8780
lock order reversal:
1st 0xd9e4aad0 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
2nd 0x799ad5c snaplk (snaplk) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:790
KDB: stack backtrace:
0xe50c65b0: at kdb_backtrace+0x4c
0xe50c65d0: at _witness_debugger+0x3c
0xe50c65f0: at witness_checkorder+0x8d0
0xe50c6650: at __lockmgr_args+0xaf8
0xe50c66d0: at ffs_lock+0x9c
0xe50c6700: at VOP_LOCK1_APV+0xec
0xe50c6720: at _vn_lock+0x84
0xe50c6770: at ffs_snapshot+0x22f8
0xe50c6970: at ffs_mount+0x10a4
0xe50c6a60: at vfs_donmount+0x108c
0xe50c6ca0: at nmount+0xd8
0xe50c6ce0: at trap+0x460
0xe50c6da0: at powerpc_interrupt+0x15c
0xe50c6dd0: user SC trap by 0x218d8788: srr1=0xf032
r1=0x7fffdb90 cr=0x20004044 xer=0 ctr=0x218d8780
## UP
% dmesg
FreeBSD 8.0-CURRENT #0: Tue Nov 11 15:01:01 CST 2008
root at rorty.grinz.com:/usr/obj/usr/src/sys/RORTY.8
WARNING: WITNESS option enabled, expect reduced performance.
cpu0: Motorola PowerPC 7455 revision 2.1, 1000.00 MHz
cpu0: HID0 8450c0bc<EMCP,TBEN,NAP,DPM,ICE,DCE,SGE,BTIC,LRSTK,FOLD,BHT>
real memory = 2135240704 (2036 MB)
avail memory = 2067062784 (1971 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0: dev=ff87f908 (BSP)
cpu1: dev=ff880bc8
...
lock order reversal:
1st 0xc44048 user map (user map) @ /usr/src/sys/vm/vm_map.c:3115
2nd 0xe0aafc ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2047
KDB: stack backtrace:
0xe08cf930: at kdb_backtrace+0x4c
0xe08cf950: at _witness_debugger+0x3c
0xe08cf970: at witness_checkorder+0x8d0
0xe08cf9d0: at __lockmgr_args+0x23c
0xe08cfa50: at ffs_lock+0x9c
0xe08cfa80: at VOP_LOCK1_APV+0xec
0xe08cfaa0: at _vn_lock+0x84
0xe08cfaf0: at vget+0xdc
0xe08cfb30: at vnode_pager_lock+0x20c
0xe08cfb90: at vm_fault+0x218
0xe08cfca0: at trap_pfault+0x128
0xe08cfce0: at trap+0x1ac
0xe08cfda0: at powerpc_interrupt+0x15c
0xe08cfdd0: user ISI trap by 0x1818f4c: srr1=0x4000d032
r1=0x7fffded0 cr=0x24000048 xer=0 ctr=0
WARNING: /mnt/disk2 was not properly dismounted
lock order reversal:
1st 0xd9d27400 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
2nd 0xe41e00 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:263
KDB: stack backtrace:
0xe50c1a20: at kdb_backtrace+0x4c
0xe50c1a40: at _witness_debugger+0x3c
0xe50c1a20: at kdb_backtrace+0x4c
0xe50c1a40: at _witness_debugger+0x3c
0xe50c1a60: at witness_checkorder+0x8d0
0xe50c1ac0: at _sx_xlock+0x90
0xe50c1af0: at ufsdirhash_acquire+0x40
0xe50c1b10: at ufsdirhash_remove+0x2c
0xe50c1b40: at ufs_dirremove+0x100
0xe50c1b80: at ufs_remove+0x8c
0xe50c1bc0: at VOP_REMOVE_APV+0xe0
0xe50c1be0: at kern_unlinkat+0x1b4
0xe50c1ca0: at kern_unlink+0x24
0xe50c1cc0: at unlink+0x1c
0xe50c1ce0: at trap+0x460
0xe50c1da0: at powerpc_interrupt+0x15c
0xe50c1dd0: user SC trap by 0x21940288: srr1=0xd032
r1=0x7fffd570 cr=0x40000042 xer=0 ctr=0x21940280
lock order reversal:
1st 0x4181c0c ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1064
2nd 0x41896bc devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2047
KDB: stack backtrace:
0xe510c7f0: at kdb_backtrace+0x4c
0xe510c810: at _witness_debugger+0x3c
0xe510c830: at witness_checkorder+0x8d0
0xe510c890: at __lockmgr_args+0xaf8
0xe510c910: at vop_stdlock+0x48
0xe510c930: at VOP_LOCK1_APV+0xec
0xe510c950: at _vn_lock+0x84
0xe510c9a0: at vget+0xdc
0xe510c9e0: at devfs_allocv+0x11c
0xe510ca20: at devfs_root+0x5c
0xe510ca60: at vfs_donmount+0x1458
0xe510cca0: at nmount+0xd8
0xe510cce0: at trap+0x460
0xe510cda0: at powerpc_interrupt+0x15c
0xe510cdd0: user SC trap by 0x218d2788: srr1=0xd032
r1=0x7fffcd10 cr=0x20000044 xer=0 ctr=0x218d2780
link_elf: symbol dev2unit undefined
lock order reversal:
link_elf: symbol dev2unit undefined
lock order reversal:
1st 0x88efd1c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:420
2nd 0xd9d5b118 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
3rd 0xf2c05c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:541
KDB: stack backtrace:
0xe511b5b0: at kdb_backtrace+0x4c
0xe511b5d0: at _witness_debugger+0x3c
0xe511b5f0: at witness_checkorder+0x8d0
0xe511b650: at __lockmgr_args+0xaf8
0xe511b6d0: at ffs_lock+0x9c
0xe511b700: at VOP_LOCK1_APV+0xec
0xe511b720: at _vn_lock+0x84
0xe511b770: at ffs_snapshot+0x12ec
0xe511b970: at ffs_mount+0x10a4
0xe511ba60: at vfs_donmount+0x108c
0xe511bca0: at nmount+0xd8
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bdd0: user SC trap by 0x218d8788: srr1=0xf032
r1=0x7fffdb90 cr=0x20004044 xer=0 ctr=0x218d8780
lock order reversal:
1st 0xd9d5b118 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
2nd 0x8923b9c snaplk (snaplk) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:790
KDB: stack backtrace:
0xe511b5b0: at kdb_backtrace+0x4c
0xe511b5d0: at _witness_debugger+0x3c
0xe511b5f0: at witness_checkorder+0x8d0
0xe511b650: at __lockmgr_args+0xaf8
0xe511b6d0: at ffs_lock+0x9c
0xe511b700: at VOP_LOCK1_APV+0xec
0xe511b720: at _vn_lock+0x84
0xe511b770: at ffs_snapshot+0x22f8
0xe511b970: at ffs_mount+0x10a4
0xe511ba60: at vfs_donmount+0x108c
0xe511bca0: at nmount+0xd8
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bdd0: user SC trap by 0x218d8788: srr1=0xf032
r1=0x7fffdb90 cr=0x20004044 xer=0 ctr=0x218d8780
lock order reversal:
1st 0x8923b9c snaplk (snaplk) @ /usr/src/sys/kern/vfs_vnops.c:293
2nd 0x88efd1c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:1584
KDB: stack backtrace:
0xe511b880: at kdb_backtrace+0x4c
0xe511b8a0: at _witness_debugger+0x3c
0xe511b8c0: at witness_checkorder+0x8d0
0xe511b920: at __lockmgr_args+0xaf8
0xe511b9a0: at ffs_snapremove+0x148
0xe511ba10: at softdep_releasefile+0x54
0xe511ba40: at ufs_inactive+0x1c8
0xe511ba80: at VOP_INACTIVE_APV+0xe0
0xe511baa0: at vinactive+0x98
0xe511bae0: at vput+0x21c
0xe511bb30: at vn_close+0x10c
0xe511bb80: at vn_closefile+0x114
0xe511bbf0: at _fdrop+0x60
0xe511bc10: at closef+0x2f8
0xe511bc90: at kern_close+0x144
0xe511bcc0: at close+0x18
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bdd0: user SC trap by 0x2197f088: srr1=0xf032
r1=0x7fffdb60 cr=0x22004028 xer=0 ctr=0x2197f080
lock order reversal:
1st 0x4181c0c ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1207
2nd 0x41895ac syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2147
KDB: stack backtrace:
0xe5206a70: at kdb_backtrace+0x4c
0xe5206a90: at _witness_debugger+0x3c
0xe5206ab0: at witness_checkorder+0x8d0
0xe5206b10: at __lockmgr_args+0xaf8
0xe5206b90: at vop_stdlock+0x48
0xe5206bb0: at VOP_LOCK1_APV+0xec
0xe5206b90: at vop_stdlock+0x48
0xe5206bb0: at VOP_LOCK1_APV+0xec
0xe5206bd0: at _vn_lock+0x84
0xe5206c20: at vrele+0x158
0xe5206c60: at dounmount+0x3b0
0xe5206ca0: at unmount+0x2e4
0xe5206ce0: at trap+0x460
0xe5206da0: at powerpc_interrupt+0x15c
0xe5206dd0: user SC trap by 0x218b1e38: srr1=0xd032
r1=0x7fffd540 cr=0x20004082 xer=0 ctr=0x218b1e30
More information about the freebsd-ppc
mailing list