freebsd crash under I/O - got error messages

Sun Dec 7 20:21:57 UTC 2014

after enabling debug, WITNESS, INVARIANTS, DIAGNOSTICS etc.

just after virtualbox starting VM with windows XP, i've got

what to do next to trace down a problem?

Dec  7 21:15:26 laptop kernel: vboxdrv: fAsync=0 offMin=0x356 offMax=0xe62
Dec  7 21:15:41 laptop kernel: lock order reversal:
Dec  7 21:15:41 laptop kernel: 1st 0xfffff800603305f0 ufs (ufs) @ kern/vfs_syscalls.c:3459
Dec  7 21:15:41 laptop kernel: 2nd 0xfffffe0060df5ad0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262
Dec  7 21:15:41 laptop kernel: 3rd 0xfffff8006037dd50 ufs (ufs) @ kern/vfs_subr.c:2137
Dec  7 21:15:41 laptop kernel: KDB: stack backtrace:
Dec  7 21:15:41 laptop kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00787923e0
Dec  7 21:15:41 laptop kernel: kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0078792490
Dec  7 21:15:41 laptop kernel: witness_checkorder() at witness_checkorder+0xdc2/frame 0xfffffe0078792520
Dec  7 21:15:41 laptop kernel: __lockmgr_args() at __lockmgr_args+0x9ea/frame 0xfffffe0078792660
Dec  7 21:15:41 laptop kernel: ffs_lock() at ffs_lock+0x84/frame 0xfffffe00787926b0
Dec  7 21:15:41 laptop kernel: VOP_LOCK1_APV() at VOP_LOCK1_APV+0xd9/frame 0xfffffe00787926e0
Dec  7 21:15:41 laptop kernel: _vn_lock() at _vn_lock+0xaa/frame 0xfffffe0078792750
Dec  7 21:15:41 laptop kernel: vget() at vget+0x67/frame 0xfffffe0078792790
Dec  7 21:15:41 laptop kernel: vfs_hash_get() at vfs_hash_get+0xe1/frame 0xfffffe00787927e0
Dec  7 21:15:41 laptop kernel: ffs_vgetf() at ffs_vgetf+0x40/frame 0xfffffe0078792870
Dec  7 21:15:41 laptop kernel: softdep_sync_buf() at softdep_sync_buf+0xac0/frame 0xfffffe0078792950
Dec  7 21:15:41 laptop kernel: ffs_syncvnode() at ffs_syncvnode+0x286/frame 0xfffffe00787929d0
Dec  7 21:15:41 laptop kernel: ffs_fsync() at ffs_fsync+0x20/frame 0xfffffe0078792a00
Dec  7 21:15:41 laptop kernel: VOP_FSYNC_APV() at VOP_FSYNC_APV+0xd1/frame 0xfffffe0078792a30
Dec  7 21:15:41 laptop kernel: sys_fsync() at sys_fsync+0x144/frame 0xfffffe0078792aa0
Dec  7 21:15:41 laptop kernel: amd64_syscall() at amd64_syscall+0x216/frame 0xfffffe0078792bb0
Dec  7 21:15:41 laptop kernel: Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0078792bb0
Dec  7 21:15:41 laptop kernel: --- syscall (95, FreeBSD ELF64, sys_fsync), rip = 0x80128e66a, rsp = 0x7fffffffb4d8, rbp = 0x7fffffffb4f0 ---
Dec  7 21:16:30 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207473672192, length=262144)]error = 11
Dec  7 21:16:31 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207474262016, length=950272)]error = 11
Dec  7 21:16:32 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207475507200, length=65536)]error = 11
Dec  7 21:16:33 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207475671040, length=98304)]error = 11
Dec  7 21:16:34 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207709601792, length=32768)]error = 11
Dec  7 21:16:35 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207709667328, length=98304)]error = 11
Dec  7 21:16:36 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207709798400, length=65536)]error = 11
Dec  7 21:16:37 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207709962240, length=32768)]error = 11
Dec  7 21:16:38 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207710650368, length=32768)]error = 11
Dec  7 21:16:39 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207714942976, length=32768)]error = 11
Dec  7 21:16:40 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715041280, length=32768)]error = 11
Dec  7 21:16:41 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715106816, length=32768)]error = 11
Dec  7 21:16:42 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715237888, length=32768)]error = 11
Dec  7 21:16:43 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715467264, length=65536)]error = 11
Dec  7 21:16:44 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715565568, length=131072)]error = 11
Dec  7 21:16:45 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715729408, length=65536)]error = 11
Dec  7 21:16:46 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715827712, length=98304)]error = 11
Dec  7 21:16:47 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207715958784, length=65536)]error = 11
Dec  7 21:16:48 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207716188160, length=65536)]error = 11
Dec  7 21:16:49 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207716548608, length=65536)]error = 11
Dec  7 21:16:50 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207719825408, length=32768)]error = 11
Dec  7 21:16:51 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207719989248, length=65536)]error = 11
Dec  7 21:16:52 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207720087552, length=131072)]error = 11
Dec  7 21:16:53 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207720775680, length=131072)]error = 11
Dec  7 21:16:54 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207720939520, length=32768)]error = 11
Dec  7 21:16:55 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207721005056, length=393216)]error = 11
Dec  7 21:16:56 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207721463808, length=163840)]error = 11
Dec  7 21:16:57 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207721758720, length=65536)]error = 11
Dec  7 21:16:58 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207721857024, length=98304)]error = 11
Dec  7 21:16:59 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207722184704, length=32768)]error = 11
Dec  7 21:17:00 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207722512384, length=32768)]error = 11
Dec  7 21:17:01 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207723167744, length=65536)]error = 11
Dec  7 21:17:02 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207723266048, length=32768)]error = 11
Dec  7 21:17:03 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207723364352, length=65536)]error = 11
Dec  7 21:17:04 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207723495424, length=131072)]error = 11
Dec  7 21:17:05 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207723659264, length=32768)]error = 11
Dec  7 21:17:06 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207723921408, length=32768)]error = 11
Dec  7 21:17:07 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208111108096, length=32768)]error = 11
Dec  7 21:17:08 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208111206400, length=32768)]error = 11
Dec  7 21:17:09 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208111271936, length=32768)]error = 11
Dec  7 21:17:10 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208223830016, length=32768)]error = 11
Dec  7 21:17:11 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208233758720, length=32768)]error = 11
Dec  7 21:17:12 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208233824256, length=98304)]error = 11
Dec  7 21:17:13 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208234250240, length=65536)]error = 11
Dec  7 21:17:14 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208234545152, length=65536)]error = 11
Dec  7 21:17:15 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=231380746240, length=32768)]error = 11
Dec  7 21:17:16 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=231366688768, length=32768)]error = 11
Dec  7 21:17:17 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=231368425472, length=32768)]error = 11
Dec  7 21:17:18 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=262973521920, length=32768)]error = 11
Dec  7 21:17:19 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=233904668672, length=32768)]error = 11
Dec  7 21:17:20 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=233911713792, length=32768)]error = 11
Dec  7 21:17:21 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=233914073088, length=32768)]error = 11
Dec  7 21:17:22 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=233946447872, length=32768)]error = 11
Dec  7 21:17:23 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=234820861952, length=32768)]error = 11
Dec  7 21:17:24 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=234776231936, length=32768)]error = 11
Dec  7 21:17:25 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=235616010240, length=32768)]error = 11
Dec  7 21:17:26 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=235633606656, length=32768)]error = 11
Dec  7 21:17:27 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207441526784, length=65536)]error = 11
Dec  7 21:17:28 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=285122953216, length=32768)]error = 11
Dec  7 21:17:29 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=280897093632, length=32768)]error = 11
Dec  7 21:17:30 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=199790362624, length=4096)]error = 11
Dec  7 21:17:31 laptop kernel: g_vfs_done():ada0d.eli[READ(offset=269781565440, length=32768)]error = 11
Dec  7 21:17:32 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=270651752448, length=32768)]error = 11
Dec  7 21:17:33 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=270652309504, length=32768)]error = 11
Dec  7 21:17:34 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207724150784, length=32768)]error = 11
Dec  7 21:17:35 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=207725461504, length=393216)]error = 11
Dec  7 21:17:36 laptop kernel: g_vfs_done():ada0d.eli[WRITE(offset=208111370240, length=393216)]error = 11
Dec  7 21:17:37 laptop kernel: g_vfs_done():ada0d.eli[READ(offset=228004618240, length=49152)]error = 11
Dec  7 21:17:37 laptop kernel: vnode_pager_getpages: I/O read error
Dec  7 21:17:37 laptop kernel: vm_fault: pager read error, pid 673 (VirtualBox)