Bug about sched_4bsd?
Giovanni Trematerra
giovanni.trematerra at gmail.com
Wed Jan 20 07:32:47 UTC 2010
On Mon, Jan 18, 2010 at 3:58 AM, Attilio Rao <attilio at freebsd.org> wrote:
> 2010/1/17 Kohji Okuno <okuno.kohji at jp.panasonic.com>:
>> Hello,
>>
>> Could you check sched_4bsd.patch, please?
>
> I think, instead, that what needs to happen is to have sched_switch()
> to do a lock handover from sleepq/turnstile spinlock to schedlock.
> That way, if threads are willing to contest on td_lock they will be
> still inhibited.
> I'm not sure if this patch breaks any invariant, if you may test I
> would appreciate:
> http://www.freebsd.org/~attilio/sched_4bsd_schedlock.diff
I stressed an 8-core machine with pho's stress2 kernel stress suite and
your patch seems to break the invariant THREAD_LOCKPTR_ASSERT in
turnstile_claim:subr_turnstile.c
The relevant stack trace are:
Tracing command creat pid 79098 tid 100624 td 0xc8c59af0
kdb_enter(c0c9b0d1,c0c9b0d1,c0c9f546,e978a85c,1,...) at kdb_enter+0x3a
panic(c0c9f546,c9633af0,c0dfc024,c9d3e280,c0f5bd3c,...) at panic+0x136
turnstile_claim(c9d3e280,2,c0ca7376,1f0,4,...) at turnstile_claim+0x148
_rw_try_upgrade(c0f5bd3c,c0ca7376,1f0,e978a990,e978ab88,...) at
_rw_try_upgrade+0xe6
cache_lookup(c99e9bb0,e978ab74,e978ab88,0,0,...) at cache_lookup+0x362
nfs_lookup(e978aa50,e978aa50,e978ab5c,200000,e978ab5c,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e978aa50,e978ab88,1f1,e978ab74,...) at
VOP_LOOKUP_APV+0xa5
lookup(e978ab5c,c0ca7aea,ea,c5,cc093d48,...) at lookup+0x66b
namei(e978ab5c,c08d3aab,c0c94c96,c0c92df9,3,...) at namei+0x55f
kern_statat_vnhook(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at
kern_statat_vnhook+0x72
kern_statat(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat+0x3c
kern_stat(c8c59af0,bfbfdf78,0,e978ac18,2,...) at kern_stat+0x36
stat(c8c59af0,e978acf8,8,c0ca19f2,c0d88230,...) at stat+0x2f
syscall(e978ad38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2817d1a3, esp =
0xbfbfdecc, ebp = 0xbfbfe388 ---
Tracing command creat pid 79122 tid 100202 td 0xc9633af0
sched_switch(c9633af0,0,103,18c,48fb36ba,...) at sched_switch+0x1c5
mi_switch(103,0,c0c9fc0e,2e2,c9d3e280,...) at mi_switch+0x200
turnstile_wait(c9d3e280,0,0,c0f5bd3c,c0f2cb10,...) at turnstile_wait+0x495
_rw_wlock_hard(c0f5bd3c,c9633af0,c0ca7376,209,0,...) at _rw_wlock_hard+0x20c
_rw_wlock(c0f5bd3c,c0ca7376,209,e9147990,e9147b88,...) at _rw_wlock+0xae
cache_lookup(c99e9aa0,e9147b74,e9147b88,0,0,...) at cache_lookup+0x46f
nfs_lookup(e9147a50,e9147a50,e9147b5c,200000,e9147b5c,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e9147a50,e9147b88,1f1,e9147b74,...) at
VOP_LOOKUP_APV+0xa5
lookup(e9147b5c,c0ca7aea,ea,c5,c962caa0,...) at lookup+0x66b
namei(e9147b5c,c08d3aab,c0c94c96,c0c92df9,3,...) at namei+0x55f
kern_statat_vnhook(c9633af0,0,ffffff9c,bfbfdf78,0,...) at
kern_statat_vnhook+0x72
kern_statat(c9633af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat+0x3c
kern_stat(c9633af0,bfbfdf78,0,e9147c18,2,...) at kern_stat+0x36
stat(c9633af0,e9147cf8,8,c0c828f4,c0d88230,...) at stat+0x2f
syscall(e9147d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2817d1a3, esp =
0xbfbfdecc, ebp = 0xbfbfe388 ---
What seems to happen to me is:
The thread 0xc8c59af0 sleeps on the turnstile queue by a previous call
to turnstile_wait.
The thread 0xc9633af0 call turnstile_wait and does a voluntary switch.
The call to thread_lock_set
added from your patch to sched_switch, wakes up the thread 0xc8c59af0
and while thread 0xc9633af0
is in the middle of sched_switch (so before cpu_switch), thread
0xc8c59af0 is running turnstile_claim
that discover the thread 0xc9633af0 not hold a turnstile lock by
THREAD_LOCKPTR_ASSERT invariant assertion.
I attached the entire stack trace.
If needed I have the coredump.
Hope this help.
--
Gianni
-------------- next part --------------
Script started on Tue Jan 19 13:00:03 2010
[Enter `^Ec?' for help]
[ok]
db> bt
Tracing pid 79098 tid 100624 td 0xc8c59af0
kdb_enter(c0c9b0d1,c0c9b0d1,c0c9f546,e978a85c,1,...) at kdb_enter+0x3a
panic(c0c9f546,c9633af0,c0dfc024,c9d3e280,c0f5bd3c,...) at panic+0x136
turnstile_claim(c9d3e280,2,c0ca7376,1f0,4,...) at turnstile_claim+0x148
_rw_try_upgrade(c0f5bd3c,c0ca7376,1f0,e978a990,e978ab88,...) at _rw_try_upgrade+0xe6
cache_lookup(c99e9bb0,e978ab74,e978ab88,0,0,...) at cache_lookup+0x362
nfs_lookup(e978aa50,e978aa50,e978ab5c,200000,e978ab5c,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e978aa50,e978ab88,1f1,e978ab74,...) at VOP_LOOKUP_APV+0xa5
lookup(e978ab5c,c0ca7aea,ea,c5,cc093d48,...) at lookup+0x66b
namei(e978ab5c,c08d3aab,c0c94c96,c0c92df9,3,...) at namei+0x55f
kern_statat_vnhook(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat_vnhook+0x72
kern_statat(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat+0x3c
kern_stat(c8c59af0,bfbfdf78,0,e978ac18,2,...) at kern_stat+0x36
stat(c8c59af0,e978acf8,8,c0ca19f2,c0d88230,...) at stat+0x2f
syscall(e978ad38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2817d1a3, esp = 0xbfbfdecc, ebp = 0xbfbfe388 ---
db> show alllocks
Process 79122 (creat) thread 0xc9633af0 (100202)
shared lockmgr nfs (nfs) r = 0 (0xc99e9af8) locked @ /zoo/gianni/testbox/sys/kern/vfs_subr.c:2091
Process 79104 (thr1) thread 0xc9dae690 (100305)
exclusive sleep mutex process lock (process lock) r = 0 (0xc9c15dd0) locked @ /zoo/gianni/testbox/sys/kern/kern_thr.c:231
Process 79098 (creat) thread 0xc8c59af0 (100624)
shared rw Name Cache (Name Cache) r = 0 (0xc0f5bd3c) locked @ /zoo/gianni/testbox/sys/kern/vfs_cache.c:390
shared lockmgr nfs (nfs) r = 0 (0xc99e9c08) locked @ /zoo/gianni/testbox/sys/kern/vfs_subr.c:2091
db> ps
pid ppid pgrp uid state wmesg wchan cmd
79146 976 976 0 R syslogd
79145 976 976 0 R syslogd
79137 79092 3545 0 R+ creat
79136 79092 3545 0 R+ creat
79134 79092 3545 0 R+ creat
79132 79092 3545 0 R+ creat
79130 79092 3545 0 R+ creat
79128 79092 3545 0 R+ creat
79126 79092 3545 0 R+ CPU 0 creat
79124 79092 3545 0 R+ creat
79122 79092 3545 0 L+ *Name Cac 0xc9d3e280 creat
79120 79092 3545 0 R+ creat
79118 79092 3545 0 R+ creat
79116 79087 3545 0 R+ (threaded) thr1
101255 RunQ thr1
101520 RunQ thr1
101513 RunQ thr1
100279 S uwait 0xc8d69680 thr1
79115 79092 3545 0 R+ CPU 3 creat
--More-- 79113 79092 3545 0 R+ creat
79111 79087 3545 0 R+ (threaded) thr1
101455 RunQ thr1
101448 RunQ thr1
101439 RunQ thr1
101432 RunQ thr1
101424 RunQ thr1
101416 RunQ thr1
101410 RunQ thr1
101403 RunQ thr1
101396 RunQ thr1
101389 RunQ thr1
101380 RunQ thr1
101373 RunQ thr1
101370 RunQ thr1
101363 RunQ thr1
101357 RunQ thr1
101350 RunQ thr1
101316 RunQ thr1
101342 RunQ thr1
--More-- 101340 RunQ thr1
101294 RunQ thr1
101232 RunQ thr1
101268 RunQ thr1
101196 RunQ thr1
101197 RunQ thr1
101338 RunQ thr1
101333 RunQ thr1
101329 RunQ thr1
101325 RunQ thr1
101321 RunQ thr1
101315 RunQ thr1
101310 RunQ thr1
101305 RunQ thr1
101222 RunQ thr1
101213 RunQ thr1
101204 RunQ thr1
101203 RunQ thr1
100465 S uwait 0xcbe0e680 thr1
79110 79092 3545 0 R+ creat
--More-- 79108 79092 3545 0 R+ creat
79107 79087 3545 0 R+ (threaded) thr1
101290 RunQ thr1
101285 RunQ thr1
101279 RunQ thr1
101276 RunQ thr1
101263 RunQ thr1
101244 RunQ thr1
101239 RunQ thr1
101223 RunQ thr1
101214 RunQ thr1
101209 RunQ thr1
101230 RunQ thr1
101583 RunQ thr1
100894 S uwait 0xcbca2880 thr1
79106 79092 3545 0 R+ creat
79104 79087 3545 0 R+ (threaded) thr1
101713 RunQ thr1
101708 RunQ thr1
101705 RunQ thr1
--More-- 101701 RunQ thr1
101696 RunQ thr1
101693 RunQ thr1
101689 RunQ thr1
101684 RunQ thr1
101680 RunQ thr1
101676 RunQ thr1
101672 RunQ thr1
101668 RunQ thr1
101665 RunQ thr1
101661 RunQ thr1
101656 RunQ thr1
101653 RunQ thr1
101649 RunQ thr1
101645 RunQ thr1
101641 RunQ thr1
101637 RunQ thr1
101633 RunQ thr1
101629 RunQ thr1
101625 RunQ thr1
--More-- 101620 RunQ thr1
101617 RunQ thr1
101613 RunQ thr1
101609 RunQ thr1
101604 RunQ thr1
101600 RunQ thr1
101596 RunQ thr1
101590 RunQ thr1
101585 RunQ thr1
101578 RunQ thr1
101574 RunQ thr1
101569 RunQ thr1
101564 RunQ thr1
101558 RunQ thr1
101553 RunQ thr1
101547 RunQ thr1
101542 RunQ thr1
101537 RunQ thr1
101532 RunQ thr1
101527 RunQ thr1
--More-- 101521 RunQ thr1
101515 RunQ thr1
101509 RunQ thr1
101504 RunQ thr1
101499 RunQ thr1
101493 RunQ thr1
101487 RunQ thr1
101481 RunQ thr1
101475 RunQ thr1
101469 RunQ thr1
101463 RunQ thr1
101459 RunQ thr1
101452 RunQ thr1
101445 RunQ thr1
101438 RunQ thr1
101431 RunQ thr1
101425 RunQ thr1
101418 RunQ thr1
101411 RunQ thr1
101404 RunQ thr1
--More-- 101397 RunQ thr1
101390 RunQ thr1
101383 RunQ thr1
101376 RunQ thr1
101366 RunQ thr1
101360 RunQ thr1
101355 RunQ thr1
101348 RunQ thr1
101191 RunQ thr1
101221 RunQ thr1
101245 RunQ thr1
101275 RunQ thr1
101260 RunQ thr1
101195 RunQ thr1
101193 RunQ thr1
101202 RunQ thr1
101194 RunQ thr1
101220 RunQ thr1
101336 RunQ thr1
101330 RunQ thr1
--More-- 101326 RunQ thr1
101320 RunQ thr1
101314 RunQ thr1
101306 RunQ thr1
101296 RunQ thr1
101291 RunQ thr1
101286 RunQ thr1
101282 RunQ thr1
101277 RunQ thr1
101271 RunQ thr1
101265 RunQ thr1
101253 RunQ thr1
101241 RunQ thr1
101235 RunQ thr1
101228 RunQ thr1
101211 RunQ thr1
101205 RunQ thr1
101226 RunQ thr1
101252 RunQ thr1
101266 RunQ thr1
--More-- 100305 Run CPU 4 thr1
79103 79092 3545 0 R+ creat
79101 79092 3545 0 R+ creat
79100 79087 3545 0 R+ (threaded) thr1
101712 RunQ thr1
101709 RunQ thr1
101704 RunQ thr1
101700 RunQ thr1
101697 RunQ thr1
101692 RunQ thr1
101688 RunQ thr1
101685 RunQ thr1
101681 RunQ thr1
101677 RunQ thr1
101673 RunQ thr1
101669 RunQ thr1
101664 RunQ thr1
101660 RunQ thr1
101657 RunQ thr1
101652 RunQ thr1
--More-- 101648 RunQ thr1
101644 RunQ thr1
101640 RunQ thr1
101636 RunQ thr1
101632 RunQ thr1
101628 RunQ thr1
101624 RunQ thr1
101621 RunQ thr1
101616 RunQ thr1
101612 RunQ thr1
101608 RunQ thr1
101605 RunQ thr1
101601 RunQ thr1
101597 RunQ thr1
101593 RunQ thr1
101589 RunQ thr1
101584 RunQ thr1
101579 RunQ thr1
101573 RunQ thr1
101568 RunQ thr1
--More-- 101563 RunQ thr1
101559 RunQ thr1
101555 RunQ thr1
101550 RunQ thr1
101545 RunQ thr1
101540 RunQ thr1
101536 RunQ thr1
101531 RunQ thr1
101526 RunQ thr1
101522 RunQ thr1
101516 RunQ thr1
101510 RunQ thr1
101506 RunQ thr1
101501 RunQ thr1
101495 RunQ thr1
101489 RunQ thr1
101483 RunQ thr1
101477 RunQ thr1
101471 RunQ thr1
101465 RunQ thr1
--More-- 101457 RunQ thr1
101450 RunQ thr1
101443 RunQ thr1
101436 RunQ thr1
101427 RunQ thr1
101420 RunQ thr1
101413 RunQ thr1
101407 RunQ thr1
101399 RunQ thr1
101392 RunQ thr1
101385 RunQ thr1
101379 RunQ thr1
101372 RunQ thr1
101365 RunQ thr1
101359 RunQ thr1
101354 RunQ thr1
101349 RunQ thr1
101344 RunQ thr1
101238 RunQ thr1
101303 RunQ thr1
--More-- 101249 RunQ thr1
101225 RunQ thr1
101216 RunQ thr1
101201 RunQ thr1
101190 RunQ thr1
101339 RunQ thr1
101337 RunQ thr1
100726 Run CPU 5 thr1
79098 79092 3545 0 R+ CPU 1 creat
79096 79087 3545 0 R+ (threaded) thr1
101710 RunQ thr1
101706 RunQ thr1
101702 RunQ thr1
101698 RunQ thr1
101695 RunQ thr1
101691 RunQ thr1
101686 RunQ thr1
101682 RunQ thr1
101678 RunQ thr1
101674 RunQ thr1
--More-- 101670 RunQ thr1
101666 RunQ thr1
101662 RunQ thr1
101659 RunQ thr1
101654 RunQ thr1
101650 RunQ thr1
101646 RunQ thr1
101642 RunQ thr1
101638 RunQ thr1
101634 RunQ thr1
101630 RunQ thr1
101626 RunQ thr1
101622 RunQ thr1
101618 RunQ thr1
101614 RunQ thr1
101610 RunQ thr1
101606 RunQ thr1
101602 RunQ thr1
101598 RunQ thr1
101594 RunQ thr1
--More-- 101591 RunQ thr1
101586 RunQ thr1
101580 RunQ thr1
101575 RunQ thr1
101570 RunQ thr1
101566 RunQ thr1
101561 RunQ thr1
101556 RunQ thr1
101551 RunQ thr1
101546 RunQ thr1
101541 RunQ thr1
101535 RunQ thr1
101530 RunQ thr1
101525 RunQ thr1
101519 RunQ thr1
101514 RunQ thr1
101507 RunQ thr1
101503 RunQ thr1
101497 RunQ thr1
101491 RunQ thr1
--More-- 101484 RunQ thr1
101478 RunQ thr1
101473 RunQ thr1
101468 RunQ thr1
101460 RunQ thr1
101453 RunQ thr1
101446 RunQ thr1
101440 RunQ thr1
101433 RunQ thr1
101426 RunQ thr1
101419 RunQ thr1
101412 RunQ thr1
101406 RunQ thr1
101400 RunQ thr1
101393 RunQ thr1
101386 RunQ thr1
101378 RunQ thr1
101371 RunQ thr1
101364 RunQ thr1
101358 RunQ thr1
--More-- 101352 RunQ thr1
101346 RunQ thr1
101270 RunQ thr1
101199 RunQ thr1
101192 RunQ thr1
101299 RunQ thr1
101302 RunQ thr1
101327 RunQ thr1
101322 RunQ thr1
101317 RunQ thr1
101311 RunQ thr1
101301 RunQ thr1
101292 RunQ thr1
101287 RunQ thr1
101281 RunQ thr1
101278 RunQ thr1
101273 RunQ thr1
101258 RunQ thr1
101251 RunQ thr1
101243 RunQ thr1
--More-- 101237 RunQ thr1
101224 RunQ thr1
101218 RunQ thr1
101231 RunQ thr1
101229 RunQ thr1
101257 RunQ thr1
100812 Run CPU 7 thr1
79095 79092 3545 0 R+ CPU 2 creat
79093 79087 3545 0 R+ (threaded) thr1
101588 Inactv thr1
101582 RunQ thr1
101577 RunQ thr1
101572 RunQ thr1
101567 RunQ thr1
101562 RunQ thr1
101557 RunQ thr1
101552 RunQ thr1
101548 RunQ thr1
101543 RunQ thr1
101538 RunQ thr1
--More-- 101533 RunQ thr1
101528 RunQ thr1
101523 RunQ thr1
101517 RunQ thr1
101511 RunQ thr1
101505 RunQ thr1
101500 RunQ thr1
101494 RunQ thr1
101488 RunQ thr1
101482 RunQ thr1
101476 RunQ thr1
101470 RunQ thr1
101464 RunQ thr1
101458 RunQ thr1
101451 RunQ thr1
101444 RunQ thr1
101437 RunQ thr1
101429 RunQ thr1
101422 RunQ thr1
101415 RunQ thr1
--More-- 101408 RunQ thr1
101401 RunQ thr1
101394 RunQ thr1
101388 RunQ thr1
101382 RunQ thr1
101375 RunQ thr1
101368 RunQ thr1
101217 RunQ thr1
101215 RunQ thr1
101212 RunQ thr1
101198 RunQ thr1
101236 RunQ thr1
101262 RunQ thr1
101261 RunQ thr1
100454 RunQ thr1
79092 79076 3545 0 S+ wait 0xcc920550 creat
79090 79087 3545 0 R+ (threaded) thr1
101715 RunQ thr1
101711 RunQ thr1
101707 RunQ thr1
--More-- 101703 RunQ thr1
101699 RunQ thr1
101694 RunQ thr1
101690 RunQ thr1
101687 RunQ thr1
101683 RunQ thr1
101679 RunQ thr1
101675 RunQ thr1
101671 RunQ thr1
101667 RunQ thr1
101663 RunQ thr1
101658 RunQ thr1
101655 RunQ thr1
101651 RunQ thr1
101647 RunQ thr1
101643 RunQ thr1
101639 RunQ thr1
101635 RunQ thr1
101631 RunQ thr1
101627 RunQ thr1
--More-- 101623 RunQ thr1
101619 RunQ thr1
101615 RunQ thr1
101611 RunQ thr1
101607 RunQ thr1
101603 RunQ thr1
101599 RunQ thr1
101595 RunQ thr1
101592 RunQ thr1
101587 RunQ thr1
101581 RunQ thr1
101576 RunQ thr1
101571 RunQ thr1
101565 RunQ thr1
101560 RunQ thr1
101554 RunQ thr1
101549 RunQ thr1
101544 RunQ thr1
101539 RunQ thr1
101534 RunQ thr1
--More-- 101529 RunQ thr1
101524 RunQ thr1
101518 RunQ thr1
101512 RunQ thr1
101508 RunQ thr1
101502 RunQ thr1
101496 RunQ thr1
101490 RunQ thr1
101485 RunQ thr1
101479 RunQ thr1
101474 RunQ thr1
101467 RunQ thr1
101461 RunQ thr1
101454 RunQ thr1
101447 RunQ thr1
101441 RunQ thr1
101434 RunQ thr1
101428 RunQ thr1
101421 RunQ thr1
101414 RunQ thr1
--More-- 101405 RunQ thr1
101398 RunQ thr1
101391 RunQ thr1
101384 RunQ thr1
101377 RunQ thr1
101367 RunQ thr1
101361 RunQ thr1
101353 RunQ thr1
101347 RunQ thr1
101343 RunQ thr1
101259 RunQ thr1
101308 RunQ thr1
101334 RunQ thr1
101331 RunQ thr1
101328 RunQ thr1
101324 RunQ thr1
101319 RunQ thr1
101312 RunQ thr1
101307 RunQ thr1
101297 RunQ thr1
--More-- 101288 RunQ thr1
101284 RunQ thr1
101280 RunQ thr1
101274 RunQ thr1
101269 RunQ thr1
101254 RunQ thr1
101250 RunQ thr1
101240 RunQ thr1
101234 RunQ thr1
101233 RunQ thr1
101200 RunQ thr1
101210 RunQ thr1
101227 RunQ thr1
101248 RunQ thr1
101256 RunQ thr1
101264 RunQ thr1
101267 RunQ thr1
100320 Run CPU 6 thr1
79088 79087 3545 0 R+ (threaded) thr1
101498 RunQ thr1
--More-- 101492 RunQ thr1
101486 RunQ thr1
101480 RunQ thr1
101472 RunQ thr1
101466 RunQ thr1
101462 RunQ thr1
101456 RunQ thr1
101449 RunQ thr1
101442 RunQ thr1
101435 RunQ thr1
101430 RunQ thr1
101423 RunQ thr1
101417 RunQ thr1
101409 RunQ thr1
101402 RunQ thr1
101395 RunQ thr1
101387 RunQ thr1
101381 RunQ thr1
101374 RunQ thr1
101369 RunQ thr1
--More-- 101362 RunQ thr1
101356 RunQ thr1
101351 RunQ thr1
101345 RunQ thr1
101246 RunQ thr1
101341 RunQ thr1
101295 RunQ thr1
101272 RunQ thr1
101247 RunQ thr1
101219 RunQ thr1
101300 RunQ thr1
101335 RunQ thr1
101332 RunQ thr1
101304 RunQ thr1
101323 RunQ thr1
101318 RunQ thr1
101313 RunQ thr1
101309 RunQ thr1
101298 RunQ thr1
101293 RunQ thr1
--More-- 101289 RunQ thr1
101283 RunQ thr1
101208 RunQ thr1
101207 RunQ thr1
101206 RunQ thr1
101242 RunQ thr1
100464 S uwait 0xcc091280 thr1
79087 79078 3545 0 S+ wait 0xccdc8550 thr1
79078 3554 3545 0 S+ nanslp 0xc0df86c4 initial thread
79077 3554 3545 0 S+ nanslp 0xc0df86c4 mkdir
79076 3554 3545 0 S+ nanslp 0xc0df86c4 creat
79074 3554 3545 0 S+ nanslp 0xc0df86c4 rw
77671 0 0 0 SL - 0xc0f61840 [nfsiod 0]
3554 3553 3545 0 S+ wait 0xc9266000 run
3553 3552 3545 0 SW+ wait 0xcbc4baa0 run
3552 3545 3545 0 S+ nanslp 0xc0df86c4 run
3545 1332 3545 0 SW+ wait 0xcbc527f8 sh
1847 0 0 0 DL mdwait 0xc91b9800 [md0]
1332 1330 1332 0 SW+ pause 0xc962e5a8 csh
1330 1 1330 0 SWs+ wait 0xc95377f8 login
--More-- 1252 1 1252 0 Ss select 0xc9b239a4 sshd
976 1 976 0 Ss select 0xc9b222a4 syslogd
799 1 799 0 Ss select 0xc91817a4 devd
20 0 0 0 DL - 0xc0df8524 [schedcpu]
19 0 0 0 DL flowclea 0xc0f5c148 [flowcleaner]
18 0 0 0 DL sdflush 0xc0f678a0 [softdepflush]
17 0 0 0 DL syncer 0xc0f5bf54 [syncer]
16 0 0 0 DL vlruwt 0xc908ad48 [vnlru]
15 0 0 0 DL psleep 0xc0f5bc88 [bufdaemon]
9 0 0 0 DL pgzero 0xc0f68a14 [pagezero]
8 0 0 0 DL psleep 0xc0f68644 [vmdaemon]
7 0 0 0 DL psleep 0xc0f6860c [pagedaemon]
6 0 0 0 DL - 0xc8c1e23c [fdc0]
14 0 0 0 DL (threaded) [usb]
100062 D - 0xc8bb1d0c [usbus4]
100061 D - 0xc8bb1cdc [usbus4]
100060 D - 0xc8bb1cac [usbus4]
100059 D - 0xc8bb1c7c [usbus4]
100058 D - 0xc8b89dac [usbus3]
100057 D - 0xc8b89d7c [usbus3]
--More-- 100056 D - 0xc8b89d4c [usbus3]
100055 D - 0xc8b89d1c [usbus3]
100053 D - 0xc8b67dac [usbus2]
100052 D - 0xc8b67d7c [usbus2]
100051 D - 0xc8b67d4c [usbus2]
100050 D - 0xc8b67d1c [usbus2]
100048 D - 0xc8b3fdac [usbus1]
100047 D - 0xc8b3fd7c [usbus1]
100046 D - 0xc8b3fd4c [usbus1]
100045 D - 0xc8b3fd1c [usbus1]
100043 D - 0xc8b02dac [usbus0]
100042 D - 0xc8b02d7c [usbus0]
100041 D - 0xc8b02d4c [usbus0]
100040 D - 0xc8b02d1c [usbus0]
5 0 0 0 DL ccb_scan 0xc0dc48d4 [xpt_thrd]
13 0 0 0 DL - 0xc0df8524 [yarrow]
4 0 0 0 DL - 0xc0df62e4 [g_down]
3 0 0 0 DL - 0xc0df62e0 [g_up]
2 0 0 0 DL - 0xc0df62d8 [g_event]
12 0 0 0 RL (threaded) [intr]
--More-- 100066 I [irq1: atkbd0]
100064 RunQ [swi0: uart uart]
100063 I [irq14: ata0]
100054 I [irq16: uhci3]
100049 I [irq18: fxp0 uhci2]
100044 I [irq19: uhci1+]
100039 I [irq17: uhci0 ehci0]
100036 I [irq9: acpi0]
100035 I [swi2: cambio]
100033 I [swi6: task queue]
100032 I [swi6: Giant taskq]
100030 I [swi5: +]
100020 I [swi3: vm]
100019 I [swi4: clock]
100018 RunQ [swi4: clock]
100017 RunQ [swi4: clock]
100016 RunQ [swi4: clock]
100015 I [swi4: clock]
100014 RunQ [swi4: clock]
100013 I [swi4: clock]
--More-- 100012 RunQ [swi4: clock]
100011 I [swi1: netisr 0]
11 0 0 0 RL (threaded) [idle]
100010 CanRun [idle: cpu0]
100009 CanRun [idle: cpu1]
100008 CanRun [idle: cpu2]
100007 CanRun [idle: cpu3]
100006 CanRun [idle: cpu4]
100005 CanRun [idle: cpu5]
100004 CanRun [idle: cpu6]
100003 CanRun [idle: cpu7]
1 0 1 0 SLs wait 0xc8597d48 [init]
10 0 0 0 DL audit_wo 0xc0f671c0 [audit]
0 0 0 0 DLs (threaded) [kernel]
100038 D - 0xc8abad80 [em1 taskq]
100037 D - 0xc8a99980 [em0 taskq]
100031 D - 0xc899fa80 [thread taskq]
100029 D - 0xc89a0080 [kqueue taskq]
100028 D - 0xc89a2080 [acpi_task_2]
100027 D - 0xc89a2080 [acpi_task_1]
--More-- 100026 D - 0xc89a2080 [acpi_task_0]
100024 D - 0xc858f080 [firmware taskq]
100000 D sched 0xc0df63c0 [swapper]
79081 79074 3545 0 Z+ rw
79089 79077 3545 0 Z+ mkdir
79075 3554 3545 0 Z+ swap
79080 3554 3545 0 Z+ tcp
79079 3554 3545 0 Z+ udp
db> shio ow allpcpu
Current CPU: 1
cpuid = 0
dynamic pcpu = 0x661400
curthread = 0xcbeac230: pid 79126 "creat"
curpcb = 0xe9eb9d90
fpcurthread = none
idlethread = 0xc85a6230: pid 11 "idle: cpu0"
APIC ID = 0
currentldt = 0x50
spin locks held:
cpuid = 1
dynamic pcpu = 0x5530400
curthread = 0xc8c59af0: pid 79098 "creat"
curpcb = 0xe978ad90
fpcurthread = none
idlethread = 0xc85a6460: pid 11 "idle: cpu1"
APIC ID = 1
currentldt = 0x50
--More-- spin locks held:
cpuid = 2
dynamic pcpu = 0x5533400
curthread = 0xcbed6690: pid 79095 "creat"
curpcb = 0xe9c6bd90
fpcurthread = none
idlethread = 0xc859a000: pid 11 "idle: cpu2"
APIC ID = 2
currentldt = 0x50
spin locks held:
cpuid = 3
dynamic pcpu = 0x5536400
curthread = 0xc9ae6000: pid 79115 "creat"
curpcb = 0xe9b42d90
fpcurthread = none
idlethread = 0xc859a230: pid 11 "idle: cpu3"
APIC ID = 3
currentldt = 0x50
--More-- spin locks held:
cpuid = 4
dynamic pcpu = 0x5539400
curthread = 0xc9dae690: pid 79104 "thr1"
curpcb = 0xe92ccd90
fpcurthread = none
idlethread = 0xc859a460: pid 11 "idle: cpu4"
APIC ID = 4
currentldt = 0x50
spin locks held:
cpuid = 5
dynamic pcpu = 0x553c400
curthread = 0xc942c000: pid 79100 "thr1"
curpcb = 0xe9a31d90
fpcurthread = none
idlethread = 0xc859a690: pid 11 "idle: cpu5"
APIC ID = 5
currentldt = 0x50
--More-- spin locks held:
cpuid = 6
dynamic pcpu = 0x553f400
curthread = 0xc9e26d20: pid 79090 "thr1"
curpcb = 0xe9301d90
fpcurthread = none
idlethread = 0xc859a8c0: pid 11 "idle: cpu6"
APIC ID = 6
currentldt = 0x50
spin locks held:
cpuid = 7
dynamic pcpu = 0x5542400
curthread = 0xc9adb460: pid 79096 "thr1"
curpcb = 0xe9bead90
fpcurthread = none
idlethread = 0xc859aaf0: pid 11 "idle: cpu7"
APIC ID = 7
currentldt = 0x50
--More-- spin locks held:
db> show lockedvnodes
No such command
db> show lockedvnodess
Locked vnodes
0xc99e9bb0: tag nfs, type VDIR
usecount 1, writecount 0, refcount 2 mountedhere 0
flags ()
lock type nfs: SHARED (count 1)
fileid -377969560 fsid 0xc0cbc89d
0xc99e9aa0: tag nfs, type VDIR
usecount 1, writecount 0, refcount 2 mountedhere 0
flags ()
lock type nfs: SHARED (count 1)
fileid -377969560 fsid 0xc0cbc89d
db> show mount
0xc91e8ca8 192.168.5.1:/zoo/lion1 on / (nfs)
0xc91e9000 devfs on /dev (devfs)
0xc9c0b510 192.168.5.1:/zoo/gianni on /zoo/gianni (nfs)
0xcb6e3a20 /dev/md0 on /root/tmp (ufs)
More info: show mount <addr>
db> allt
Tracing command syslogd pid 79146 tid 100606 td 0xc93888c0
sched_switch(c93888c0,0,104,191,f32307c1,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c93888c0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c93888c0,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e973bb64,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,cc16a480,...) at tty_wait+0x71
ttydev_write(c85e9b00,cc16a480,0) at ttydev_write+0xcc
ttyconsdev_write(c85e9b00,cc16a480,0,0,0,...) at ttyconsdev_write+0x28
devfs_write_f(c93eb6c8,cc16a480,c8575280,0,c93888c0,...) at devfs_write_f+0x9e
dofilewrite(cc16a480,ffffffff,ffffffff,0,c93eb6c8,...) at dofilewrite+0x95
kern_writev(c93888c0,8,cc16a480,cc16a480,bfbfce0c,...) at kern_writev+0x58
writev(c93888c0,e973bcf8,c,c0ca1bb3,c0d87adc,...) at writev+0x46
syscall(e973bd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (121, FreeBSD ELF32, writev), eip = 0x281773eb, esp = 0xbfbfcd3c, ebp = 0xbfbfcdb8 ---
Tracing command syslogd pid 79145 tid 101113 td 0xc9338d20
--More-- sched_switch(c9338d20,0,104,191,f3204514,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c9338d20,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c9338d20,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9fd0b64,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,cccd0b80,...) at tty_wait+0x71
ttydev_write(c85e9b00,cccd0b80,0) at ttydev_write+0xcc
ttyconsdev_write(c85e9b00,cccd0b80,0,0,0,...) at ttyconsdev_write+0x28
devfs_write_f(c93eb540,cccd0b80,c8575280,0,c9338d20,...) at devfs_write_f+0x9e
dofilewrite(cccd0b80,ffffffff,ffffffff,0,c93eb540,...) at dofilewrite+0x95
kern_writev(c9338d20,8,cccd0b80,cccd0b80,bfbfce0c,...) at kern_writev+0x58
writev(c9338d20,e9fd0cf8,c,c0ca1bb3,c0d87adc,...) at writev+0x46
syscall(e9fd0d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (121, FreeBSD ELF32, writev), eip = 0x281773eb, esp = 0xbfbfcd3c, ebp = 0xbfbfcdb8 ---
Tracing command creat pid 79137 tid 100600 td 0xc950e000
sched_switch(c950e000,0,104,191,d3b235a5,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
--More-- sleepq_switch(c950e000,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c950e000,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9729b60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9729c58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e9729c58,c9bada80,0,c950e000,...) at devfs_write_f+0x9e
dofilewrite(e9729c58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(c950e000,2,e9729c58,e9729c78,1,...) at kern_writev+0x58
write(c950e000,e9729cf8,c,c0ca19f2,c0d86e10,...) at write+0x4f
syscall(e9729d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79136 tid 100841 td 0xc9adb230
sched_switch(c9adb230,0,104,191,d3b64993,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c9adb230,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c9adb230,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9c9bb60,101,0,...) at sleepq_wait_sig+0x17
--More-- _cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9c9bc58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e9c9bc58,c9bada80,0,c9adb230,...) at devfs_write_f+0x9e
dofilewrite(e9c9bc58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(c9adb230,2,e9c9bc58,e9c9bc78,1,...) at kern_writev+0x58
write(c9adb230,e9c9bcf8,c,c0ca19f2,c0d86e10,...) at write+0x4f
syscall(e9c9bd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79134 tid 101064 td 0xcc421690
sched_switch(cc421690,0,104,191,d3b810e2,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cc421690,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,cc421690,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9f3db60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9f3dc58,0,0,0,...) at ttydev_write+0xcc
--More-- devfs_write_f(c94a7d20,e9f3dc58,c9bada80,0,cc421690,...) at devfs_write_f+0x9e
dofilewrite(e9f3dc58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(cc421690,2,e9f3dc58,e9f3dc78,1,...) at kern_writev+0x58
write(cc421690,e9f3dcf8,c,cc421690,c0d86e10,...) at write+0x4f
syscall(e9f3dd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79132 tid 100424 td 0xcbe28690
sched_switch(cbe28690,0,104,191,d3b42df6,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cbe28690,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,cbe28690,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e94c4b60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,7,...) at tty_wait+0x71
ttydev_write(c8cc6900,e94c4c58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e94c4c58,c9bada80,0,cbe28690,...) at devfs_write_f+0x9e
dofilewrite(e94c4c58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(cbe28690,2,e94c4c58,e94c4c78,1,...) at kern_writev+0x58
--More-- write(cbe28690,e94c4cf8,c,cbe28690,c0d86e10,...) at write+0x4f
syscall(e94c4d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79130 tid 100098 td 0xc9620d20
sched_switch(c9620d20,0,104,191,d3b34972,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c9620d20,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c9620d20,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e8f8db60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e8f8dc58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e8f8dc58,c9bada80,0,c9620d20,...) at devfs_write_f+0x9e
dofilewrite(e8f8dc58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(c9620d20,2,e8f8dc58,e8f8dc78,1,...) at kern_writev+0x58
write(c9620d20,e8f8dcf8,c,56c,c0d86e10,...) at write+0x4f
syscall(e8f8dd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--More-- --- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79128 tid 100813 td 0xc947faf0
sched_switch(c947faf0,0,104,191,d3b3a81f,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c947faf0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c947faf0,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9bedb60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9bedc58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e9bedc58,c9bada80,0,c947faf0,...) at devfs_write_f+0x9e
dofilewrite(e9bedc58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(c947faf0,2,e9bedc58,e9bedc78,1,...) at kern_writev+0x58
write(c947faf0,e9bedcf8,c,c0ca19f2,c0d86e10,...) at write+0x4f
syscall(e9bedd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79126 tid 101020 td 0xcbeac230
--More-- cpustop_handler(1,e9eb9830,c0bc8fd6,80000000,369e99,...) at cpustop_handler+0x32
ipi_nmi_handler(80000000,369e99,0,0,cc378d48,...) at ipi_nmi_handler+0x2f
trap(e9eb983c) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc088dc72, esp = 0xe9eb987c, ebp = 0xe9eb989c ---
_rw_rlock(c0f5bd3c,c0ca7376,186,c9bada80,cbeac230,...) at _rw_rlock+0x152
cache_lookup(c96f1880,e9eb9bbc,e9eb9bd0,e9eb9bbc,c9bada80,...) at cache_lookup+0x46
vfs_cache_lookup(e9eb9988,e9eb9988,e9eb9ba4,80000,e9eb9ba4,...) at vfs_cache_lookup+0xad
VOP_LOOKUP_APV(c0da8a80,e9eb9988,e9eb9bd0,1f1,e9eb9bbc,...) at VOP_LOOKUP_APV+0xa5
lookup(e9eb9ba4,c0ca7aea,ea,c5,ffffff9c,...) at lookup+0x66b
namei(e9eb9ba4,c0ca3f9c,2,38,0,...) at namei+0x55f
vn_open_cred(e9eb9ba4,e9eb9c5c,1b0,0,c9bada80,...) at vn_open_cred+0x90
vn_open(e9eb9ba4,e9eb9c5c,1b0,c9486c78,c0880239,...) at vn_open+0x3b
kern_openat(cbeac230,ffffff9c,bfbfe8d4,0,602,...) at kern_openat+0x11f
kern_open(cbeac230,bfbfe8d4,0,601,1b0,...) at kern_open+0x35
open(cbeac230,e9eb9cf8,c,c0ca19b6,c0d86e2c,...) at open+0x30
syscall(e9eb9d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (5, FreeBSD ELF32, open), eip = 0x2817d203, esp = 0xbfbfe87c, ebp = 0xbfbfe898 ---
--More-- Tracing command creat pid 79124 tid 100847 td 0xcbff5000
sched_switch(cbff5000,0,104,191,d3b57571,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cbff5000,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,cbff5000,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9cadb60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9cadc58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e9cadc58,c9bada80,0,cbff5000,...) at devfs_write_f+0x9e
dofilewrite(e9cadc58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(cbff5000,2,e9cadc58,e9cadc78,1,...) at kern_writev+0x58
write(cbff5000,e9cadcf8,c,56c,c0d86e10,...) at write+0x4f
syscall(e9cadd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79122 tid 100202 td 0xc9633af0
sched_switch(c9633af0,0,103,18c,48fb36ba,...) at sched_switch+0x1c5
mi_switch(103,0,c0c9fc0e,2e2,c9d3e280,...) at mi_switch+0x200
--More-- turnstile_wait(c9d3e280,0,0,c0f5bd3c,c0f2cb10,...) at turnstile_wait+0x495
_rw_wlock_hard(c0f5bd3c,c9633af0,c0ca7376,209,0,...) at _rw_wlock_hard+0x20c
_rw_wlock(c0f5bd3c,c0ca7376,209,e9147990,e9147b88,...) at _rw_wlock+0xae
cache_lookup(c99e9aa0,e9147b74,e9147b88,0,0,...) at cache_lookup+0x46f
nfs_lookup(e9147a50,e9147a50,e9147b5c,200000,e9147b5c,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e9147a50,e9147b88,1f1,e9147b74,...) at VOP_LOOKUP_APV+0xa5
lookup(e9147b5c,c0ca7aea,ea,c5,c962caa0,...) at lookup+0x66b
namei(e9147b5c,c08d3aab,c0c94c96,c0c92df9,3,...) at namei+0x55f
kern_statat_vnhook(c9633af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat_vnhook+0x72
kern_statat(c9633af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat+0x3c
kern_stat(c9633af0,bfbfdf78,0,e9147c18,2,...) at kern_stat+0x36
stat(c9633af0,e9147cf8,8,c0c828f4,c0d88230,...) at stat+0x2f
syscall(e9147d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2817d1a3, esp = 0xbfbfdecc, ebp = 0xbfbfe388 ---
Tracing command creat pid 79120 tid 100925 td 0xcadeb8c0
sched_switch(cadeb8c0,0,104,191,d3b37420,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cadeb8c0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
--More-- sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,cadeb8c0,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9d97b60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9d97c58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e9d97c58,c9bada80,0,cadeb8c0,...) at devfs_write_f+0x9e
dofilewrite(e9d97c58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(cadeb8c0,2,e9d97c58,e9d97c78,1,...) at kern_writev+0x58
write(cadeb8c0,e9d97cf8,c,c0ca19f2,c0d86e10,...) at write+0x4f
syscall(e9d97d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79118 tid 100420 td 0xc95a5000
sched_switch(c95a5000,0,104,191,d3b76a35,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c95a5000,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c95a5000,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e94b2b60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
--More-- tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e94b2c58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e94b2c58,c9bada80,0,c95a5000,...) at devfs_write_f+0x9e
dofilewrite(e94b2c58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(c95a5000,2,e94b2c58,e94b2c78,1,...) at kern_writev+0x58
write(c95a5000,e94b2cf8,c,c0ca19f2,c0d86e10,...) at write+0x4f
syscall(e94b2d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command thr1 pid 79116 tid 101255 td 0xc9a28690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79116 tid 101520 td 0xccde2690
sched_switch(ccde2690,0,104,191,47be0551,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(ccde2690,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ab9980,0,c0c9c89e,100,0,...) at sleepq_wait_sig+0x17
_sleep(c8ab9980,c0df92b0,100,c0c9c89e,0,...) at _sleep+0x354
--More-- _do_lock_umutex(0,2,280b40e0,ccde2690,c089e5d5,...) at _do_lock_umutex+0x88c
do_lock_umutex(2,0,ccde2690,ea552c80,c08cd5d0) at do_lock_umutex+0x4d
__umtx_op_wait_umutex(ccde2690,ea552cf8,ea552d2c,c0bc8d53,ccde2690,...) at __umtx_op_wait_umutex+0x50
_umtx_op(ccde2690,ea552cf8,14,c0ca19b6,c0d89f48,...) at _umtx_op+0x27
syscall(ea552d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280b1317, esp = 0xb454aeac, ebp = 0xb454aed8 ---
Tracing command thr1 pid 79116 tid 101513 td 0xccf668c0
sched_switch(ccf668c0,0,104,191,47bb9485,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(ccf668c0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(cbf46280,0,c0c9c89e,100,0,...) at sleepq_wait_sig+0x17
_sleep(cbf46280,c0df92b0,100,c0c9c89e,0,...) at _sleep+0x354
_do_lock_umutex(0,2,280b40e0,ccf668c0,c089e5d5,...) at _do_lock_umutex+0x88c
do_lock_umutex(2,0,ccf668c0,ea39fc80,c08cd5d0) at do_lock_umutex+0x4d
__umtx_op_wait_umutex(ccf668c0,ea39fcf8,ea39fd2c,c0bc8d53,ccf668c0,...) at __umtx_op_wait_umutex+0x50
_umtx_op(ccf668c0,ea39fcf8,14,c0ca19b6,c0d89f48,...) at _umtx_op+0x27
syscall(ea39fd38) at syscall+0x2a3
--More-- Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280b1317, esp = 0xb464beac, ebp = 0xb464bed8 ---
Tracing command thr1 pid 79116 tid 100279 td 0xc9d3c000
sched_switch(c9d3c000,0,104,191,47bec689,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c9d3c000,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8d69680,0,c0c9c917,100,0,...) at sleepq_wait_sig+0x17
_sleep(c8d69680,c0dfa840,100,c0c9c917,0,...) at _sleep+0x354
do_wait(0,0,0,e927ec80,c08cd5d0) at do_wait+0x511
__umtx_op_wait(c9d3c000,e927ecf8,e927ed2c,c0bc8d53,c9d3c000,...) at __umtx_op_wait+0x5f
_umtx_op(c9d3c000,e927ecf8,14,c0ca2830,c0d89f48,...) at _umtx_op+0x27
syscall(e927ed38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280b1317, esp = 0xbfbfe4ac, ebp = 0xbfbfe4c8 ---
Tracing command creat pid 79115 tid 100754 td 0xc9ae6000
cpustop_handler(8,e9b42ba8,c0bc8fd6,e9b42b38,c087f934,...) at cpustop_handler+0x32
ipi_nmi_handler(e9b42b38,c087f934,c0df87b4,4,cc4fc2a8,...) at ipi_nmi_handler+0x2f
--More-- trap(e9b42bb4) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc088dc80, esp = 0xe9b42bf4, ebp = 0xe9b42c14 ---
_rw_rlock(c0f5bd3c,c0ca7376,475,ca1cadd0,c92b6220,...) at _rw_rlock+0x160
vn_fullpath1(c976a400,e9b42c58,3ff,3a4,c976a400,...) at vn_fullpath1+0x43
kern___getcwd(c9ae6000,bfbfde2b,0,401,e9b42d2c,...) at kern___getcwd+0xd0
__getcwd(c9ae6000,e9b42cf8,8,c0c819a7,c0d89148,...) at __getcwd+0x29
syscall(e9b42d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (326, FreeBSD ELF32, __getcwd), eip = 0x28100c3b, esp = 0xbfbfdd3c, ebp = 0xbfbfddf8 ---
Tracing command creat pid 79113 tid 100495 td 0xc95abaf0
sched_switch(c95abaf0,0,104,191,48c6c314,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c95abaf0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c95abaf0,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e95ddb60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,20,...) at tty_wait+0x71
ttydev_write(c8cc6900,e95ddc58,0,0,0,...) at ttydev_write+0xcc
--More-- devfs_write_f(c94a7d20,e95ddc58,c9bada80,0,c95abaf0,...) at devfs_write_f+0x9e
dofilewrite(e95ddc58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(c95abaf0,2,e95ddc58,e95ddc78,1,...) at kern_writev+0x58
write(c95abaf0,e95ddcf8,c,c0c828f4,c0d86e10,...) at write+0x4f
syscall(e95ddd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde4c, ebp = 0xbfbfde68 ---
Tracing command thr1 pid 79111 tid 101455 td 0xcce0c460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101448 td 0xccf81af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101439 td 0xccde1460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101432 td 0xcbf29690
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79111 tid 101424 td 0xccd328c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101416 td 0xccd758c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101410 td 0xccf27460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101403 td 0xccdc5d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101396 td 0xccf11230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101389 td 0xcb787230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101380 td 0xcd00dd20
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79111 tid 101373 td 0xccf2d8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101370 td 0xccf06460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101363 td 0xc93ac8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101357 td 0xc9227d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101350 td 0xcce3baf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101316 td 0xcceac460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101342 td 0xccd38460
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101340 td 0xccf10230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101294 td 0xcce7f690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101232 td 0xccef7000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101268 td 0xccf4a000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101196 td 0xccf60230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101197 td 0xccd1eaf0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79111 tid 101338 td 0xccdaf230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101333 td 0xccd41af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101329 td 0xccd7faf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101325 td 0xccd86460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101321 td 0xc93ac000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101315 td 0xc9bced20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101310 td 0xc9a28230
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79111 tid 101305 td 0xccdfb8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101222 td 0xccf00000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101213 td 0xccf1c8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101204 td 0xcb5ac690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 101203 td 0xccd17460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79111 tid 100465 td 0xcbfa8af0
sched_switch(cbfa8af0,0,104,191,48c61f01,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cbfa8af0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
--More-- sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(cbe0e680,0,c0c9c917,100,0,...) at sleepq_wait_sig+0x17
_sleep(cbe0e680,c0dfbbf0,100,c0c9c917,0,...) at _sleep+0x354
do_wait(0,0,0,e9545c80,c08cd5d0) at do_wait+0x511
__umtx_op_wait(cbfa8af0,e9545cf8,e9545d2c,c0bc8d53,cbfa8af0,...) at __umtx_op_wait+0x5f
_umtx_op(cbfa8af0,e9545cf8,14,e9545ca0,c0d89f48,...) at _umtx_op+0x27
syscall(e9545d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280b1317, esp = 0xbfbfe4ac, ebp = 0xbfbfe4c8 ---
Tracing command creat pid 79110 tid 100225 td 0xc9a60af0
sched_switch(c9a60af0,0,207,18c,48e93198,...) at sched_switch+0x1c5
mi_switch(207,0,c0c9fbb9,d6,bc,...) at mi_switch+0x200
ast(e91a7d38) at ast+0x2b3
doreti_ast() at doreti_ast+0x17
Tracing command creat pid 79108 tid 100574 td 0xcadf18c0
sched_switch(cadf18c0,0,207,18c,48f491f9,...) at sched_switch+0x1c5
mi_switch(207,0,c0c9fbb9,d6,bc,...) at mi_switch+0x200
ast(e96dbd38) at ast+0x2b3
--More-- doreti_ast() at doreti_ast+0x17
Tracing command thr1 pid 79107 tid 101290 td 0xccde38c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101285 td 0xcce5f690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101279 td 0xccf27000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101276 td 0xca66c8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101263 td 0xc93c3230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101244 td 0xccf13690
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79107 tid 101239 td 0xcbee58c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101223 td 0xccf66460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101214 td 0xcce27d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101209 td 0xccd98d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101230 td 0xcd00cd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 101583 td 0xcc4b38c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79107 tid 100894 td 0xcbf08d20
sched_switch(cbf08d20,0,104,191,4888b0e9,...) at sched_switch+0x1c5
--More-- mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cbf08d20,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(cbca2880,0,c0c9c917,100,0,...) at sleepq_wait_sig+0x17
_sleep(cbca2880,c0dfaf00,100,c0c9c917,0,...) at _sleep+0x354
do_wait(0,0,0,e9d3ac80,c08cd5d0) at do_wait+0x511
__umtx_op_wait(cbf08d20,e9d3acf8,e9d3ad2c,c0bc8d53,cbf08d20,...) at __umtx_op_wait+0x5f
_umtx_op(cbf08d20,e9d3acf8,14,e9d3aca0,c0d89f48,...) at _umtx_op+0x27
syscall(e9d3ad38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280b1317, esp = 0xbfbfe4ac, ebp = 0xbfbfe4c8 ---
Tracing command creat pid 79106 tid 100585 td 0xcbddb460
sched_switch(cbddb460,0,207,18c,48d5563f,...) at sched_switch+0x1c5
mi_switch(207,0,c0c9fbb9,d6,18c,...) at mi_switch+0x200
ast(e96fcd38) at ast+0x2b3
doreti_ast() at doreti_ast+0x17
Tracing command thr1 pid 79104 tid 101713 td 0xcce97690
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79104 tid 101708 td 0xccef3460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101705 td 0xccf63460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101701 td 0xcce75d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101696 td 0xcceff230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101693 td 0xcce9daf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101689 td 0xccd8aaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101684 td 0xcbddbaf0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101680 td 0xcced7000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101676 td 0xccd19230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101672 td 0xccf028c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101668 td 0xcd00f230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101665 td 0xccf06000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101661 td 0xcce85af0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79104 tid 101656 td 0xccd1d230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101653 td 0xccff8af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101649 td 0xc9a28460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101645 td 0xccf62af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101641 td 0xccf47690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101637 td 0xcbee5000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101633 td 0xc8c65230
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79104 tid 101629 td 0xccf6cd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101625 td 0xccf35af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101620 td 0xca629d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101617 td 0xccd4f460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101613 td 0xccf97690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101609 td 0xcce85230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101604 td 0xccd1c000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101600 td 0xcce20690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101596 td 0xcbfa8d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101590 td 0xcd019000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101585 td 0xccf98d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101578 td 0xcbf7ad20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101574 td 0xcc4768c0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79104 tid 101569 td 0xc9242af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101564 td 0xc911aaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101558 td 0xccf62d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101553 td 0xccd4f690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101547 td 0xc9dd9d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101542 td 0xccddcd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101537 td 0xcccfbaf0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79104 tid 101532 td 0xccd4faf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101527 td 0xccf288c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101521 td 0xccd8ed20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101515 td 0xccf918c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101509 td 0xc944c460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101504 td 0xcc074460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101499 td 0xc93cdaf0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101493 td 0xccf70d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101487 td 0xc9421460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101481 td 0xccf61230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101475 td 0xccd1c230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101469 td 0xc9648d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101463 td 0xcc476af0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79104 tid 101459 td 0xcb68e8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101452 td 0xc92398c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101445 td 0xcce75460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101438 td 0xc96c9690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101431 td 0xcce81230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101425 td 0xccd7e000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101418 td 0xcc4b3460
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79104 tid 101411 td 0xc97be000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101404 td 0xcce05af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101397 td 0xccde5460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101390 td 0xccf1c230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101383 td 0xccf02af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101376 td 0xcc06d690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101366 td 0xc94918c0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101360 td 0xcc476d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101355 td 0xcce4b460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101348 td 0xccd85690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101191 td 0xcbf7b690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101221 td 0xc95c5d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101245 td 0xccd1d460
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79104 tid 101275 td 0xccf93230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101260 td 0xc96a8af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101195 td 0xccd65460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101193 td 0xccd4f000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101202 td 0xccdbe230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101194 td 0xcbbd9460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101220 td 0xccd2aaf0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79104 tid 101336 td 0xcce858c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101330 td 0xcce92000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101326 td 0xc9482690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101320 td 0xc9608690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101314 td 0xccffeaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101306 td 0xccf0faf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101296 td 0xccd3b000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101291 td 0xccfa8d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101286 td 0xccf9baf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101282 td 0xc9799460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101277 td 0xcceb9d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101271 td 0xcd018460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101265 td 0xc9da7000
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79104 tid 101253 td 0xccf568c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101241 td 0xccfa88c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101235 td 0xccf30230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101228 td 0xccf0c230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101211 td 0xccd55af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101205 td 0xcc4548c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101226 td 0xccf718c0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79104 tid 101252 td 0xcce80af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 101266 td 0xcc40d460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79104 tid 100305 td 0xc9dae690
cpustop_handler(10,e92cc9e8,c0bc8fd6,e92cc978,c0df87f0,...) at cpustop_handler+0x32
ipi_nmi_handler(e92cc978,c0df87f0,c0df87f0,c9dae690,c9c15d48,...) at ipi_nmi_handler+0x2f
trap(e92cc9f4) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc0bccf97, esp = 0xe92cca34, ebp = 0xe92cca50 ---
DELAY(1,c9dae690,c0e01c34,0,e92cca90,...) at DELAY+0x87
_mtx_lock_spin(c0e01c34,c9dae690,0,c0cd40dd,462,...) at _mtx_lock_spin+0x6c
_mtx_lock_spin_flags(c0e01c34,0,c0cd40dd,462,f5,...) at _mtx_lock_spin_flags+0x146
smp_tlb_shootdown(e92ccae0,c0bbfd7f,ea799000,ea79a000,c14b6000,...) at smp_tlb_shootdown+0x66
smp_invlpg_range(ea799000,ea79a000,c14b6000,0,1,...) at smp_invlpg_range+0x1c
pmap_invalidate_range(c0fbb5e0,ea799000,ea79a000) at pmap_invalidate_range+0x4f
pmap_qremove(ea799000,1,0,171,cbf2f5d8,...) at pmap_qremove+0x58
--More-- vm_thread_new(ccd35460,2,2,e92ccc44,e92ccbfc,...) at vm_thread_new+0x15e
thread_alloc(0,c9c15dd0,4,c0c997e5,280a6670,...) at thread_alloc+0x4f
create_thread(28231440,b1f26000,100000,281d0890,28231440,28231440,2,0,0) at create_thread+0x9c
kern_thr_new(c9dae690,e92ccc44,34,280a6670,28231440,...) at kern_thr_new+0x77
thr_new(c9dae690,e92cccf8,8,c0ca1a3a,c0d89f64,...) at thr_new+0x55
syscall(e92ccd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (455, FreeBSD ELF32, thr_new), eip = 0x280fd1cb, esp = 0xbfbfe47c, ebp = 0xbfbfe538 ---
Tracing command creat pid 79103 tid 100281 td 0xc9d3baf0
sched_switch(c9d3baf0,0,104,191,d3b3f916,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c9d3baf0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,c9d3baf0,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e9284b60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,7,...) at tty_wait+0x71
ttydev_write(c8cc6900,e9284c58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e9284c58,c9bada80,0,c9d3baf0,...) at devfs_write_f+0x9e
dofilewrite(e9284c58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
--More-- kern_writev(c9d3baf0,2,e9284c58,e9284c78,1,...) at kern_writev+0x58
write(c9d3baf0,e9284cf8,c,c0ca1e1e,c0d86e10,...) at write+0x4f
syscall(e9284d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command creat pid 79101 tid 100620 td 0xcbf65000
sched_switch(cbf65000,0,104,191,d3b78d66,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(cbf65000,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c8ac7204,0,c0c997e5,cbf65000,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8ac7280,0,e977eb60,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c8ac7280,c8ac7204,c0ca333f,511,c8ac7200,...) at _cv_wait_sig+0x240
tty_wait(c8ac7200,c8ac7280,c0ca333f,9f,18,...) at tty_wait+0x71
ttydev_write(c8cc6900,e977ec58,0,0,0,...) at ttydev_write+0xcc
devfs_write_f(c94a7d20,e977ec58,c9bada80,0,cbf65000,...) at devfs_write_f+0x9e
dofilewrite(e977ec58,ffffffff,ffffffff,0,c94a7d20,...) at dofilewrite+0x95
kern_writev(cbf65000,2,e977ec58,e977ec78,1,...) at kern_writev+0x58
write(cbf65000,e977ecf8,c,c0ca19f2,c0d86e10,...) at write+0x4f
syscall(e977ed38) at syscall+0x2a3
--More-- Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (4, FreeBSD ELF32, write), eip = 0x2818dc93, esp = 0xbfbfde1c, ebp = 0xbfbfde38 ---
Tracing command thr1 pid 79100 tid 101712 td 0xccf60000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101709 td 0xccd71d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101704 td 0xc9799af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101700 td 0xcce6b000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101697 td 0xccd31af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101692 td 0xc9242000
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79100 tid 101688 td 0xc9421000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101685 td 0xccd75af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101681 td 0xccd8caf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101677 td 0xcceac8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101673 td 0xccdc3690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101669 td 0xccfead20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101664 td 0xccd6f460
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101660 td 0xccf67af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101657 td 0xcc40b000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101652 td 0xccde5af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101648 td 0xccf0c460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101644 td 0xcc4b3230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101640 td 0xccf548c0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79100 tid 101636 td 0xccd9b230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101632 td 0xccde3d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101628 td 0xccd60d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101624 td 0xc9aead20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101621 td 0xccd96d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101616 td 0xccda6690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101612 td 0xccd1e8c0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79100 tid 101608 td 0xccffe000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101605 td 0xccd9c460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101601 td 0xccd7daf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101597 td 0xcc4ded20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101593 td 0xcbebeaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101589 td 0xcce448c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101584 td 0xccd8b000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101579 td 0xccfe98c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101573 td 0xccf9b690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101568 td 0xcced7d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101563 td 0xcce54460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101559 td 0xccd8c8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101555 td 0xc96add20
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79100 tid 101550 td 0xc95a68c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101545 td 0xccd9f230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101540 td 0xccfff690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101536 td 0xccda6000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101531 td 0xccff88c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101526 td 0xca5fa460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101522 td 0xccf60af0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79100 tid 101516 td 0xcc6a7460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101510 td 0xccf6f460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101506 td 0xccf31460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101501 td 0xccf19690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101495 td 0xcb161690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101489 td 0xccd84af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101483 td 0xcce2ad20
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101477 td 0xccf4b000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101471 td 0xcd013af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101465 td 0xccf4c000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101457 td 0xccd7f8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101450 td 0xccf2e000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101443 td 0xccff8460
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79100 tid 101436 td 0xccf27af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101427 td 0xccd6f8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101420 td 0xccd498c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101413 td 0xccdd2af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101407 td 0xcc6a7d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101399 td 0xccd32460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101392 td 0xcce66af0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79100 tid 101385 td 0xcbc98000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101379 td 0xccf7f460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101372 td 0xc9cdbd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101365 td 0xcb1cd230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101359 td 0xcd00d000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101354 td 0xccbdc690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101349 td 0xcbaecaf0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101344 td 0xccda68c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101238 td 0xcce97d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101303 td 0xc8c59460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101249 td 0xccea0460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101225 td 0xca827af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101216 td 0xc9239d20
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79100 tid 101201 td 0xccf07460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101190 td 0xcbd4a000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101339 td 0xccd438c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 101337 td 0xccd11d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79100 tid 100726 td 0xc942c000
cpustop_handler(20,e9a319e8,c0bc8fd6,e9a31978,c0df882c,...) at cpustop_handler+0x32
ipi_nmi_handler(e9a31978,c0df882c,c0df882c,c942c000,cc6e07f8,...) at ipi_nmi_handler+0x2f
trap(e9a319f4) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc0bccf99, esp = 0xe9a31a34, ebp = 0xe9a31a50 ---
DELAY(1,c942c000,c0e01c34,0,e9a31a90,...) at DELAY+0x89
_mtx_lock_spin(c0e01c34,c942c000,0,c0cd40dd,462,...) at _mtx_lock_spin+0x6c
--More-- _mtx_lock_spin_flags(c0e01c34,0,c0cd40dd,462,f5,...) at _mtx_lock_spin_flags+0x146
smp_tlb_shootdown(e9a31ae0,c0bbfd7f,ea79c000,ea79d000,c14b6000,...) at smp_tlb_shootdown+0x66
smp_invlpg_range(ea79c000,ea79d000,c14b6000,0,1,...) at smp_invlpg_range+0x1c
pmap_invalidate_range(c0fbb5e0,ea79c000,ea79d000) at pmap_invalidate_range+0x4f
pmap_qremove(ea79c000,1,0,171,cc7d9d48,...) at pmap_qremove+0x58
vm_thread_new(ccf59690,2,2,e9a31c44,e9a31bfc,...) at vm_thread_new+0x15e
thread_alloc(0,cc6e0880,4,c0c997e5,280a6670,...) at thread_alloc+0x4f
create_thread(28204700,ba5ac000,100000,281dae90,28204700,28204700,2,0,0) at create_thread+0x9c
kern_thr_new(c942c000,e9a31c44,34,280a6670,28204700,...) at kern_thr_new+0x77
thr_new(c942c000,e9a31cf8,8,c0ca1a3a,c0d89f64,...) at thr_new+0x55
syscall(e9a31d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (455, FreeBSD ELF32, thr_new), eip = 0x280fd1cb, esp = 0xbfbfe47c, ebp = 0xbfbfe538 ---
Tracing command creat pid 79098 tid 100624 td 0xc8c59af0
kdb_enter(c0c9b0d1,c0c9b0d1,c0c9f546,e978a85c,1,...) at kdb_enter+0x3a
panic(c0c9f546,c9633af0,c0dfc024,c9d3e280,c0f5bd3c,...) at panic+0x136
turnstile_claim(c9d3e280,2,c0ca7376,1f0,4,...) at turnstile_claim+0x148
_rw_try_upgrade(c0f5bd3c,c0ca7376,1f0,e978a990,e978ab88,...) at _rw_try_upgrade+0xe6
cache_lookup(c99e9bb0,e978ab74,e978ab88,0,0,...) at cache_lookup+0x362
--More-- nfs_lookup(e978aa50,e978aa50,e978ab5c,200000,e978ab5c,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e978aa50,e978ab88,1f1,e978ab74,...) at VOP_LOOKUP_APV+0xa5
lookup(e978ab5c,c0ca7aea,ea,c5,cc093d48,...) at lookup+0x66b
namei(e978ab5c,c08d3aab,c0c94c96,c0c92df9,3,...) at namei+0x55f
kern_statat_vnhook(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat_vnhook+0x72
kern_statat(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat+0x3c
kern_stat(c8c59af0,bfbfdf78,0,e978ac18,2,...) at kern_stat+0x36
stat(c8c59af0,e978acf8,8,c0ca19f2,c0d88230,...) at stat+0x2f
syscall(e978ad38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2817d1a3, esp = 0xbfbfdecc, ebp = 0xbfbfe388 ---
Tracing command thr1 pid 79096 tid 101710 td 0xccfde690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101706 td 0xcc6b3230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101702 td 0xcce54af0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79096 tid 101698 td 0xccf06230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101695 td 0xccd91230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101691 td 0xccf1a690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101686 td 0xc96818c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101682 td 0xcce75af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101678 td 0xcbe9f690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101674 td 0xccde5000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101670 td 0xcce98d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101666 td 0xccda8690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101662 td 0xccd4caf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101659 td 0xccd72230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101654 td 0xcd001af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101650 td 0xcce2b000
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79096 tid 101646 td 0xcbfc5000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101642 td 0xccff98c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101638 td 0xccf35d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101634 td 0xcc282af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101630 td 0xccffe460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101626 td 0xcc03f460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101622 td 0xccf77230
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79096 tid 101618 td 0xccf47000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101614 td 0xcbddaaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101610 td 0xccfda000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101606 td 0xccfb0000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101602 td 0xccd1c690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101598 td 0xccd78d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101594 td 0xccf8c460
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101591 td 0xcbdc9000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101586 td 0xccd608c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101580 td 0xcc220000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101575 td 0xccf67230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101570 td 0xccd28af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101566 td 0xcced7460
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79096 tid 101561 td 0xccdac000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101556 td 0xcce40230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101551 td 0xccd91d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101546 td 0xcce85690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101541 td 0xccf118c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101535 td 0xccd20460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101530 td 0xccf57230
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79096 tid 101525 td 0xccd95000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101519 td 0xccf6c000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101514 td 0xccf07af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101507 td 0xcce27af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101503 td 0xc957c230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101497 td 0xc9e40af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101491 td 0xcce6f8c0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101484 td 0xcce66690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101478 td 0xcbf57000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101473 td 0xccf6d8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101468 td 0xcce9e230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101460 td 0xccf078c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101453 td 0xccef4af0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79096 tid 101446 td 0xccd72000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101440 td 0xccda08c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101433 td 0xc947f230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101426 td 0xccd20690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101419 td 0xccdd2690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101412 td 0xccf47af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101406 td 0xccf0caf0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79096 tid 101400 td 0xccfac8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101393 td 0xccd76af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101386 td 0xccdafaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101378 td 0xcc40d8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101371 td 0xcd00b230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101364 td 0xc95c5af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101358 td 0xccd37000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101352 td 0xcafa78c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101346 td 0xccf57460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101270 td 0xccd89690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101199 td 0xc9a28af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101192 td 0xccd2a230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101299 td 0xccfff000
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79096 tid 101302 td 0xccee1d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101327 td 0xc9c9d230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101322 td 0xc92428c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101317 td 0xc8f488c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101311 td 0xccd22000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101301 td 0xcc448230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101292 td 0xccff8230
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79096 tid 101287 td 0xc9b6c460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101281 td 0xccf71af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101278 td 0xcce3e460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101273 td 0xccf79af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101258 td 0xccf06690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101251 td 0xccf9b8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101243 td 0xc9307af0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101237 td 0xcbefb230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101224 td 0xcd016460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101218 td 0xccfd1d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101231 td 0xccd56690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101229 td 0xcc81d460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79096 tid 101257 td 0xccf00af0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79096 tid 100812 td 0xc9adb460
cpustop_handler(80,e9beaa4c,c0bc8fd6,4,c0cc5ad8,...) at cpustop_handler+0x32
ipi_nmi_handler(4,c0cc5ad8,c85170a8,e9bea9e4,cc715d48,...) at ipi_nmi_handler+0x2f
trap(e9beaa58) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc0bbb168, esp = 0xe9beaa98, ebp = 0xe9beaab8 ---
smp_tlb_shootdown(e9beaae0,c0bbfd7f,ea796000,ea797000,c14b6000,...) at smp_tlb_shootdown+0x98
smp_invlpg_range(ea796000,ea797000,c14b6000,0,1,...) at smp_invlpg_range+0x1c
pmap_invalidate_range(c0fbb5e0,ea796000,ea797000) at pmap_invalidate_range+0x4f
pmap_qremove(ea796000,1,0,171,cc0bc3b8,...) at pmap_qremove+0x58
vm_thread_new(cce81000,2,2,e9beac44,e9beabfc,...) at vm_thread_new+0x15e
thread_alloc(0,cc715dd0,4,c0c997e5,280a6670,...) at thread_alloc+0x4f
create_thread(28228980,b131a000,100000,281de790,28228980,28228980,2,0,0) at create_thread+0x9c
kern_thr_new(c9adb460,e9beac44,34,280a6670,28228980,...) at kern_thr_new+0x77
thr_new(c9adb460,e9beacf8,8,c0ca1a3a,c0d89f64,...) at thr_new+0x55
syscall(e9bead38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (455, FreeBSD ELF32, thr_new), eip = 0x280fd1cb, esp = 0xbfbfe47c, ebp = 0xbfbfe538 ---
Tracing command creat pid 79095 tid 100825 td 0xcbed6690
--More-- cpustop_handler(4,e9c6b488,c0bc8fd6,e9c6b438,246,...) at cpustop_handler+0x32
ipi_nmi_handler(e9c6b438,246,c087f934,c0e02afc,ccdd9aa0,...) at ipi_nmi_handler+0x2f
trap(e9c6b494) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc079795f, esp = 0xe9c6b4d4, ebp = 0xe9c6b4f4 ---
ns8250_bus_ipend(c8c1e900,c0869198,c0df8778,c8c1e980,c8c1e958,...) at ns8250_bus_ipend+0x5f
uart_intr(c8c1e900,cbed6690,c85e44d0,c8598e80,4,...) at uart_intr+0x33b
intr_event_handle(c8598e80,e9c6b584,c0f79438,0,c0f5bd3c,...) at intr_event_handle+0x5c
intr_execute_handlers(c85e44d0,e9c6b584,2,e9c6b5e4,c0bab404,...) at intr_execute_handlers+0x49
lapic_handle_intr(30,e9c6b584) at lapic_handle_intr+0x4c
Xapic_isr1() at Xapic_isr1+0x34
--- interrupt, eip = 0xc088dc70, esp = 0xe9c6b5c4, ebp = 0xe9c6b5e4 ---
_rw_rlock(c0f5bd3c,c0ca7376,186,e9c6b6d0,e9c6b874,...) at _rw_rlock+0x150
cache_lookup(c92b6220,e9c6b860,e9c6b874,c0f21968,0,...) at cache_lookup+0x46
nfs_lookup(e9c6b790,e9c6b790,e9c6b848,200000,e9c6b848,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e9c6b790,e9c6b874,1f1,e9c6b860,...) at VOP_LOOKUP_APV+0xa5
lookup(e9c6b848,c0ca7aea,ea,c5,ccdd9aa0,...) at lookup+0x66b
namei(e9c6b848,cb6e3a80,1d8,e9c6bbd0,e9c6ba9c,...) at namei+0x55f
kern_statfs(cbed6690,bfbfde3b,0,e9c6ba9c,20030518,...) at kern_statfs+0x8c
statfs(cbed6690,e9c6bcf8,8,c0ca22f1,c0d898f0,...) at statfs+0x3b
--More-- syscall(e9c6bd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (396, FreeBSD ELF32, statfs), eip = 0x280e978b, esp = 0xbfbfde0c, ebp = 0xbfbfe418 ---
Tracing command thr1 pid 79093 tid 101588 td 0xc9242d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101582 td 0xcbf0a230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101577 td 0xccd67460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101572 td 0xcd00b000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101567 td 0xccf75af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101562 td 0xccd7c000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101557 td 0xcce3b8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101552 td 0xcbcf1af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101548 td 0xcd00c230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101543 td 0xccd3a8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101538 td 0xccd52000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101533 td 0xccd95460
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79093 tid 101528 td 0xcce058c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101523 td 0xccd21af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101517 td 0xcce808c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101511 td 0xc928f8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101505 td 0xccef2d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101500 td 0xcd002d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101494 td 0xcd018af0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79093 tid 101488 td 0xcd001d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101482 td 0xc93cc230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101476 td 0xccf83af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101470 td 0xccd52460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101464 td 0xc93c6000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101458 td 0xccd36230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101451 td 0xccf8dd20
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101444 td 0xccf28d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101437 td 0xcd00d690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101429 td 0xccdd4af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101422 td 0xccfeaaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101415 td 0xc9bce690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101408 td 0xcd013460
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79093 tid 101401 td 0xccd1d000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101394 td 0xccd658c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101388 td 0xc8f48690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101382 td 0xccde28c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101375 td 0xccf56460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101368 td 0xcce63230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101217 td 0xcbea88c0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79093 tid 101215 td 0xc9527690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101212 td 0xcbf85690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101198 td 0xcce27000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101236 td 0xcbee5690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101262 td 0xcc171d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 101261 td 0xccd968c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79093 tid 100454 td 0xca649000
--More-- sched_switch(ca649000,0,602,18c,48ddec49,...) at sched_switch+0x1c5
mi_switch(602,0,c0c9b7c0,cf,c0f78de0,...) at mi_switch+0x200
critical_exit(0,c087fc6f,0) at critical_exit+0xa8
lapic_handle_timer(e9523b64) at lapic_handle_timer+0x155
Xtimerint() at Xtimerint+0x1f
--- interrupt, eip = 0xc087fc6f, esp = 0xe9523ba4, ebp = 0xe9523bc0 ---
_mtx_unlock_flags(cbec9dd0,0,c0c9c154,f2,280a6670,...) at _mtx_unlock_flags+0xef
create_thread(282040c0,ba0a7000,100000,281da990,282040c0,282040c0,2,0,0) at create_thread+0x322
kern_thr_new(ca649000,e9523c44,34,280a6670,282040c0,...) at kern_thr_new+0x77
thr_new(ca649000,e9523cf8,8,c0ca1a3a,c0d89f64,...) at thr_new+0x55
syscall(e9523d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (455, FreeBSD ELF32, thr_new), eip = 0x280fd1cb, esp = 0xbfbfe47c, ebp = 0xbfbfe538 ---
Tracing command creat pid 79092 tid 100673 td 0xcc5c4af0
sched_switch(cc5c4af0,0,104,191,9807f544,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(cc5c4af0,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(cc920550,5c,c0ca1b60,100,0,...) at sleepq_wait_sig+0x17
--More-- _sleep(cc920550,cc9205d8,15c,c0ca1b60,0,...) at _sleep+0x354
kern_wait(cc5c4af0,134f7,e9992c74,0,0,...) at kern_wait+0xb76
wait4(cc5c4af0,e9992cf8,10,cc5c4af0,c0d86e64,...) at wait4+0x3b
syscall(e9992d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x28100cdb, esp = 0xbfbfe95c, ebp = 0xbfbfe978 ---
Tracing command thr1 pid 79090 tid 101715 td 0xcc319690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101711 td 0xc944cd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101707 td 0xccf4a230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101703 td 0xccf02460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101699 td 0xccd918c0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101694 td 0xcce2ed20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101690 td 0xcce2aaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101687 td 0xccef4690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101683 td 0xc911a690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101679 td 0xccf0c690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101675 td 0xcd005230
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79090 tid 101671 td 0xccd08000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101667 td 0xccd5e690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101663 td 0xcc282460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101658 td 0xccf358c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101655 td 0xcd016690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101651 td 0xcce6caf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101647 td 0xcce0d8c0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79090 tid 101643 td 0xcbf0aaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101639 td 0xccd5ed20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101635 td 0xccd91690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101631 td 0xccf59230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101627 td 0xc9b5a460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101623 td 0xcd00d8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101619 td 0xccef4d20
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101615 td 0xccd49000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101611 td 0xccda5af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101607 td 0xc9e62690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101603 td 0xcc37b000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101599 td 0xccdc5af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101595 td 0xccfc9d20
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79090 tid 101592 td 0xcd018000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101587 td 0xccd16000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101581 td 0xccd7c8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101576 td 0xccd9a8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101571 td 0xc944c690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101565 td 0xccf83d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101560 td 0xccd78000
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79090 tid 101554 td 0xcce12460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101549 td 0xcce35230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101544 td 0xccd2a8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101539 td 0xcced7690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101534 td 0xcce06460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101529 td 0xcd016000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101524 td 0xcce27690
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101518 td 0xccd41d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101512 td 0xcd015d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101508 td 0xcc454460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101502 td 0xccf2f8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101496 td 0xccda9460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101490 td 0xcce4a000
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79090 tid 101485 td 0xcce43460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101479 td 0xccd858c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101474 td 0xccdf7460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101467 td 0xcb787af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101461 td 0xccd2eaf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101454 td 0xcce06d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101447 td 0xcc416af0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79090 tid 101441 td 0xccf02d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101434 td 0xc923a8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101428 td 0xccf80000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101421 td 0xcbcc4d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101414 td 0xccfe6000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101405 td 0xccd9d8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101398 td 0xccd66000
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101391 td 0xcb161d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101384 td 0xccf2f690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101377 td 0xccf92690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101367 td 0xccffd460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101361 td 0xccd74460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101353 td 0xcd0028c0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79090 tid 101347 td 0xccd90460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101343 td 0xccd89af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101259 td 0xcbf7fd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101308 td 0xccda0d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101334 td 0xccd70000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101331 td 0xcce65460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101328 td 0xccf5e230
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79090 tid 101324 td 0xcce5f460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101319 td 0xccd9caf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101312 td 0xccda28c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101307 td 0xccffd000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101297 td 0xc9491690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101288 td 0xccdc3af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101284 td 0xccd7a230
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101280 td 0xcce59000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101274 td 0xcbeb4460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101269 td 0xccfc5000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101254 td 0xccf1a8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101250 td 0xccee1000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101240 td 0xcbf57230
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79090 tid 101234 td 0xcbd30690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101233 td 0xccfe9af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101200 td 0xcce06000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101210 td 0xccf81690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101227 td 0xc97be8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101248 td 0xcad33af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101256 td 0xccd1faf0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79090 tid 101264 td 0xccef48c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 101267 td 0xcce2e690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79090 tid 100320 td 0xc9e26d20
cpustop_handler(40,e93019e8,c0bc8fd6,e9301978,c0df8868,...) at cpustop_handler+0x32
ipi_nmi_handler(e9301978,c0df8868,c0df8868,c9e26d20,c9e10aa0,...) at ipi_nmi_handler+0x2f
trap(e93019f4) at trap+0x36
calltrap() at calltrap+0x6
--- trap 0x13, eip = 0xc0bccf99, esp = 0xe9301a34, ebp = 0xe9301a50 ---
DELAY(1,c9e26d20,c0e01c34,0,e9301a90,...) at DELAY+0x89
_mtx_lock_spin(c0e01c34,c9e26d20,0,c0cd40dd,462,...) at _mtx_lock_spin+0x6c
_mtx_lock_spin_flags(c0e01c34,0,c0cd40dd,462,f5,...) at _mtx_lock_spin_flags+0x146
smp_tlb_shootdown(e9301ae0,c0bbfd7f,ea79f000,ea7a0000,c14b6000,...) at smp_tlb_shootdown+0x66
smp_invlpg_range(ea79f000,ea7a0000,c14b6000,0,1,...) at smp_invlpg_range+0x1c
pmap_invalidate_range(c0fbb5e0,ea79f000,ea7a0000) at pmap_invalidate_range+0x4f
pmap_qremove(ea79f000,1,0,171,c9a16440,...) at pmap_qremove+0x58
--More-- vm_thread_new(cbccd690,2,2,e9301c44,e9301bfc,...) at vm_thread_new+0x15e
thread_alloc(0,c9e10b28,4,c0c997e5,280a6670,...) at thread_alloc+0x4f
create_thread(28234b40,b4047000,100000,281d2990,28234b40,28234b40,2,0,0) at create_thread+0x9c
kern_thr_new(c9e26d20,e9301c44,34,280a6670,28234b40,...) at kern_thr_new+0x77
thr_new(c9e26d20,e9301cf8,8,c0ca1a3a,c0d89f64,...) at thr_new+0x55
syscall(e9301d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (455, FreeBSD ELF32, thr_new), eip = 0x280fd1cb, esp = 0xbfbfe47c, ebp = 0xbfbfe538 ---
Tracing command thr1 pid 79088 tid 101498 td 0xccd85af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101492 td 0xcbd72230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101486 td 0xc9239af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101480 td 0xccf6d460
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79088 tid 101472 td 0xcced78c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101466 td 0xc93cc000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101462 td 0xccd7a460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101456 td 0xccd17af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101449 td 0xcc4d3460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101442 td 0xc95dad20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101435 td 0xcce9baf0
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101430 td 0xcce8f230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101423 td 0xcbefb690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101417 td 0xccf09230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101409 td 0xcce2a230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101402 td 0xccffdd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101395 td 0xcbe29d20
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79088 tid 101387 td 0xcbe9f230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101381 td 0xccfb0af0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101374 td 0xccd60460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101369 td 0xcced5690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101362 td 0xc8c65690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101356 td 0xccd7c460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101351 td 0xccdd4d20
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79088 tid 101345 td 0xcd016d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101246 td 0xcce4b230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101341 td 0xccf9a460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101295 td 0xccd75d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101272 td 0xccd38d20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101247 td 0xccfe6690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101219 td 0xcc4eb690
--More-- fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101300 td 0xc94ce8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101335 td 0xcd0168c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101332 td 0xcce76460
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101304 td 0xccf02690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101323 td 0xccfc5690
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101318 td 0xccd59af0
fork_trampoline() at fork_trampoline
--More-- Tracing command thr1 pid 79088 tid 101313 td 0xccd9baf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101309 td 0xccf13230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101298 td 0xccd6faf0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101293 td 0xccd8d230
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101289 td 0xccbdcd20
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101283 td 0xccfa9000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101208 td 0xccda58c0
fork_trampoline() at fork_trampoline
--More--
Tracing command thr1 pid 79088 tid 101207 td 0xccd9b8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101206 td 0xccf8d8c0
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 101242 td 0xccd9b000
fork_trampoline() at fork_trampoline
Tracing command thr1 pid 79088 tid 100464 td 0xc92d3000
sched_switch(c92d3000,0,104,191,48d0b0e0,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c92d3000,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(cc091280,0,c0c9c917,100,0,...) at sleepq_wait_sig+0x17
_sleep(cc091280,c0dfa9c0,100,c0c9c917,0,...) at _sleep+0x354
do_wait(0,0,0,e9542c80,c08cd5d0) at do_wait+0x511
__umtx_op_wait(c92d3000,e9542cf8,e9542d2c,c0bc8d53,c92d3000,...) at __umtx_op_wait+0x5f
_umtx_op(c92d3000,e9542cf8,14,c0ca2839,c0d89f48,...) at _umtx_op+0x27
--More-- syscall(e9542d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (454, FreeBSD ELF32, _umtx_op), eip = 0x280b1317, esp = 0xbfbfe4ac, ebp = 0xbfbfe4c8 ---
Tracing command thr1 pid 79087 tid 100882 td 0xcc4e3af0
sched_switch(cc4e3af0,0,104,191,977996a4,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(cc4e3af0,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(ccdc8550,5c,c0ca1b60,100,0,...) at sleepq_wait_sig+0x17
_sleep(ccdc8550,ccdc85d8,15c,c0ca1b60,0,...) at _sleep+0x354
kern_wait(cc4e3af0,134f0,e9d16c74,0,0,...) at kern_wait+0xb76
wait4(cc4e3af0,e9d16cf8,10,cc4e3af0,c0d86e64,...) at wait4+0x3b
syscall(e9d16d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x28114cdb, esp = 0xbfbfe94c, ebp = 0xbfbfe968 ---
Tracing command thr1 pid 79078 tid 101076 td 0xc9329af0
sched_switch(c9329af0,0,104,191,1305142d,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
--More-- sleepq_switch(c9329af0,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(3e9,c08ca520,c9329af0,1,100,...) at sleepq_catch_signals+0xb7
sleepq_timedwait_sig(c0df86c4,5c,c0c9c3f3,100,0,...) at sleepq_timedwait_sig+0x1a
_sleep(c0df86c4,0,15c,c0c9c3f3,3e9,...) at _sleep+0x31e
kern_nanosleep(c9329af0,e9f61c64,e9f61c6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c9329af0,e9f61cf8,8,c0ca1ca4,c0d887e0,...) at nanosleep+0x6f
syscall(e9f61d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x281826cf, esp = 0xbfbfe96c, ebp = 0xbfbfe998 ---
Tracing command mkdir pid 79077 tid 101085 td 0xcc4da460
sched_switch(cc4da460,0,104,191,136d9090,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(cc4da460,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(3e9,c08ca520,cc4da460,1,100,...) at sleepq_catch_signals+0xb7
sleepq_timedwait_sig(c0df86c4,5c,c0c9c3f3,100,0,...) at sleepq_timedwait_sig+0x1a
_sleep(c0df86c4,0,15c,c0c9c3f3,3e9,...) at _sleep+0x31e
kern_nanosleep(cc4da460,e9f7cc64,e9f7cc6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(cc4da460,e9f7ccf8,8,c0ca1ca4,c0d887e0,...) at nanosleep+0x6f
syscall(e9f7cd38) at syscall+0x2a3
--More-- Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2816e6cf, esp = 0xbfbfe97c, ebp = 0xbfbfe9a8 ---
Tracing command creat pid 79076 tid 100486 td 0xc9307460
sched_switch(c9307460,0,104,191,13c90484,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(c9307460,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(3e9,c08ca520,c9307460,1,100,...) at sleepq_catch_signals+0xb7
sleepq_timedwait_sig(c0df86c4,5c,c0c9c3f3,100,0,...) at sleepq_timedwait_sig+0x1a
_sleep(c0df86c4,0,15c,c0c9c3f3,3e9,...) at _sleep+0x31e
kern_nanosleep(c9307460,e9584c64,e9584c6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c9307460,e9584cf8,8,c0ca1ca4,c0d887e0,...) at nanosleep+0x6f
syscall(e9584d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2816e6cf, esp = 0xbfbfe97c, ebp = 0xbfbfe9a8 ---
Tracing command rw pid 79074 tid 100525 td 0xcbd4a8c0
sched_switch(cbd4a8c0,0,104,191,1256ba03,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(cbd4a8c0,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
--More-- sleepq_catch_signals(3e9,c08ca520,cbd4a8c0,4,100,...) at sleepq_catch_signals+0xb7
sleepq_timedwait_sig(c0df86c4,5c,c0c9c3f3,100,0,...) at sleepq_timedwait_sig+0x1a
_sleep(c0df86c4,0,15c,c0c9c3f3,3e9,...) at _sleep+0x31e
kern_nanosleep(cbd4a8c0,e963cc64,e963cc6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(cbd4a8c0,e963ccf8,8,c0ca1ca4,c0d887e0,...) at nanosleep+0x6f
syscall(e963cd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2816e6cf, esp = 0xbfbfe99c, ebp = 0xbfbfe9c8 ---
Tracing command nfsiod 0 pid 77671 tid 101102 td 0xc9708230
sched_switch(c9708230,0,104,191,f3e4fec2,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(c9708230,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(1d4c0,c08ca520,c9708230,2,100,...) at sleepq_catch_signals+0xb7
sleepq_timedwait_sig(c0f61840,5c,c0c9081a,100,0,...) at sleepq_timedwait_sig+0x1a
_sleep(c0f61840,c0f61810,15c,c0c9081a,1d4c0,...) at _sleep+0x31e
nfssvc_iod(c0f611c0,e9fafd38,c0c9646a,343,cb7a57f8,...) at nfssvc_iod+0xcf
fork_exit(c0a541b0,c0f611c0,e9fafd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe9fafd70, ebp = 0 ---
--More--
Tracing command run pid 3554 tid 100385 td 0xcaf8b690
sched_switch(caf8b690,0,104,191,9633496c,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(caf8b690,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c9266000,5c,c0ca1b60,100,0,...) at sleepq_wait_sig+0x17
_sleep(c9266000,c9266088,15c,c0ca1b60,0,...) at _sleep+0x354
kern_wait(caf8b690,134e2,e9431c74,0,0,...) at kern_wait+0xb76
wait4(caf8b690,e9431cf8,10,caf8b690,c0d86e64,...) at wait4+0x3b
syscall(e9431d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x280ffcdb, esp = 0xbfbfe40c, ebp = 0xbfbfe428 ---
Tracing command run pid 3553 tid 100410 td 0xcc4de460
Tracing command run pid 3552 tid 100145 td 0xc963a000
sched_switch(c963a000,0,104,191,c0aad32d,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(c963a000,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
--More-- sleepq_catch_signals(3e9,c08ca520,c963a000,1,100,...) at sleepq_catch_signals+0xb7
sleepq_timedwait_sig(c0df86c4,5c,c0c9c3f3,100,0,...) at sleepq_timedwait_sig+0x1a
_sleep(c0df86c4,0,15c,c0c9c3f3,3e9,...) at _sleep+0x31e
kern_nanosleep(c963a000,e9048c64,e9048c6c,1,0,...) at kern_nanosleep+0xc1
nanosleep(c963a000,e9048cf8,8,c0ca1ca4,c0d887e0,...) at nanosleep+0x6f
syscall(e9048d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2816d6cf, esp = 0xbfbfe8dc, ebp = 0xbfbfe908 ---
Tracing command sh pid 3545 tid 100169 td 0xc9338230
Tracing command md0 pid 1847 tid 100154 td 0xc9a09460
sched_switch(c9a09460,0,104,191,284abca0,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,4c,...) at mi_switch+0x200
sleepq_switch(c9a09460,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c91b9800,4c,c0c6db4c,0,0,...) at sleepq_wait+0x63
_sleep(c91b9800,c91b9820,24c,c0c6db4c,0,...) at _sleep+0x36b
md_kthread(c91b9800,e9067d38,c0c9646a,343,c9a042a8,...) at md_kthread+0x125
fork_exit(c06b5c80,c91b9800,e9067d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--More-- --- trap 0, eip = 0, esp = 0xe9067d70, ebp = 0 ---
Tracing command csh pid 1332 tid 100136 td 0xc963ad20
Tracing command login pid 1330 tid 100163 td 0xc9608d20
Tracing command sshd pid 1252 tid 100110 td 0xc952b460
sched_switch(c952b460,0,104,191,f5d0ba0,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c952b460,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c9b23990,0,c0c997e5,c952b460,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c9b239a4,0,e8fc4a7c,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c9b239a4,c9b23990,c0ca156d,603,c93ebb98,...) at _cv_wait_sig+0x240
seltdwait(c93ebb98,58,c9be9c80,c952b460,ebe,...) at seltdwait+0xa2
kern_select(c952b460,5,286090b0,0,0,0,20,8082308,1) at kern_select+0x4f4
select(c952b460,e8fc4cf8,14,c952b460,c0d877cc,...) at select+0x66
syscall(e8fc4d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x283cdc33, esp = 0xbfbfdf1c, ebp = 0xbfbfee38 ---
--More-- Tracing command syslogd pid 976 tid 100260 td 0xc9b21230
sched_switch(c9b21230,0,104,191,169dd954,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c9b21230,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c9b22290,0,c0c997e5,c9b21230,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c9b222a4,0,e921da7c,101,0,...) at sleepq_wait_sig+0x17
_cv_wait_sig(c9b222a4,c9b22290,c0ca156d,603,c94a79d8,...) at _cv_wait_sig+0x240
seltdwait(c94a79d8,58,c8575280,c9b21230,58,...) at seltdwait+0xa2
kern_select(c9b21230,8,282290ac,0,0,0,20,0,2822ac00) at kern_select+0x4f4
select(c9b21230,e921dcf8,14,c0cc174d,c0d877cc,...) at select+0x66
syscall(e921dd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x28190c33, esp = 0xbfbfde7c, ebp = 0xbfbfee28 ---
Tracing command devd pid 799 tid 100205 td 0xc961daf0
sched_switch(c961daf0,0,104,191,991254c,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c961daf0,0,c0c9f36f,1a0,0,...) at sleepq_switch+0x15f
sleepq_catch_signals(c087fcea,c9181790,0,c0c997e5,c961daf0,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c91817a4,0,e9158a7c,101,0,...) at sleepq_wait_sig+0x17
--More-- _cv_wait_sig(c91817a4,c9181790,c0ca156d,603,c93ec770,...) at _cv_wait_sig+0x240
seltdwait(c93ec770,58,c8575280,c961daf0,0,...) at seltdwait+0xa2
kern_select(c961daf0,6,bfbfe9b0,0,0,0,20,8097fbf,1) at kern_select+0x4f4
select(c961daf0,e9158cf8,14,c961daf0,c0d877cc,...) at select+0x66
syscall(e9158d38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (93, FreeBSD ELF32, select), eip = 0x8088b63, esp = 0xbfbfe97c, ebp = 0xbfbfee58 ---
Tracing command schedcpu pid 20 tid 100075 td 0xc8d0f460
sched_switch(c8d0f460,0,104,191,fdd1b610,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8d0f460,0,c0c9f36f,283,2,...) at sleepq_switch+0x15f
sleepq_timedwait(c0df8524,0,c0c9081a,2,0,...) at sleepq_timedwait+0x6b
_sleep(c0df8524,0,0,c0c9081a,3e8,...) at _sleep+0x339
pause(c0c9081a,3e8,21b,219,fc7c,...) at pause+0x47
schedcpu_thread(0,e8f33d38,c0c9646a,343,c908a2a8,...) at schedcpu_thread+0x24c
fork_exit(c08b39f0,0,e8f33d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe8f33d70, ebp = 0 ---
--More-- Tracing command flowcleaner pid 19 tid 100074 td 0xc8d0f690
sched_switch(c8d0f690,0,104,191,7670e96b,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8d0f690,0,c0c9f36f,283,c8d0f690,...) at sleepq_switch+0x15f
sleepq_timedwait(c0f5c148,0,e6d44cc4,1,0,...) at sleepq_timedwait+0x6b
_cv_timedwait(c0f5c148,c0f5c150,2710,3f0,0,...) at _cv_timedwait+0x250
flowtable_cleaner(0,e6d44d38,c0c9646a,343,c908a550,...) at flowtable_cleaner+0x1bf
fork_exit(c09393b0,0,e6d44d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d44d70, ebp = 0 ---
Tracing command softdepflush pid 18 tid 100073 td 0xc8d0f8c0
sched_switch(c8d0f8c0,0,104,191,f5f10ee5,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,44,...) at mi_switch+0x200
sleepq_switch(c8d0f8c0,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0f678a0,44,c0cc2273,0,0,...) at sleepq_timedwait+0x6b
_sleep(c0f678a0,c0f67844,44,c0cc2273,3e8,...) at _sleep+0x339
softdep_flush(0,e6d41d38,c0c9646a,343,c908a7f8,...) at softdep_flush+0x244
fork_exit(c0ac8b50,0,e6d41d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--More-- --- trap 0, eip = 0, esp = 0xe6d41d70, ebp = 0 ---
Tracing command syncer pid 17 tid 100072 td 0xc8d0faf0
sched_switch(c8d0faf0,0,104,191,da8767c0,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8d0faf0,0,c0c9f36f,283,c8d0faf0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0f5bf54,0,e6d3ec88,1,0,...) at sleepq_timedwait+0x6b
_cv_timedwait(c0f5bf54,c0f5bf40,3e8,6d4,4e20,...) at _cv_timedwait+0x250
sched_sync(0,e6d3ed38,c0c9646a,343,c908aaa0,...) at sched_sync+0x502
fork_exit(c0924070,0,e6d3ed38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d3ed70, ebp = 0 ---
Tracing command vnlru pid 16 tid 100071 td 0xc8d0fd20
sched_switch(c8d0fd20,0,104,191,b53a4825,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,50,...) at mi_switch+0x200
sleepq_switch(c8d0fd20,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c908ad48,50,c0ca92be,0,0,...) at sleepq_timedwait+0x6b
_sleep(c908ad48,c0f5bf14,250,c0ca92be,3e8,...) at _sleep+0x339
vnlru_proc(0,e6d3bd38,c0c9646a,343,c908ad48,...) at vnlru_proc+0xe7
--More-- fork_exit(c0924c20,0,e6d3bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d3bd70, ebp = 0 ---
Tracing command bufdaemon pid 15 tid 100070 td 0xc8d11000
sched_switch(c8d11000,0,104,191,a644f2a6,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,44,...) at mi_switch+0x200
sleepq_switch(c8d11000,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0f5bc88,44,c0ca6a18,0,0,...) at sleepq_timedwait+0x6b
_sleep(c0f5bc88,c0f5bc8c,44,c0ca6a18,3e8,...) at _sleep+0x339
buf_daemon(0,e6d38d38,c0c9646a,343,c85992a8,...) at buf_daemon+0x138
fork_exit(c090cbb0,0,e6d38d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d38d70, ebp = 0 ---
Tracing command pagezero pid 9 tid 100069 td 0xc8d11230
sched_switch(c8d11230,0,104,191,5e0deda3,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8d11230,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0f68a14,0,c0cc82e7,0,0,...) at sleepq_timedwait+0x6b
--More-- _sleep(c0f68a14,c0f68500,0,c0cc82e7,493e0,...) at _sleep+0x339
vm_pagezero(0,e6d35d38,c0c9646a,343,c8599550,...) at vm_pagezero+0xdc
fork_exit(c0b07050,0,e6d35d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d35d70, ebp = 0 ---
Tracing command vmdaemon pid 8 tid 100068 td 0xc8d11460
sched_switch(c8d11460,0,104,191,fc51444f,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,68,...) at mi_switch+0x200
sleepq_switch(c8d11460,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c0f68644,68,c0ca6a18,0,0,...) at sleepq_wait+0x63
_sleep(c0f68644,c0f68648,68,c0ca6a18,0,...) at _sleep+0x36b
vm_daemon(0,e6d32d38,c0c9646a,343,c85997f8,...) at vm_daemon+0x59
fork_exit(c0b014f0,0,e6d32d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d32d70, ebp = 0 ---
Tracing command pagedaemon pid 7 tid 100067 td 0xc8d11690
sched_switch(c8d11690,0,104,191,33ccefa4,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,44,...) at mi_switch+0x200
--More-- sleepq_switch(c8d11690,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0f6860c,44,c0ca6a18,0,0,...) at sleepq_timedwait+0x6b
_sleep(c0f6860c,c0f68500,44,c0ca6a18,1388,...) at _sleep+0x339
vm_pageout(0,e6d2fd38,c0c9646a,343,c8599aa0,...) at vm_pageout+0x2bb
fork_exit(c0b02390,0,e6d2fd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d2fd70, ebp = 0 ---
Tracing command fdc0 pid 6 tid 100065 td 0xc8d11af0
sched_switch(c8d11af0,0,104,191,d407a4f7,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,4c,...) at mi_switch+0x200
sleepq_switch(c8d11af0,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c8c1e23c,4c,c0c9081a,0,0,...) at sleepq_timedwait+0x6b
_sleep(c8c1e23c,c8c1e2f0,4c,c0c9081a,3e8,...) at _sleep+0x339
fdc_thread(c8c1e200,e6d29d38,c0c9646a,343,c8599d48,...) at fdc_thread+0x27d
fork_exit(c0b84650,c8c1e200,e6d29d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d29d70, ebp = 0 ---
Tracing command usb pid 14 tid 100062 td 0xc8b27460
--More-- sched_switch(c8b27460,0,104,191,b9fb43c9,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b27460,0,c0c9f36f,260,c8b27460,...) at sleepq_switch+0x15f
sleepq_wait(c8bb1d0c,0,e6af5cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8bb1d0c,c8bb1dac,c0c8927b,6c,c8bb1d14,...) at _cv_wait+0x240
usb_process(c8bb1d04,e6af5d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8bb1d04,e6af5d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6af5d70, ebp = 0 ---
Tracing command usb pid 14 tid 100061 td 0xc8b27690
sched_switch(c8b27690,0,104,191,29638d32,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b27690,0,c0c9f36f,260,c8b27690,...) at sleepq_switch+0x15f
sleepq_wait(c8bb1cdc,0,e6af2cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8bb1cdc,c8bb1dac,c0c8927b,6c,c8bb1ce4,...) at _cv_wait+0x240
usb_process(c8bb1cd4,e6af2d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8bb1cd4,e6af2d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6af2d70, ebp = 0 ---
--More--
Tracing command usb pid 14 tid 100060 td 0xc8b278c0
sched_switch(c8b278c0,0,104,191,b2eb8a24,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b278c0,0,c0c9f36f,260,c8b278c0,...) at sleepq_switch+0x15f
sleepq_wait(c8bb1cac,0,e6aefcbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8bb1cac,c8bb1dac,c0c8927b,6c,c8bb1cb4,...) at _cv_wait+0x240
usb_process(c8bb1ca4,e6aefd38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8bb1ca4,e6aefd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6aefd70, ebp = 0 ---
Tracing command usb pid 14 tid 100059 td 0xc8b27af0
sched_switch(c8b27af0,0,104,191,b2eb7578,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b27af0,0,c0c9f36f,260,c8b27af0,...) at sleepq_switch+0x15f
sleepq_wait(c8bb1c7c,0,e6aeccbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8bb1c7c,c8bb1dac,c0c8927b,6c,c8bb1c84,...) at _cv_wait+0x240
usb_process(c8bb1c74,e6aecd38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8bb1c74,e6aecd38) at fork_exit+0xb8
--More-- fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6aecd70, ebp = 0 ---
Tracing command usb pid 14 tid 100058 td 0xc8b27d20
sched_switch(c8b27d20,0,104,191,b2eb5eef,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b27d20,0,c0c9f36f,260,c8b27d20,...) at sleepq_switch+0x15f
sleepq_wait(c8b89dac,0,e6ae7cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b89dac,c8b89e4c,c0c8927b,6c,c8b89db4,...) at _cv_wait+0x240
usb_process(c8b89da4,e6ae7d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b89da4,e6ae7d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ae7d70, ebp = 0 ---
Tracing command usb pid 14 tid 100057 td 0xc8b83000
sched_switch(c8b83000,0,104,191,fd791c25,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b83000,0,c0c9f36f,260,c8b83000,...) at sleepq_switch+0x15f
sleepq_wait(c8b89d7c,0,e6ae4cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b89d7c,c8b89e4c,c0c8927b,6c,c8b89d84,...) at _cv_wait+0x240
--More-- usb_process(c8b89d74,e6ae4d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b89d74,e6ae4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ae4d70, ebp = 0 ---
Tracing command usb pid 14 tid 100056 td 0xc8b83230
sched_switch(c8b83230,0,104,191,ac0bc3c2,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b83230,0,c0c9f36f,260,c8b83230,...) at sleepq_switch+0x15f
sleepq_wait(c8b89d4c,0,e6ae1cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b89d4c,c8b89e4c,c0c8927b,6c,c8b89d54,...) at _cv_wait+0x240
usb_process(c8b89d44,e6ae1d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b89d44,e6ae1d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ae1d70, ebp = 0 ---
Tracing command usb pid 14 tid 100055 td 0xc8b83460
sched_switch(c8b83460,0,104,191,ac0bb2c7,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b83460,0,c0c9f36f,260,c8b83460,...) at sleepq_switch+0x15f
--More-- sleepq_wait(c8b89d1c,0,e6adecbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b89d1c,c8b89e4c,c0c8927b,6c,c8b89d24,...) at _cv_wait+0x240
usb_process(c8b89d14,e6aded38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b89d14,e6aded38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6aded70, ebp = 0 ---
Tracing command usb pid 14 tid 100053 td 0xc8b838c0
sched_switch(c8b838c0,0,104,191,ac0b9a10,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b838c0,0,c0c9f36f,260,c8b838c0,...) at sleepq_switch+0x15f
sleepq_wait(c8b67dac,0,e6ad7cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b67dac,c8b67e4c,c0c8927b,6c,c8b67db4,...) at _cv_wait+0x240
usb_process(c8b67da4,e6ad7d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b67da4,e6ad7d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ad7d70, ebp = 0 ---
Tracing command usb pid 14 tid 100052 td 0xc8b83af0
sched_switch(c8b83af0,0,104,191,fd785be0,...) at sched_switch+0x1c5
--More-- mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b83af0,0,c0c9f36f,260,c8b83af0,...) at sleepq_switch+0x15f
sleepq_wait(c8b67d7c,0,e6ad4cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b67d7c,c8b67e4c,c0c8927b,6c,c8b67d84,...) at _cv_wait+0x240
usb_process(c8b67d74,e6ad4d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b67d74,e6ad4d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ad4d70, ebp = 0 ---
Tracing command usb pid 14 tid 100051 td 0xc8b83d20
sched_switch(c8b83d20,0,104,191,a52b1249,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b83d20,0,c0c9f36f,260,c8b83d20,...) at sleepq_switch+0x15f
sleepq_wait(c8b67d4c,0,e6ad1cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b67d4c,c8b67e4c,c0c8927b,6c,c8b67d54,...) at _cv_wait+0x240
usb_process(c8b67d44,e6ad1d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b67d44,e6ad1d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ad1d70, ebp = 0 ---
--More-- Tracing command usb pid 14 tid 100050 td 0xc89af690
sched_switch(c89af690,0,104,191,a52b0049,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89af690,0,c0c9f36f,260,c89af690,...) at sleepq_switch+0x15f
sleepq_wait(c8b67d1c,0,e6acecbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b67d1c,c8b67e4c,c0c8927b,6c,c8b67d24,...) at _cv_wait+0x240
usb_process(c8b67d14,e6aced38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b67d14,e6aced38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6aced70, ebp = 0 ---
Tracing command usb pid 14 tid 100048 td 0xc89afaf0
sched_switch(c89afaf0,0,104,191,a52ae822,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89afaf0,0,c0c9f36f,260,c89afaf0,...) at sleepq_switch+0x15f
sleepq_wait(c8b3fdac,0,e6ac8cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b3fdac,c8b3fe4c,c0c8927b,6c,c8b3fdb4,...) at _cv_wait+0x240
usb_process(c8b3fda4,e6ac8d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b3fda4,e6ac8d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--More-- --- trap 0, eip = 0, esp = 0xe6ac8d70, ebp = 0 ---
Tracing command usb pid 14 tid 100047 td 0xc89afd20
sched_switch(c89afd20,0,104,191,fd77a396,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89afd20,0,c0c9f36f,260,c89afd20,...) at sleepq_switch+0x15f
sleepq_wait(c8b3fd7c,0,e6ac5cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b3fd7c,c8b3fe4c,c0c8927b,6c,c8b3fd84,...) at _cv_wait+0x240
usb_process(c8b3fd74,e6ac5d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b3fd74,e6ac5d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ac5d70, ebp = 0 ---
Tracing command usb pid 14 tid 100046 td 0xc8b26000
sched_switch(c8b26000,0,104,191,9e4abeae,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b26000,0,c0c9f36f,260,c8b26000,...) at sleepq_switch+0x15f
sleepq_wait(c8b3fd4c,0,e6ac2cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b3fd4c,c8b3fe4c,c0c8927b,6c,c8b3fd54,...) at _cv_wait+0x240
usb_process(c8b3fd44,e6ac2d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
--More-- fork_exit(c07c1e00,c8b3fd44,e6ac2d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ac2d70, ebp = 0 ---
Tracing command usb pid 14 tid 100045 td 0xc8b26230
sched_switch(c8b26230,0,104,191,9e4aac93,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b26230,0,c0c9f36f,260,c8b26230,...) at sleepq_switch+0x15f
sleepq_wait(c8b3fd1c,0,e6abfcbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b3fd1c,c8b3fe4c,c0c8927b,6c,c8b3fd24,...) at _cv_wait+0x240
usb_process(c8b3fd14,e6abfd38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b3fd14,e6abfd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6abfd70, ebp = 0 ---
Tracing command usb pid 14 tid 100043 td 0xc8b26690
sched_switch(c8b26690,0,104,191,9e4a9262,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b26690,0,c0c9f36f,260,c8b26690,...) at sleepq_switch+0x15f
sleepq_wait(c8b02dac,0,e6ab9cbc,1,0,...) at sleepq_wait+0x63
--More-- _cv_wait(c8b02dac,c8b02e4c,c0c8927b,6c,c8b02db4,...) at _cv_wait+0x240
usb_process(c8b02da4,e6ab9d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b02da4,e6ab9d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ab9d70, ebp = 0 ---
Tracing command usb pid 14 tid 100042 td 0xc8b268c0
sched_switch(c8b268c0,0,104,191,fd76c67d,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b268c0,0,c0c9f36f,260,c8b268c0,...) at sleepq_switch+0x15f
sleepq_wait(c8b02d7c,0,e6ab6cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b02d7c,c8b02e4c,c0c8927b,6c,c8b02d84,...) at _cv_wait+0x240
usb_process(c8b02d74,e6ab6d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b02d74,e6ab6d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ab6d70, ebp = 0 ---
Tracing command usb pid 14 tid 100041 td 0xc8b26af0
sched_switch(c8b26af0,0,104,191,976a2eda,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
--More-- sleepq_switch(c8b26af0,0,c0c9f36f,260,c8b26af0,...) at sleepq_switch+0x15f
sleepq_wait(c8b02d4c,0,e6ab3cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b02d4c,c8b02e4c,c0c8927b,6c,c8b02d54,...) at _cv_wait+0x240
usb_process(c8b02d44,e6ab3d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b02d44,e6ab3d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ab3d70, ebp = 0 ---
Tracing command usb pid 14 tid 100040 td 0xc8b26d20
sched_switch(c8b26d20,0,104,191,976a1944,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8b26d20,0,c0c9f36f,260,c8b26d20,...) at sleepq_switch+0x15f
sleepq_wait(c8b02d1c,0,e6ab0cbc,1,0,...) at sleepq_wait+0x63
_cv_wait(c8b02d1c,c8b02e4c,c0c8927b,6c,c8b02d24,...) at _cv_wait+0x240
usb_process(c8b02d14,e6ab0d38,c0c9646a,343,c89a8000,...) at usb_process+0x193
fork_exit(c07c1e00,c8b02d14,e6ab0d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6ab0d70, ebp = 0 ---
Tracing command xpt_thrd pid 5 tid 100034 td 0xc89ad690
--More-- sched_switch(c89ad690,0,104,191,9769fca6,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,4c,...) at mi_switch+0x200
sleepq_switch(c89ad690,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c0dc48d4,4c,c0c34619,0,0,...) at sleepq_wait+0x63
_sleep(c0dc48d4,c0dc48ec,4c,c0c34619,0,...) at _sleep+0x36b
xpt_scanner_thread(0,c6383d38,c0c9646a,343,c89a82a8,...) at xpt_scanner_thread+0x4a
fork_exit(c0484710,0,c6383d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6383d70, ebp = 0 ---
Tracing command yarrow pid 13 tid 100025 td 0xc85a6af0
sched_switch(c85a6af0,0,104,191,465bcbc7,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c85a6af0,0,c0c9f36f,283,2,...) at sleepq_switch+0x15f
sleepq_timedwait(c0df8524,0,c0c9081a,2,0,...) at sleepq_timedwait+0x6b
_sleep(c0df8524,0,0,c0c9081a,64,...) at _sleep+0x339
pause(c0c9081a,64,c0c7ccfd,111,0,...) at pause+0x47
random_kthread(0,c6368d38,c0c9646a,343,c89a8550,...) at random_kthread+0x1ef
fork_exit(c0738850,0,c6368d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--More-- --- trap 0, eip = 0, esp = 0xc6368d70, ebp = 0 ---
Tracing command g_down pid 4 tid 100023 td 0xc8738000
sched_switch(c8738000,0,104,191,2848f605,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,4c,...) at mi_switch+0x200
sleepq_switch(c8738000,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c0df62e4,4c,c0c9081a,0,0,...) at sleepq_wait+0x63
_sleep(c0df62e4,c0df6248,24c,c0c9081a,0,...) at _sleep+0x36b
g_io_schedule_down(c8738000,0,c0c91e62,74,0,...) at g_io_schedule_down+0x56
g_down_procbody(0,c635ed38,c0c9646a,343,c8597000,...) at g_down_procbody+0x8d
fork_exit(c082de00,0,c635ed38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc635ed70, ebp = 0 ---
Tracing command g_up pid 3 tid 100022 td 0xc8738230
sched_switch(c8738230,0,104,191,284b3632,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,4c,...) at mi_switch+0x200
sleepq_switch(c8738230,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c0df62e0,4c,c0c9081a,0,0,...) at sleepq_wait+0x63
_sleep(c0df62e0,c0df6268,24c,c0c9081a,0,...) at _sleep+0x36b
--More-- g_io_schedule_up(c8738230,0,c0c91e62,5d,0,...) at g_io_schedule_up+0x11e
g_up_procbody(0,c635bd38,c0c9646a,343,c85972a8,...) at g_up_procbody+0x8d
fork_exit(c082de90,0,c635bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc635bd70, ebp = 0 ---
Tracing command g_event pid 2 tid 100021 td 0xc8738460
sched_switch(c8738460,0,104,191,43dc3c57,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,4c,...) at mi_switch+0x200
sleepq_switch(c8738460,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0df62d8,4c,c0c9081a,0,0,...) at sleepq_timedwait+0x6b
_sleep(c0df62d8,0,4c,c0c9081a,64,...) at _sleep+0x339
g_event_procbody(0,c6358d38,c0c9646a,343,c8597550,...) at g_event_procbody+0xcb
fork_exit(c082df20,0,c6358d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6358d70, ebp = 0 ---
Tracing command intr pid 12 tid 100066 td 0xc8d118c0
fork_trampoline() at fork_trampoline
--More-- Tracing command intr pid 12 tid 100064 td 0xc8d11d20
sched_switch(c8d11d20,0,109,191,489cd9b5,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c8cc66f0,...) at mi_switch+0x200
ithread_loop(c8d0a980,e6d1cd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8d0a980,e6d1cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d1cd70, ebp = 0 ---
Tracing command intr pid 12 tid 100063 td 0xc8b27230
sched_switch(c8b27230,0,109,191,f1c36081,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85e5af0,...) at mi_switch+0x200
ithread_loop(c8ccbb80,e6d06d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8ccbb80,e6d06d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6d06d70, ebp = 0 ---
Tracing command intr pid 12 tid 100054 td 0xc8b83690
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100049 td 0xc89af8c0
--More-- sched_switch(c89af8c0,0,109,191,910e9f41,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85e52f0,...) at mi_switch+0x200
ithread_loop(c8b7ee80,e6acbd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8b7ee80,e6acbd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6acbd70, ebp = 0 ---
Tracing command intr pid 12 tid 100044 td 0xc8b26460
sched_switch(c8b26460,0,109,191,8fe9f370,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85e50f0,...) at mi_switch+0x200
ithread_loop(c8b52b80,e6abcd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8b52b80,e6abcd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xe6abcd70, ebp = 0 ---
Tracing command intr pid 12 tid 100039 td 0xc8b27000
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100036 td 0xc89ad230
fork_trampoline() at fork_trampoline
--More--
Tracing command intr pid 12 tid 100035 td 0xc89ad460
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100033 td 0xc89ad8c0
sched_switch(c89ad8c0,0,109,191,ec2bf8,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c89a9af0,...) at mi_switch+0x200
ithread_loop(c899f380,c6380d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c899f380,c6380d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6380d70, ebp = 0 ---
Tracing command intr pid 12 tid 100032 td 0xc89adaf0
sched_switch(c89adaf0,0,109,191,f120b70a,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c89a9cf0,...) at mi_switch+0x200
ithread_loop(c899f680,c637dd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c899f680,c637dd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc637dd70, ebp = 0 ---
--More-- Tracing command intr pid 12 tid 100030 td 0xc89af000
sched_switch(c89af000,0,109,191,fb271174,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c89a9ef0,...) at mi_switch+0x200
ithread_loop(c899fb80,c6377d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c899fb80,c6377d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6377d70, ebp = 0 ---
Tracing command intr pid 12 tid 100020 td 0xc8738690
fork_trampoline() at fork_trampoline
Tracing command intr pid 12 tid 100019 td 0xc87388c0
sched_switch(c87388c0,0,109,191,fc9e58b7,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ec6f0,...) at mi_switch+0x200
ithread_loop(c858fb80,c6352d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c858fb80,c6352d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6352d70, ebp = 0 ---
Tracing command intr pid 12 tid 100018 td 0xc8738af0
--More-- sched_switch(c8738af0,0,109,191,130452da,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ec8f0,...) at mi_switch+0x200
ithread_loop(c8590c80,c634fd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8590c80,c634fd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc634fd70, ebp = 0 ---
Tracing command intr pid 12 tid 100017 td 0xc859c230
sched_switch(c859c230,0,109,191,e5b9956,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ecaf0,...) at mi_switch+0x200
ithread_loop(c8590e80,c634cd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8590e80,c634cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc634cd70, ebp = 0 ---
Tracing command intr pid 12 tid 100016 td 0xc859c460
sched_switch(c859c460,0,109,191,125621ff,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85eccf0,...) at mi_switch+0x200
ithread_loop(c8591180,c6349d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8591180,c6349d38) at fork_exit+0xb8
--More-- fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6349d70, ebp = 0 ---
Tracing command intr pid 12 tid 100015 td 0xc859c690
sched_switch(c859c690,0,109,191,38e55c40,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ecef0,...) at mi_switch+0x200
ithread_loop(c8591380,c6346d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8591380,c6346d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6346d70, ebp = 0 ---
Tracing command intr pid 12 tid 100014 td 0xc859c8c0
sched_switch(c859c8c0,0,109,191,465b44d9,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ed0f0,...) at mi_switch+0x200
ithread_loop(c8591580,c6343d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8591580,c6343d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6343d70, ebp = 0 ---
Tracing command intr pid 12 tid 100013 td 0xc859caf0
--More-- sched_switch(c859caf0,0,109,191,13c85aa4,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ed2f0,...) at mi_switch+0x200
ithread_loop(c8591780,c6340d38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8591780,c6340d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6340d70, ebp = 0 ---
Tracing command intr pid 12 tid 100012 td 0xc859cd20
sched_switch(c859cd20,0,109,191,48de385d,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85ed4f0,...) at mi_switch+0x200
ithread_loop(c8591980,c633dd38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8591980,c633dd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc633dd70, ebp = 0 ---
Tracing command intr pid 12 tid 100011 td 0xc85a6000
sched_switch(c85a6000,0,109,191,129c612b,...) at sched_switch+0x1c5
mi_switch(109,0,c0c96707,52d,c85e7ef0,...) at mi_switch+0x200
ithread_loop(c8591b80,c633ad38,c0c9646a,343,c85977f8,...) at ithread_loop+0x1f6
fork_exit(c0868900,c8591b80,c633ad38) at fork_exit+0xb8
--More-- fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc633ad70, ebp = 0 ---
Tracing command idle pid 11 tid 100010 td 0xc85a6230
sched_switch(c85a6230,0,108,18c,46a192b4,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c6335d24,...) at mi_switch+0x200
sched_idletd(0,c6335d38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c6335d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6335d70, ebp = 0 ---
Tracing command idle pid 11 tid 100009 td 0xc85a6460
sched_switch(c85a6460,0,108,18c,46a1d364,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c6332d24,...) at mi_switch+0x200
sched_idletd(0,c6332d38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c6332d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6332d70, ebp = 0 ---
Tracing command idle pid 11 tid 100008 td 0xc859a000
--More-- sched_switch(c859a000,0,108,18c,ca332d38,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c632fd24,...) at mi_switch+0x200
sched_idletd(0,c632fd38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c632fd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc632fd70, ebp = 0 ---
Tracing command idle pid 11 tid 100007 td 0xc859a230
sched_switch(c859a230,0,108,18c,46a14f19,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c632cd24,...) at mi_switch+0x200
sched_idletd(0,c632cd38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c632cd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc632cd70, ebp = 0 ---
Tracing command idle pid 11 tid 100006 td 0xc859a460
sched_switch(c859a460,0,108,18c,46a2181f,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c6329d24,...) at mi_switch+0x200
sched_idletd(0,c6329d38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c6329d38) at fork_exit+0xb8
--More-- fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6329d70, ebp = 0 ---
Tracing command idle pid 11 tid 100005 td 0xc859a690
sched_switch(c859a690,0,108,18c,46a2650b,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c6326d24,...) at mi_switch+0x200
sched_idletd(0,c6326d38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c6326d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6326d70, ebp = 0 ---
Tracing command idle pid 11 tid 100004 td 0xc859a8c0
sched_switch(c859a8c0,0,108,18c,46a2d756,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c6323d24,...) at mi_switch+0x200
sched_idletd(0,c6323d38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c6323d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6323d70, ebp = 0 ---
Tracing command idle pid 11 tid 100003 td 0xc859aaf0
--More-- sched_switch(c859aaf0,0,108,18c,46a2aa9e,...) at sched_switch+0x1c5
mi_switch(108,0,c0c9cd5a,60c,c6320d24,...) at mi_switch+0x200
sched_idletd(0,c6320d38,c0c9646a,343,c8597aa0,...) at sched_idletd+0x81
fork_exit(c08b2ed0,0,c6320d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6320d70, ebp = 0 ---
Tracing command init pid 1 tid 100002 td 0xc859ad20
sched_switch(c859ad20,0,104,191,101c0579,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,5c,...) at mi_switch+0x200
sleepq_switch(c859ad20,0,c0c9f36f,1a0,5c,...) at sleepq_switch+0x15f
sleepq_catch_signals(c0c9f36f,160,0,100,100,...) at sleepq_catch_signals+0xb7
sleepq_wait_sig(c8597d48,5c,c0ca1b60,100,0,...) at sleepq_wait_sig+0x17
_sleep(c8597d48,c8597dd0,15c,c0ca1b60,0,...) at _sleep+0x354
kern_wait(c859ad20,ffffffff,c631cc74,0,0,...) at kern_wait+0xb76
wait4(c859ad20,c631ccf8,10,c0ca1973,c0d86e64,...) at wait4+0x3b
syscall(c631cd38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054b8f, esp = 0xbfbfe90c, ebp = 0xbfbfe928 ---
--More-- Tracing command audit pid 10 tid 100001 td 0xc859c000
sched_switch(c859c000,0,104,191,97676003,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c859c000,0,c0c9f36f,260,c859c000,...) at sleepq_switch+0x15f
sleepq_wait(c0f671c0,0,c6319c9c,1,0,...) at sleepq_wait+0x63
_cv_wait(c0f671c0,c0f671a4,c0cbf8ad,194,0,...) at _cv_wait+0x240
audit_worker(0,c6319d38,c0c9646a,343,c8599000,...) at audit_worker+0x84
fork_exit(c0a98360,0,c6319d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6319d70, ebp = 0 ---
Tracing command kernel pid 0 tid 100038 td 0xc8738d20
sched_switch(c8738d20,0,104,191,910e540e,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c8738d20,0,c0c9f36f,260,c8738d20,...) at sleepq_switch+0x15f
sleepq_wait(c8abad80,0,c0c9bcf0,c0c9081a,0,...) at sleepq_wait+0x63
msleep_spin(c8abad80,c8abad98,c0c9081a,0,c0c997e5,...) at msleep_spin+0x21d
taskqueue_thread_loop(c8ab45a0,c63fcd38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0x94
fork_exit(c08ccfa0,c8ab45a0,c63fcd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--More-- --- trap 0, eip = 0, esp = 0xc63fcd70, ebp = 0 ---
Tracing command kernel pid 0 tid 100037 td 0xc89ad000
sched_switch(c89ad000,0,104,191,14e77254,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89ad000,0,c0c9f36f,260,c89ad000,...) at sleepq_switch+0x15f
sleepq_wait(c8a99980,0,c0c9bcf0,c0c9081a,0,...) at sleepq_wait+0x63
msleep_spin(c8a99980,c8a99998,c0c9081a,0,c0c997e5,...) at msleep_spin+0x21d
taskqueue_thread_loop(c8a955a0,c63f9d38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0x94
fork_exit(c08ccfa0,c8a955a0,c63f9d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc63f9d70, ebp = 0 ---
Tracing command kernel pid 0 tid 100031 td 0xc89add20
sched_switch(c89add20,0,104,191,f664854a,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89add20,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c899fa80,0,c0c9081a,0,0,...) at sleepq_wait+0x63
_sleep(c899fa80,c899fa98,0,c0c9081a,0,...) at _sleep+0x36b
taskqueue_thread_loop(c0e01e88,c637ad38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0xba
--More-- fork_exit(c08ccfa0,c0e01e88,c637ad38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc637ad70, ebp = 0 ---
Tracing command kernel pid 0 tid 100029 td 0xc89af230
sched_switch(c89af230,0,104,191,d2452e7e,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89af230,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c89a0080,0,c0c9081a,0,0,...) at sleepq_wait+0x63
_sleep(c89a0080,c89a0098,0,c0c9081a,0,...) at _sleep+0x36b
taskqueue_thread_loop(c0df6c38,c6374d38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0xba
fork_exit(c08ccfa0,c0df6c38,c6374d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6374d70, ebp = 0 ---
Tracing command kernel pid 0 tid 100028 td 0xc89af460
sched_switch(c89af460,0,104,191,d245183d,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c89af460,0,c0c9f36f,260,c89af460,...) at sleepq_switch+0x15f
sleepq_wait(c89a2080,0,c0c9bcf0,c0c9081a,0,...) at sleepq_wait+0x63
--More-- msleep_spin(c89a2080,c89a2098,c0c9081a,0,c0c997e5,...) at msleep_spin+0x21d
taskqueue_thread_loop(c0dc7720,c6371d38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0x94
fork_exit(c08ccfa0,c0dc7720,c6371d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6371d70, ebp = 0 ---
Tracing command kernel pid 0 tid 100027 td 0xc85a6690
sched_switch(c85a6690,0,104,191,d245082c,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c85a6690,0,c0c9f36f,260,c85a6690,...) at sleepq_switch+0x15f
sleepq_wait(c89a2080,0,c0c9bcf0,c0c9081a,0,...) at sleepq_wait+0x63
msleep_spin(c89a2080,c89a2098,c0c9081a,0,c0c997e5,...) at msleep_spin+0x21d
taskqueue_thread_loop(c0dc7720,c636ed38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0x94
fork_exit(c08ccfa0,c0dc7720,c636ed38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc636ed70, ebp = 0 ---
Tracing command kernel pid 0 tid 100026 td 0xc85a68c0
sched_switch(c85a68c0,0,104,191,d244f3ad,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
--More-- sleepq_switch(c85a68c0,0,c0c9f36f,260,c85a68c0,...) at sleepq_switch+0x15f
sleepq_wait(c89a2080,0,c0c9bcf0,c0c9081a,0,...) at sleepq_wait+0x63
msleep_spin(c89a2080,c89a2098,c0c9081a,0,c0c997e5,...) at msleep_spin+0x21d
taskqueue_thread_loop(c0dc7720,c636bd38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0x94
fork_exit(c08ccfa0,c0dc7720,c636bd38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc636bd70, ebp = 0 ---
Tracing command kernel pid 0 tid 100024 td 0xc85a6d20
sched_switch(c85a6d20,0,104,191,2b259d35,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,0,...) at mi_switch+0x200
sleepq_switch(c85a6d20,0,c0c9f36f,260,0,...) at sleepq_switch+0x15f
sleepq_wait(c858f080,0,c0c9081a,0,0,...) at sleepq_wait+0x63
_sleep(c858f080,c858f098,0,c0c9081a,0,...) at _sleep+0x36b
taskqueue_thread_loop(c0e00920,c6361d38,c0c9646a,343,c0df63c0,...) at taskqueue_thread_loop+0xba
fork_exit(c08ccfa0,c0e00920,c6361d38) at fork_exit+0xb8
fork_trampoline() at fork_trampoline+0x8
--- trap 0, eip = 0, esp = 0xc6361d70, ebp = 0 ---
Tracing command kernel pid 0 tid 100000 td 0xc0df6670
--More-- sched_switch(c0df6670,0,104,191,69e7870c,...) at sched_switch+0x1c5
mi_switch(104,0,c0c9f36f,1eb,44,...) at mi_switch+0x200
sleepq_switch(c0df6670,0,c0c9f36f,283,0,...) at sleepq_switch+0x15f
sleepq_timedwait(c0df63c0,44,c0c9d0fd,0,0,...) at sleepq_timedwait+0x6b
_sleep(c0df63c0,0,44,c0c9d0fd,2710,...) at _sleep+0x339
scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x23e
mi_startup() at mi_startup+0x96
begin() at begin+0x2c
db>call doadump
Physical memory: 3054 MB
Dumping 193 MB: 178 162 146 130 114 98 82 66 50 34 18 2
Dump complete
= 0xf
db> show msgbuf
msgbufp = 0xc1488fe4
magic = 63062, size = 65508, r= 575317, w = 577567, ptr = 0xc1479000, cksum= 5096264
<3>pid 79113 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
panic: Thread 0xc9633af0 lock 0xc0dfc024 does not match 0xc9d3e280
cpuid = 1
KDB: stack backtrace:
db_trace_self_wrapper(c0c9e1dc,e978a850,c088f679,c0cd422b,1,...) at db_trace_self_wrapper+0x26
kdb_backtrace(c0cd422b,1,c0c9f546,e978a85c,1,...) at kdb_backtrace+0x29
panic(c0c9f546,c9633af0,c0dfc024,c9d3e280,c0f5bd3c,...) at panic+0x119
turnstile_claim(c9d3e280,2,c0ca7376,1f0,4,...) at turnstile_claim+0x148
_rw_try_upgrade(c0f5bd3c,c0ca7376,1f0,e978a990,e978ab88,...) at _rw_try_upgrade+0xe6
cache_lookup(c99e9bb0,e978ab74,e978ab88,0,0,...) at cache_lookup+0x362
nfs_lookup(e978aa50,e978aa50,e978ab5c,200000,e978ab5c,...) at nfs_lookup+0xf6
VOP_LOOKUP_APV(c0da5fe0,e978aa50,e978ab88,1f1,e978ab74,...) at VOP_LOOKUP_APV+0xa5
lookup(e978ab5c,c0ca7aea,ea,c5,cc093d48,...) at lookup+0x66b
namei(e978ab5c,c08d3aab,c0c94c96,c0c92df9,3,...) at namei+0x55f
kern_statat_vnhook(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat_vnhook+0x72
kern_statat(c8c59af0,0,ffffff9c,bfbfdf78,0,...) at kern_statat+0x3c
kern_stat(c8c59af0,bfbfdf78,0,e978ac18,2,...) at kern_stat+0x36
stat(c8c59af0,e978acf8,8,c0ca19f2,c0d88230,...) at stat+0x2f
--More-- syscall(e978ad38) at syscall+0x2a3
Xint0x80_syscall() at Xint0x80_syscall+0x20
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2817d1a3, esp = 0xbfbfdecc, ebp = 0xbfbfe388 ---
KDB: enter: panic
shared lockmgr nfs (nfs) r = 0 (0xc99e9af8) locked @ /zoo/gianni/testbox/sys/kern/vfs_subr.c:2091
exclusive sleep mutex process lock (process lock) r = 0 (0xc9c15dd0) locked @ /zoo/gianni/testbox/sys/kern/kern_thr.c:231
shared rw Name Cache (Name Cache) r = 0 (0xc0f5bd3c) locked @ /zoo/gianni/testbox/sys/kern/vfs_cache.c:390
shared lockmgr nfs (nfs) r = 0 (0xc99e9c08) locked @ /zoo/gianni/testbox/sys/kern/vfs_subr.c:2091
0xc99e9bb0: tag nfs, type VDIR
usecount 1, writecount 0, refcount 2 mountedhere 0
flags ()
lock type nfs: SHARED (count 1)
fileid -377969560 fsid 0xc0cbc89d
0xc99e9aa0: tag nfs, type VDIR
usecount 1, writecount 0, refcount 2 mountedhere 0
flags ()
lock type nfs: SHARED (count 1)
fileid -377969560 fsid 0xc0cbc89d
--More-- Physical memory: 3054 MB
Dumping 193 MB: 178 162 146 130 114 98 82 66 50 34 18 2
Dump complete
on /root/tmp: out of inodes
<118>Jan 19 12:51:47 lion1 kernel: pid 46551 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 46545 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 12:51:49 lion1 kernel: pid 46545 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 12:51:49 lion1 kernel: pid 46545 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<3>pid 47982 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 12:56:55 lion1 kernel: pid 47982 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 48012 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 12:56:57 lion1 kernel: pid 48012 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 48018 (rw), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 12:57:00 lion1 kernel: pid 48018 (rw), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 47993 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 12:57:02 lion1 kernel: pid 47993 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 48727 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:00:40 lion1 kernel: pid 48727 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 48733 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:00:43 lion1 kernel: pid 48733 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
--More-- <3>pid 48775 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:00:45 lion1 kernel: pid 48775 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 48745 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:00:48 lion1 kernel: pid 48745 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:00:48 lion1 kernel: pid 48745 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 48745 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 48753 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:00:50 lion1 kernel: pid 48745 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:00:50 lion1 kernel: pid 48745 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:00:52 lion1 kernel: pid 48753 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:00:52 lion1 kernel: pid 48753 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 48781 (creat), uid 0 inumber 578 on /root/tmp: out of inodes
<118>Jan 19 13:00:54 lion1 kernel: pid 48781 (creat), uid 0 inumber 578 on /root/tmp: out of inodes
<118>Jan 19 13:00:54 lion1 kernel: pid 48781 (creat), uid 0 inumber 578 on /root/tmp: out of inodes
<3>pid 48773 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:00:56 lion1 kernel: pid 48773 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:00:56 lion1 kernel: pid 48773 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 48773 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 48759 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:00:58 lion1 kernel: pid 48773 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:00:58 lion1 kernel: pid 48773 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:01:00 lion1 kernel: pid 48759 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:01:00 lion1 kernel: pid 48759 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 49481 (rw), uid 0, was killed: exceeded maximum CPU limit
<118>Jan 19 13:08:30 lion1 kernel: pid 49481 (rw), uid 0, was killed: exceeded maximum CPU limit
<3>pid 50282 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:08:34 lion1 kernel: pid 50282 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:08:35 lion1 kernel: pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50270 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:08:36 lion1 kernel: pid 50270 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:08:37 lion1 kernel: pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>an 19 13:08:37 lion1 kernel: pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>an 19 13:08:37 lion1 kernel: pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50252 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:08:42 lion1 last message repeated 2 times
<118>Jan 19 13:08:44 lion1 kernel: pid 50252 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
--More-- <3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:08:45 lion1 kernel: pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50247 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 50249 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:08:53 lion1 last message repeated 4 times
<118>Jan 19 13:08:55 lion1 kernel: pid 50249 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:08:53 lion1 last message repeated 4 times
<118>Jan 19 13:08:55 lion1 kernel: pid 50249 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 50256 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:08:57 lion1 kernel: pid 50256 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:08:57 lion1 kernel: pid 50256 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 50254 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:09:00 lion1 kernel: pid 50254 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:09:00 lion1 kernel: pid 50254 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 50249 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:09:02 lion1 kernel: pid 50249 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:09:02 lion1 kernel: pid 50249 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
--More-- <3>pid 51062 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:11:40 lion1 kernel: pid 51062 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 51056 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:11:43 lion1 kernel: pid 51056 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:11:45 lion1 kernel: pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:11:46 lion1 kernel: pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:11:46 lion1 kernel: pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 51039 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:11:50 lion1 last message repeated 2 times
<118>Jan 19 13:11:50 lion1 last message repeated 2 times
<118>Jan 19 13:11:52 lion1 kernel: pid 51039 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:11:52 lion1 kernel: pid 51039 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:11:54 lion1 kernel: pid 51038 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:11:56 lion1 kernel: pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:11:56 lion1 kernel: pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 51037 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:11:58 lion1 kernel: pid 51037 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:12:00 lion1 kernel: pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:12:00 lion1 kernel: pid 51036 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 51049 (rw), uid 0, was killed: exceeded maximum CPU limit
<118>Jan 19 13:14:55 lion1 kernel: pid 51049 (rw), uid 0, was killed: exceeded maximum CPU limit
<3>pid 51791 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:15:26 lion1 kernel: pid 51791 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 52531 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<118>Jan 19 13:18:15 lion1 kernel: pid 52531 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<118>Jan 19 13:18:15 lion1 kernel: pid 52531 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<3>pid 52526 (creat), uid 0 inumber 577 on /root/tmp: out of inodes
<118>Jan 19 13:18:17 lion1 kernel: pid 52526 (creat), uid 0 inumber 577 on /root/tmp: out of inodes
<3>pid 52495 (rw), uid 0 inumber 619 on /root/tmp: filesystem full
<118>Jan 19 13:18:17 lion1 kernel: pid 52495 (rw), uid 0 inumber 619 on /root/tmp: filesystem full
<118>Jan 19 13:18:17 lion1 kernel: pid 52495 (rw), uid 0 inumber 619 on /root/tmp: filesystem full
<3>pid 52522 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 52509 (rw), uid 0 inumber 619 on /root/tmp: filesystem full
--More-- <3>pid 52512 (rw), uid 0 inumber 615 on /root/tmp: filesystem full
<118>Jan 19 13:18:18 lion1 kernel: pid 52522 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:18:18 lion1 kernel: pid 52509 (rw), uid 0 inumber 619 on /root/tmp: filesystem full
<118>Jan 19 13:18:18 lion1 kernel: pid 52512 (rw), uid 0 inumber 615 on /root/tmp: filesystem full
<3>pid 52530 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 13:18:19 lion1 kernel: pid 52530 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 13:18:19 lion1 kernel: pid 52530 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<3>pid 52494 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:18:21 lion1 kernel: pid 52494 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 52534 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 13:18:23 lion1 kernel: pid 52534 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 13:18:23 lion1 kernel: pid 52534 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 52533 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 13:18:25 lion1 kernel: pid 52533 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<3>pid 52529 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 13:18:27 lion1 kernel: pid 52529 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 13:18:27 lion1 kernel: pid 52529 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 52524 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 13:18:29 lion1 kernel: pid 52524 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 52524 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
--More-- <3>pid 52528 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:18:32 lion1 kernel: pid 52524 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 13:18:32 lion1 kernel: pid 52524 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 13:18:34 lion1 kernel: pid 52528 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:18:34 lion1 kernel: pid 52528 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 52529 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 13:18:36 lion1 kernel: pid 52529 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 52528 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:18:38 lion1 kernel: pid 52528 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:18:38 lion1 kernel: pid 52528 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 53258 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:20:19 lion1 kernel: pid 53258 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 53264 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:20:26 lion1 kernel: pid 53264 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 53967 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:23:17 lion1 kernel: pid 53967 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:23:19 lion1 kernel: pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>an 19 13:23:19 lion1 kernel: pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>an 19 13:23:19 lion1 kernel: pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
--More-- <3>pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 53959 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:23:21 lion1 kernel: pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:23:23 lion1 kernel: pid 53959 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:23:21 lion1 kernel: pid 53962 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 53993 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 53966 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 53987 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:23:29 lion1 kernel: pid 53993 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 53991 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:23:30 lion1 kernel: pid 53966 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:23:30 lion1 kernel: pid 53987 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:23:30 lion1 kernel: pid 53991 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 53966 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:23:32 lion1 kernel: pid 53966 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:23:32 lion1 kernel: pid 53966 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 53989 (creat), uid 0 inumber 398 on /root/tmp: out of inodes
<118>Jan 19 13:23:34 lion1 kernel: pid 53989 (creat), uid 0 inumber 398 on /root/tmp: out of inodes
<118>Jan 19 13:23:34 lion1 kernel: pid 53989 (creat), uid 0 inumber 398 on /root/tmp: out of inodes
<3>pid 53989 (creat), uid 0 inumber 398 on /root/tmp: out of inodes
--More-- <3>pid 53981 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:23:36 lion1 kernel: pid 53989 (creat), uid 0 inumber 398 on /root/tmp: out of inodes
<118>Jan 19 13:23:38 lion1 kernel: pid 53981 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:23:36 lion1 kernel: pid 53989 (creat), uid 0 inumber 398 on /root/tmp: out of inodes
<118>Jan 19 13:23:38 lion1 kernel: pid 53981 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 53968 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:23:40 lion1 kernel: pid 53968 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>an 19 13:23:40 lion1 kernel: pid 53968 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>an 19 13:23:40 lion1 kernel: pid 53968 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 54708 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:25:27 lion1 kernel: pid 54708 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 54704 (rw), uid 0 inumber 578 on /root/tmp: out of inodes
<118>Jan 19 13:25:29 lion1 kernel: pid 54704 (rw), uid 0 inumber 578 on /root/tmp: out of inodes
<118>Jan 19 13:25:29 lion1 kernel: pid 54704 (rw), uid 0 inumber 578 on /root/tmp: out of inodes
<3>pid 54702 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:25:30 lion1 kernel: pid 54702 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 54726 (creat), uid 0 inumber 577 on /root/tmp: out of inodes
<118>Jan 19 13:25:31 lion1 kernel: pid 54726 (creat), uid 0 inumber 577 on /root/tmp: out of inodes
<118>Jan 19 13:25:31 lion1 kernel: pid 54726 (creat), uid 0 inumber 577 on /root/tmp: out of inodes
<3>pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:25:33 lion1 kernel: pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 54744 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 54731 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 13:25:43 lion1 last message repeated 5 times
<3>pid 54731 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 54731 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 13:25:45 lion1 kernel: pid 54731 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 13:25:43 lion1 last message repeated 5 times
<118>Jan 19 13:25:54 lion1 last message repeated 2 times
<3>pid 55468 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:27:40 lion1 kernel: pid 55468 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 56193 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:29:37 lion1 kernel: pid 56193 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:40 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:40 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
--More-- <3>pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 56183 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:29:42 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:44 lion1 kernel: pid 56183 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 56203 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:29:46 lion1 kernel: pid 56203 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:47 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:47 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 56207 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 13:29:49 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:51 lion1 kernel: pid 56207 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 13:29:49 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:51 lion1 kernel: pid 56207 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<3>pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:29:54 lion1 kernel: pid 56210 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 56189 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:29:55 lion1 kernel: pid 56189 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:29:55 lion1 kernel: pid 56189 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
--More-- <3>pid 56196 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:29:57 lion1 kernel: pid 56196 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:29:57 lion1 kernel: pid 56196 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 56196 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 56196 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 56196 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 13:30:04 lion1 last message repeated 3 times
<3>pid 56930 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:33:16 lion1 kernel: pid 56930 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:33:18 lion1 kernel: pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:33:18 lion1 kernel: pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 56936 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:33:20 lion1 kernel: pid 56936 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:33:20 lion1 kernel: pid 56936 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 56938 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:33:22 lion1 kernel: pid 56938 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:33:24 lion1 kernel: pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:33:24 lion1 kernel: pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
--More-- <3>pid 56943 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:33:27 lion1 kernel: pid 56943 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:33:27 lion1 kernel: pid 56943 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 56938 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:33:29 lion1 kernel: pid 56938 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 56941 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:33:31 lion1 kernel: pid 56941 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:33:31 lion1 kernel: pid 56941 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 56941 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 56943 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:33:33 lion1 kernel: pid 56941 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118<>1J1an8 >J1a9n 1193: 1333::333 3l:i35o nlio1n 1k erkenrenel:l :pi dp i5d694 1 5(cr6e94at3 ),(c reuiatd) ,0 uiniumd 0b iernu mber3 38991 oonn //roroto/totm/ptm: po:u t ouoft iof ninodoeds
es
<118>Jan 19 13:33:35 lion1 kernel: pid 56943 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:33:37 lion1 kernel: pid 56942 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 56940 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:33:39 lion1 kernel: pid 56940 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:33:39 lion1 kernel: pid 56940 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 58405 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:38:51 lion1 kernel: pid 58405 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:38:51 lion1 kernel: pid 58405 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 58415 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:39:03 lion1 kernel: pid 58415 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 13:39:03 lion1 kernel: pid 58415 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 59134 (rw), uid 0 inumber 405 on /root/tmp: filesystem full
<118>Jan 19 13:42:35 lion1 kernel: pid 59134 (rw), uid 0 inumber 405 on /root/tmp: filesystem full
<3>pid 59155 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<118>Jan 19 13:42:37 lion1 kernel: pid 59155 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<118>Jan 19 13:42:37 lion1 kernel: pid 59155 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<3>pid 59162 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<3>pid 59145 (rw), uid 0 inumber 209 on /root/tmp: filesystem full
<3>pid 59158 (rw), uid 0 inumber 419 on /root/tmp: filesystem full
<118>Jan 19 13:42:39 lion1 kernel: pid 59162 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<118>Jan 19 13:42:39 lion1 kernel: pid 59145 (rw), uid 0 inumber 209 on /root/tmp: filesystem full
<118>Jan 19 13:42:39 lion1 kernel: pid 59158 (rw), uid 0 inumber 419 on /root/tmp: filesystem full
<3>pid 59166 (creat), uid 0 inumber 589 on /root/tmp: out of inodes
<118>Jan 19 13:42:41 lion1 kernel: pid 59166 (creat), uid 0 inumber 589 on /root/tmp: out of inodes
<118>Jan 19 13:42:41 lion1 kernel: pid 59166 (creat), uid 0 inumber 589 on /root/tmp: out of inodes
<3>pid 59152 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:42:43 lion1 kernel: pid 59152 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 59164 (creat), uid 0 inumber 402 on /root/tmp: out of inodes
<118>Jan 19 13:42:45 lion1 kernel: pid 59164 (creat), uid 0 inumber 402 on /root/tmp: out of inodes
<118>Jan 19 13:42:45 lion1 kernel: pid 59164 (creat), uid 0 inumber 402 on /root/tmp: out of inodes
<3>pid 59161 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 13:42:47 lion1 kernel: pid 59161 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 59168 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:42:49 lion1 kernel: pid 59168 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:42:49 lion1 kernel: pid 59168 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 59152 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 13:42:51 lion1 kernel: pid 59152 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 59160 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 13:42:54 lion1 kernel: pid 59160 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 13:42:54 lion1 kernel: pid 59160 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 59168 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 13:42:56 lion1 kernel: pid 59168 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 59161 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 13:42:58 lion1 kernel: pid 59161 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 13:42:58 lion1 kernel: pid 59161 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 59930 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:44:41 lion1 kernel: pid 59930 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:44:41 lion1 kernel: pid 59930 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 59925 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 13:44:43 lion1 kernel: pid 59925 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 13:44:43 lion1 kernel: pid 59925 (creat), uid 0 inumber 396 on /root/tmp: out of inodes
<3>pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<118>Jan 19 13:44:45 lion1 kernel: pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<118>Jan 19 13:44:45 lion1 kernel: pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 59927 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 59901 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:44:53 lion1 last message repeated 4 times
<118>Jan 19 13:44:56 lion1 kernel: pid 59901 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:44:53 lion1 last message repeated 4 times
<118>Jan 19 13:44:56 lion1 kernel: pid 59901 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 59901 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 59910 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:44:58 lion1 kernel: pid 59901 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:45:00 lion1 kernel: pid 59910 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:44:58 lion1 kernel: pid 59901 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:45:00 lion1 kernel: pid 59910 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 59917 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<118>Jan 19 13:45:02 lion1 kernel: pid 59917 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<3>pid 61367 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<3>pid 61368 (rw), uid 0 inumber 404 on /root/tmp: filesystem full
<118>Jan 19 13:51:29 lion1 kernel: pid 61367 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<118>Jan 19 13:51:29 lion1 kernel: pid 61367 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<118>Jan 19 13:51:29 lion1 kernel: pid 61368 (rw), uid 0 inumber 404 on /root/tmp: filesystem full
<118>Jan 19 13:51:29 lion1 kernel: pid 61368 (rw), uid 0 inumber 404 on /root/tmp: filesystem full
<3>pid 61361 (rw), uid 0 inumber 409 on /root/tmp: filesystem full
<118>Jan 19 13:51:31 lion1 kernel: pid 61361 (rw), uid 0 inumber 409 on /root/tmp: filesystem full
<3>pid 62144 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
<118>Jan 19 13:53:33 lion1 kernel: pid 62144 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
<3>pid 62100 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<3>pid 62101 (rw), uid 0 inumber 393 on /root/tmp: filesystem full
<118>Jan 19 13:53:34 lion1 kernel: pid 62100 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<118>Jan 19 13:53:34 lion1 kernel: pid 62101 (rw), uid 0 inumber 393 on /root/tmp: filesystem full
<3>pid 62859 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:55:47 lion1 kernel: pid 62859 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 62857 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:55:51 lion1 kernel: pid 62857 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:55:51 lion1 kernel: pid 62857 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 62857 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:55:53 lion1 kernel: pid 62857 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 63583 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:59:29 lion1 kernel: pid 63583 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:59:31 lion1 kernel: pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:59:31 lion1 kernel: pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 63592 (rw), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 13:59:32 lion1 kernel: pid 63592 (rw), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 63578 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 13:59:33 lion1 kernel: pid 63578 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 13:59:33 lion1 kernel: pid 63578 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<3>pid 63587 (rw), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 13:59:34 lion1 kernel: pid 63587 (rw), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 63577 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 13:59:35 lion1 kernel: pid 63577 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
--More-- <3>pid 63588 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:59:38 lion1 kernel: pid 63588 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 13:59:38 lion1 kernel: pid 63588 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 63575 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:59:40 lion1 kernel: pid 63575 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 13:59:40 lion1 kernel: pid 63575 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 63581 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:59:42 lion1 kernel: pid 63581 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 63578 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 13:59:44 lion1 kernel: pid 63578 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 13:59:44 lion1 kernel: pid 63578 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<3>pid 63581 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 13:59:46 lion1 kernel: pid 63581 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:59:48 lion1 kernel: pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:59:48 lion1 kernel: pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 63580 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:59:50 lion1 kernel: pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 13:59:50 lion1 kernel: pid 63574 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
--More-- <118>Jan 19 13:59:52 lion1 kernel: pid 63580 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 13:59:52 lion1 kernel: pid 63580 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 64320 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:01:30 lion1 kernel: pid 64320 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 64310 (rw), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 14:01:32 lion1 kernel: pid 64310 (rw), uid 0 inumber 396 on /root/tmp: out of inodes
<118>Jan 19 14:01:32 lion1 kernel: pid 64310 (rw), uid 0 inumber 396 on /root/tmp: out of inodes
<3>pid 64337 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<118>Jan 19 14:01:34 lion1 kernel: pid 64337 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<118>Jan 19 14:01:34 lion1 kernel: pid 64337 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 64339 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
<118>Jan 19 14:01:36 lion1 kernel: pid 64339 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
<3>pid 64321 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:01:38 lion1 kernel: pid 64321 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 64343 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:01:40 lion1 kernel: pid 64343 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:01:40 lion1 kernel: pid 64343 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<3>pid 64325 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<3>pid 64341 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 64345 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
--More-- <3>pid 64345 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 64345 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 64345 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 64343 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<3>pid 64329 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 64331 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:01:42 lion1 kernel: pid 64325 (creat), uid 0 inumber 395 on /root/tmp: out of inodes
<118>Jan 19 14:02:17 lion1 kernel: pid 64341 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 14:02:17 lion1 kernel: pid 64345 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 14:02:17 lion1 last message repeated 3 times
<118>Jan 19 14:02:17 lion1 kernel: pid 64343 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:02:17 lion1 kernel: pid 64329 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 14:02:17 lion1 kernel: pid 64331 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 65045 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:03:43 lion1 kernel: pid 65045 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 65729 (rw), uid 0 inumber 402 on /root/tmp: filesystem full
<118>Jan 19 14:05:42 lion1 kernel: pid 65729 (rw), uid 0 inumber 402 on /root/tmp: filesystem full
<3>pid 65778 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
<118>Jan 19 14:05:45 lion1 kernel: pid 65778 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
<118>Jan 19 14:05:45 lion1 kernel: pid 65778 (creat), uid 0 inumber 584 on /root/tmp: out of inodes
--More-- <3>pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:05:47 lion1 kernel: pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:05:47 lion1 kernel: pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 65749 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:05:49 lion1 kernel: pid 65749 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:05:52 lion1 kernel: pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:05:52 lion1 kernel: pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 65779 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 65775 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<118>Jan 19 14:05:58 lion1 last message repeated 3 times
<118>Jan 19 14:06:00 lion1 kernel: pid 65775 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 65771 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
<118>Jan 19 14:06:02 lion1 kernel: pid 65771 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
<118>Jan 19 14:06:02 lion1 kernel: pid 65771 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
<3>pid 65769 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:06:04 lion1 kernel: pid 65769 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:06:04 lion1 kernel: pid 65769 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
--More-- <3>pid 65772 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<118>Jan 19 14:06:07 lion1 kernel: pid 65772 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<118>Jan 19 14:06:07 lion1 kernel: pid 65772 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<3>pid 65768 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 14:06:09 lion1 kernel: pid 65768 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<118>Jan 19 14:06:09 lion1 kernel: pid 65768 (creat), uid 0 inumber 399 on /root/tmp: out of inodes
<3>pid 65772 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<118>Jan 19 14:06:11 lion1 kernel: pid 65772 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<118>Jan 19 14:06:11 lion1 kernel: pid 65772 (creat), uid 0 inumber 401 on /root/tmp: out of inodes
<3>pid 66509 (rw), uid 0 inumber 610 on /root/tmp: filesystem full
<118>Jan 19 14:07:47 lion1 kernel: pid 66509 (rw), uid 0 inumber 610 on /root/tmp: filesystem full
<3>pid 66498 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:07:49 lion1 kernel: pid 66498 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<118>Jan 19 14:07:51 lion1 kernel: pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<118>Jan 19 14:07:51 lion1 kernel: pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<3>pid 66522 (rw), uid 0 inumber 405 on /root/tmp: out of inodes
<118>Jan 19 14:07:52 lion1 kernel: pid 66522 (rw), uid 0 inumber 405 on /root/tmp: out of inodes
<3>pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<118>Jan 19 14:07:53 lion1 kernel: pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
--More-- <118>Jan 19 14:07:53 lion1 kernel: pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<3>pid 66505 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 14:07:55 lion1 kernel: pid 66505 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 14:07:55 lion1 kernel: pid 66505 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 66538 (creat), uid 0 inumber 23 on /root/tmp: out of inodes
<118>Jan 19 14:07:57 lion1 kernel: pid 66538 (creat), uid 0 inumber 23 on /root/tmp: out of inodes
<118>Jan 19 14:07:57 lion1 kernel: pid 66538 (creat), uid 0 inumber 23 on /root/tmp: out of inodes
<3>pid 66538 (creat), uid 0 inumber 23 on /root/tmp: out of inodes
<3>pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<118>Jan 19 14:08:00 lion1 kernel: pid 66538 (creat), uid 0 inumber 23 on /root/tmp: out of inodes
<118>Jan 19 14:08:02 lion1 kernel: pid 66546 (creJaant 1)9, 14 :u08:id0 0 0lio ni1 nkeumrbneelr: pi5d9 76 o6n 538 /(rcrooeta/ttm)p, :ui od u0 intum boefr 2in3o des
o
<118>n /root/tmp: out of inodes
<118>Jan 19 14:08:02 lion1 kernel: pid 66546 (creat), uid 0 inumber 597 on /root/tmp: out of inodes
<3>pid 66548 (creat), uid 0 inumber 600 on /root/tmp: out of inodes
<118>Jan 19 14:08:04 lion1 kernel: pid 66548 (creat), uid 0 inumber 600 on /root/tmp: out of inodes
<118>Jan 19 14:08:04 lion1 kernel: pid 66548 (creat), uid 0 inumber 600 on /root/tmp: out of inodes
<<3>pid3 >pid 6665366 542 ((ccrreaeatt)),, uuiidd 00 i niunmubmeberr 4066 09o no n //rroooott/t/mpt:mp : oout uoft ionfo diens
o
<3>des
--More-- <118>Jan 19 14:08:06 lion1 kernel: des
<118>Jan 19 14:08:06 lion1 kernel: des
<3>pid 66507 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:08:08 lion1 kernel: pid 66507 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 68000 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:12:37 lion1 kernel: pid 68000 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 67993 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 14:12:41 lion1 kernel: pid 67993 (rw), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 67994 (rw), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:12:43 lion1 kernel: pid 67994 (rw), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 68023 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:12:45 lion1 kernel: pid 68023 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>r 384 on /root/tmp: out of inodes
<118>r 384 on /root/tmp: out of inodes
<3>pid 68832 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
<3>pid 68810 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 14:16:55 lion1 kernel: pid 68832 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
<118>Jan 19 14:16:55 lion1 kernel: pid 68810 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 68832 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
<118>Jan 19 14:16:56 lion1 kernel: pid 68832 (creat), uid 0 inumber 580 on /root/tmp: out of inodes
--More-- <3>pid 68803 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 14:16:58 lion1 kernel: pid 68803 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 68810 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<118>Jan 19 14:16:59 lion1 kernel: pid 68810 (creat), uid 0 inumber 397 on /root/tmp: out of inodes
<3>pid 68803 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 14:17:00 lion1 kernel: pid 68803 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 68791 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 14:17:02 lion1 kernel: pid 68791 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 68781 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:17:04 lion1 kernel: pid 68781 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 68780 (rw), uid 0, was killed: exceeded maximum CPU limit
<118>Jan 19 14:21:28 lion1 kernel: pid 68780 (rw), uid 0, was killed: exceeded maximum CPU limit
<3>pid 69553 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:21:35 lion1 kernel: pid 69553 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:21:35 lion1 kernel: pid 69553 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 69551 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:21:36 lion1 kernel: pid 69551 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 69543 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 14:21:37 lion1 kernel: pid 69543 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 14:21:37 lion1 kernel: pid 69543 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
--More-- <3>pid 69543 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<3>pid 69544 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 14:21:39 lion1 kernel: pid 69543 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 14:21:41 lion1 kernel: pid 69544 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
J
<118>an 19 14:21:39 lion1 kernel: pid 69543 (creat), uid 0 inumber 389 on /root/tmp: out of inodes
<118>Jan 19 14:21:41 lion1 kernel: pid 69544 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<3>pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 14:21:43 lion1 kernel: pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 69545 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:21:45 lion1 kernel: pid 69545 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 14:21:47 lion1 kernel: pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 14:21:47 lion1 kernel: pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 69542 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 14:21:49 lion1 kernel: pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 14:21:49 lion1 kernel: pid 69548 (creat), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 14:21:51 lion1 kernel: pid 69542 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 14:21:51 lion1 kernel: pid 69542 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
--More-- <3>pid 69545 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:21:54 lion1 kernel: pid 69545 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:21:54 lion1 kernel: pid 69545 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 69542 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 14:21:56 lion1 kernel: pid 69542 (creat), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 70293 (rw), uid 0 inumber 610 on /root/tmp: filesystem full
<3>pid 70300 (rw), uid 0 inumber 609 on /root/tmp: filesystem full
<118>Jan 19 14:23:35 lion1 kernel: pid 70293 (rw), uid 0 inumber 610 on /root/tmp: filesystem full
<118>19 14:23:35 lion1 kernel: pid 70293 (rw), uid 0 inumber 610 on /root/tmp: filesystem full
<118>19 14:23:35 lion1 kernel: pid 70293 (rw), uid 0 inumber 610 on /root/tmp: filesystem full
<118>Jan 19 14:23:35 lion1 kernel: pid 70300 (rw), uid 0 inumber 609 on /root/tmp: filesystem full
<118>Jan 19 14:23:35 lion1 kernel: pid 70300 (rw), uid 0 inumber 609 on /root/tmp: filesystem full
<3>pid 70284 (rw), uid 0 inumber 576 on /root/tmp: filesystem full
<118>Jan 19 14:23:36 lion1 kernel: pid 70284 (rw), uid 0 inumber 576 on /root/tmp: filesystem full
<3>pid 70276 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<118>Jan 19 14:23:44 lion1 kernel: pid 70276 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<3>pid 70258 (creat), uid 0 inumber 578 on /root/tmp: out of inodes
<118>Jan 19 14:23:46 lion1 kernel: pid 70258 (creat), uid 0 inumber 578 on /root/tmp: out of inodes
<3>pid 70290 (creat), uid 0 inumber 404 on /root/tmp: out of inodes
<118>Jan 19 14:23:49 lion1 kernel: pid 70290 (creat), uid 0 inumber 404 on /root/tmp: out of inodes
--More-- <3>pid 70276 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<118>Jan 19 14:23:54 lion1 kernel: pid 70276 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<3>pid 70263 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<118>Jan 19 14:23:55 lion1 kernel: pid 70263 (creat), uid 0 inumber 400 on /root/tmp: out of inodes
<3>pid 70294 (creat), uid 0 inumber 600 on /root/tmp: out of inodes
<118>Jan 19 14:23:56 lion1 kernel: pid 70294 (creat), uid 0 inumber 600 on /root/tmp: out of inodes
<118>Jan 19 14:23:56 lion1 kernel: pid 70294 (creat), uid 0 inumber 600 on /root/tmp: out of inodes
<3>pid 70256 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:23:58 lion1 kernel: pid 70256 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 70281 (creat), uid 0 inumber 591 on /root/tmp: out of inodes
<118>Jan 19 14:24:00 lion1 kernel: pid 70281 (creat), uid 0 inumber 591 on /root/tmp: out of inodes
<3>pid 70256 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<118>Jan 19 14:24:03 lion1 kernel: pid 70256 (creat), uid 0 inumber 579 on /root/tmp: out of inodes
<3>pid 70286 (creat), uid 0 inumber 403 on /root/tmp: out of inodes
<118>Jan 19 14:24:04 lion1 kernel: pid 70286 (creat), uid 0 inumber 403 on /root/tmp: out of inodes
<3>pid 70281 (creat), uid 0 inumber 591 on /root/tmp: out of inodes
<118>Jan 19 14:24:05 lion1 kernel: pid 70281 (creat), uid 0 inumber 591 on /root/tmp: out of inodes
<3>pid 70259 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 14:24:06 lion1 kernel: pid 70259 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 71041 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
--More-- <118>Jan 19 14:27:24 lion1 kernel: pid 71041 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:27:24 lion1 kernel: pid 71041 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:27:26 lion1 kernel: pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 71039 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:27:45 lion1 last message repeated 9 times
<3>pid 71727 (rw), uid 0 inumber 403 on /root/tmp: filesystem full
<118>Jan 19 14:29:28 lion1 kernel: pid 71727 (rw), uid 0 inumber 403 on /root/tmp: filesystem full
<3>pid 71744 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:29:32 lion1 kernel: pid 71744 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 71781 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<118>Jan 19 14:29:33 lion1 kernel: pid 71781 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
--More-- <3>pid 71729 (rw), uid 0 inumber 391 on /root/tmp: out of inodes
<118>Jan 19 14:29:35 lion1 kernel: pid 71729 (rw), uid 0 inumber 391 on /root/tmp: out of inodes
<3>pid 71728 (rw), uid 0 inumber 207 on /root/tmp: filesystem full
<118>Jan 19 14:29:36 lion1 kernel: pid 71728 (rw), uid 0 inumber 207 on /root/tmp: filesystem full
<3>pid 72490 (rw), uid 0, was killed: exceeded maximum CPU limit
<118>Jan 19 14:36:18 lion1 kernel: pid 72490 (rw), uid 0, was killed: exceeded maximum CPU limit
<3>pid 73237 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:36:30 lion1 kernel: pid 73237 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 73970 (rw), uid 0 inumber 403 on /root/tmp: filesystem full
<118>Jan 19 14:38:29 lion1 kernel: pid 73970 (rw), uid 0 inumber 403 on /root/tmp: filesystem full
<3>pid 73945 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<3>pid 73962 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<118>Jan 19 14:38:30 lion1 kernel: pid 73945 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<118>19 14:38:30 lion1 kernel: pid 73945 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<118>19 14:38:30 lion1 kernel: pid 73945 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<118>Jan 19 14:38:30 lion1 kernel: pid 73962 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<118>Jan 19 14:38:30 lion1 kernel: pid 73962 (rw), uid 0 inumber 596 on /root/tmp: filesystem full
<3>pid 73928 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<118>Jan 19 14:38:35 lion1 kernel: pid 73928 (rw), uid 0 inumber 406 on /root/tmp: filesystem full
<3>pid 73958 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
--More-- <118>Jan 19 14:38:35 lion1 kernel: pid 73958 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:38:35 lion1 kernel: pid 73958 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 73976 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:38:40 lion1 kernel: pid 73976 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:38:40 lion1 kernel: pid 73976 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 73966 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:38:41 lion1 kernel: pid 73966 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 73963 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:38:42 lion1 kernel: pid 73963 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:38:42 lion1 kernel: pid 73963 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 73982 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 14:38:44 lion1 kernel: pid 73982 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 73969 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<118>Jan 19 14:38:46 lion1 kernel: pid 73969 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<118>an 19 14:38:46 lion1 kernel: pid 73969 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<118>an 19 14:38:46 lion1 kernel: pid 73969 (creat), uid 0 inumber 586 on /root/tmp: out of inodes
<3>pid 73984 (creat), uid 0 inumber 587 on /root/tmp: out of inodes
<118>Jan 19 14:38:48 lion1 kernel: pid 73984 (creat), uid 0 inumber 587 on /root/tmp: out of inodes
<118>Jan 19 14:38:48 lion1 kernel: pid 73984 (creat), uid 0 inumber 587 on /root/tmp: out of inodes
<3>pid 73983 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
--More-- <118>Jan 19 14:38:50 lion1 kernel: pid 73983 (creat), uid 0 inumber 585 on /root/tmp: out of inodes
<3>pid 73982 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 14:38:52 lion1 kernel: pid 73982 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<118>Jan 19 14:38:52 lion1 kernel: pid 73982 (creat), uid 0 inumber 582 on /root/tmp: out of inodes
<3>pid 74703 (rw), uid 0, was killed: exceeded maximum CPU limit
<118>Jan 19 14:44:45 lion1 kernel: pid 74703 (rw), uid 0, was killed: exceeded maximum CPU limit
<3>pid 75401 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:45:07 lion1 kernel: pid 75401 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 75412 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:45:10 lion1 kernel: pid 75412 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:45:10 lion1 kernel: pid 75412 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 75412 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 75408 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:45:12 lion1 kernel: pid 75412 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:45:14 lion1 kernel: pid 75408 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:45:12 lion1 kernel: pid 75412 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:45:14 lion1 kernel: pid 75408 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 75408 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 75408 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 75408 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
--More-- <3>pid 75410 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:45:20 lion1 last message repeated 3 times
<118>Jan 19 14:45:22 lion1 kernel: pid 75410 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<118>Jan 19 14:45:20 lion1 last message repeated 3 times
<118>Jan 19 14:45:22 lion1 kernel: pid 75410 (creat), uid 0 inumber 387 on /root/tmp: out of inodes
<3>pid 76130 (rw), uid 0 inumber 400 on /root/tmp: filesystem full
<3>pid 76135 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:47:48 lion1 kernel: pid 76130 (rw), uid 0 inumber 400 on /root/tmp: filesystem full
<118>Jan 19 14:47:48 lion1 kernel: pid 76135 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 76163 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<118>Jan 19 14:47:53 lion1 kernel: pid 76163 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<118>Jan 19 14:47:53 lion1 kernel: pid 76163 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 76163 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<3>pid 76162 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<118>Jan 19 14:47:55 lion1 kernel: pid 76163 (creat), uid 0 inumber 581 on /root/tmp: out of inodes
<118>Jan 19 14:47:57 lion1 kernel: pid 76162 (creat), uid 0 inumber 576 on /root/tmp: out of inodes
<3>pid 76146 (rw), uid 0 inumber 401 on /root/tmp: filesystem full
<3>pid 76142 (rw), uid 0 inumber 409 on /root/tmp: filesystem full
<118>Jan 19 14:47:58 lion1 kernel: pid 76146 (rw), uid 0 inumber 401 on /root/tmp: filesystem full
<118>Jan 19 14:47:58 lion1 kernel: pid 76142 (rw), uid 0 inumber 409 on /root/tmp: filesystem full
--More-- <3>pid 76916 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:50:56 lion1 kernel: pid 76916 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 76927 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 14:50:59 lion1 kernel: pid 76927 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 76909 (rw), uid 0 inumber 388 on /root/tmp: out of inodes
<118>Jan 19 14:51:00 lion1 kernel: pid 76909 (rw), uid 0 inumber 388 on /root/tmp: out of inodes
<3>pid 76947 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:51:01 lion1 kernel: pid 76947 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 76927 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 14:51:03 lion1 kernel: pid 76927 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<118>Jan 19 14:51:03 lion1 kernel: pid 76927 (creat), uid 0 inumber 385 on /root/tmp: out of inodes
<3>pid 76944 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 14:51:05 lion1 kernel: pid 76944 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 14:51:05 lion1 kernel: pid 76944 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<3>pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 14:51:07 lion1 kernel: pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 14:51:07 lion1 kernel: pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 76944 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 14:51:09 lion1 kernel: pid 76944 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 14:51:09 lion1 kernel: pid 76944 (creat), uid 0 inumber 394 on /root/tmp: out of inodes
--More-- <3>pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 14:51:11 lion1 kernel: pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<<3>p3>piidd 7769692374 ( (ccreatr)e,a tuid) , u0id 0i niunmubmer ber 393 o3n 8/5 onr o/orto/ottm/pt:m p: ooutu to fo fi niondoedse
s
<3>
<118>Jan 19 14:51:13 lion1 kernel:
<118>Jan 19 14:51:13 lion1 kernel:
<3>pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<118>Jan 19 14:51:15 lion1 kernel: pid 76934 (creat), uid 0 inumber 393 on /root/tmp: out of inodes
<3>pid 77658 (rw), uid 0 inumber 399 on /root/tmp: filesystem full
<118>Jan 19 14:54:00 lion1 kernel: pid 77658 (rw), uid 0 inumber 399 on /root/tmp: filesystem full
<3>pid 77683 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:54:06 lion1 kernel: pid 77683 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 77674 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:54:07 lion1 kernel: pid 77674 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 77665 (rw), uid 0 inumber 394 on /root/tmp: out of inodes
<118>Jan 19 14:54:09 lion1 kernel: pid 77665 (rw), uid 0 inumber 394 on /root/tmp: out of inodes
<3>pid 78381 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:56:02 lion1 kernel: pid 78381 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 79082 (rw), uid 0 inumber 402 on /root/tmp: filesystem full
--More-- <3>pid 79091 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:58:05 lion1 kernel: pid 79082 (rw), uid 0 inumber 402 on /root/tmp: filesystem full
<118>Jan 19 14:58:05 lion1 kernel: pid 79091 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 79094 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:58:07 lion1 kernel: pid 79094 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<118>Jan 19 14:58:07 lion1 kernel: pid 79094 (mkdir), uid 0 inumber 384 on /root/tmp: out of inodes
<3>pid 79095 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:58:11 lion1 kernel: pid 79095 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:58:11 lion1 kernel: pid 79095 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 79095 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<3>pid 79124 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:58:13 lion1 kernel: pid 79095 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:58:16 lion1 kernel: pid 79124 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
<118>Jan 19 14:58:13 lion1 kernel: pid 79095 (creat), uid 0 inumber 386 on /root/tmp: out of inodes
<118>Jan 19 14:58:16 lion1 kernel: pid 79124 (creat), uid 0 inumber 583 on /root/tmp: out of inodes
db>reset
cpu_reset: Restarting BSP
cpu_reset_proxy: Stopped CPU 1
[disconnect]
Script done on Tue Jan 19 13:19:00 2010
More information about the freebsd-current
mailing list