panic in 8.3-PRERELEASE

Wed Feb 22 16:58:42 UTC 2012

Hiroki Sato wrote:
> Hi,
> 
> Just a report, but I got the following panic on an NFS server running
> 8.3-PRERELEASE:
> 
> ----(from here)----
> pool.allbsd.org dumped core - see /var/crash/vmcore.0
> 
> Tue Feb 21 10:59:44 JST 2012
> 
> FreeBSD pool.allbsd.org 8.3-PRERELEASE FreeBSD 8.3-PRERELEASE #7: Thu
> Feb 16 19:29:19 JST 2012 hrs at pool.allbsd.org:/usr/obj/usr/src/sys/POOL
> amd64
> 
> panic: Assertion lock == sq->sq_lock failed at
> /usr/src/sys/kern/subr_sleepqueue.c:335
> 
Oops, I didn't know that mixing msleep() and tsleep() calls on the same
event wasn't allowed.
There are two places in the code where it did a:
  mtx_unlock();
  tsleep();
left over from the days when it was written for OpenBSD.

I don't think the mix would actually break anything, except that the
MPASS() assertion fails, but I've cc'd jhb@ since he seems to have been
the author of the sleep() stuff.

Anyhow, please try the attached patch which replaces the mtx_unlock(); tsleep(); with
msleep()s using PDROP. If the attachment gets lost, the patch is also here:
  http://people.freebsd.org/~rmacklem/tsleep.patch

Thanks for reporting this, rick
ps: Is mtx_lock() now preferred over msleep()?

> GNU gdb 6.1.1 [FreeBSD]
> Copyright 2004 Free Software Foundation, Inc.
> GDB is free software, covered by the GNU General Public License, and
> you are
> welcome to change it and/or distribute copies of it under certain
> conditions.
> Type "show copying" to see the conditions.
> There is absolutely no warranty for GDB. Type "show warranty" for
> details.
> This GDB was configured as "amd64-marcel-freebsd"...
> 
> Unread portion of the kernel message buffer:
> 
> 
> Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols
> from /boot/kernel/geom_mirror.ko.symbols...done.
> done.
> Loaded symbols for /boot/kernel/geom_mirror.ko
> Reading symbols from /boot/kernel/zfs.ko...Reading symbols from
> /boot/kernel/zfs.ko.symbols...done.
> done.
> Loaded symbols for /boot/kernel/zfs.ko
> Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols
> from /boot/kernel/opensolaris.ko.symbols...done.
> done.
> Loaded symbols for /boot/kernel/opensolaris.ko
> Reading symbols from /boot/kernel/ipfw.ko...Reading symbols from
> /boot/kernel/ipfw.ko.symbols...done.
> done.
> Loaded symbols for /boot/kernel/ipfw.ko
> #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263
> 263 if (textdump_pending)
> (kgdb) #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263
> #1 0xffffffff801f8cfc in db_fncall (dummy1=Variable "dummy1" is not
> available.
> )
> at /usr/src/sys/ddb/db_command.c:548
> #2 0xffffffff801f9031 in db_command (last_cmdp=0xffffffff80d37f40,
> cmd_table=Variable "cmd_table" is not available.
> )
> at /usr/src/sys/ddb/db_command.c:445
> #3 0xffffffff801f9280 in db_command_loop ()
> at /usr/src/sys/ddb/db_command.c:498
> #4 0xffffffff801fb369 in db_trap (type=Variable "type" is not
> available.
> ) at /usr/src/sys/ddb/db_main.c:229
> #5 0xffffffff8069e021 in kdb_trap (type=3, code=0,
> tf=0xffffff86c5f7e640)
> at /usr/src/sys/kern/subr_kdb.c:548
> #6 0xffffffff80946766 in trap (frame=0xffffff86c5f7e640)
> at /usr/src/sys/amd64/amd64/trap.c:595
> #7 0xffffffff8092d324 in calltrap ()
> at /usr/src/sys/amd64/amd64/exception.S:228
> #8 0xffffffff8069de7b in kdb_enter (why=0xffffffff80a891dd "panic",
> msg=0xa <Address 0xa out of bounds>) at cpufunc.h:63
> #9 0xffffffff8066afc0 in panic (fmt=Variable "fmt" is not available.
> ) at /usr/src/sys/kern/kern_shutdown.c:597
> #10 0xffffffff806a9360 in sleepq_add (wchan=0xffffff0073b97a00,
> lock=0xffffffff80d6af00, wmesg=0xffffffff80a7bb28 "nfsrc", flags=0,
> queue=0) at /usr/src/sys/kern/subr_sleepqueue.c:335
> #11 0xffffffff80673e4f in _sleep (ident=0xffffff0073b97a00,
> lock=0xffffffff80d6af00, priority=Variable "priority" is not
> available.
> ) at /usr/src/sys/kern/kern_synch.c:218
> #12 0xffffffff805fe01e in nfsrvd_updatecache (nd=0xffffff86c5f7e960,
> so=0xffffff002217c000) at
> /usr/src/sys/fs/nfsserver/nfs_nfsdcache.c:697
> #13 0xffffffff805ea934 in nfssvc_program (rqst=0xffffff0476070800,
> xprt=0xffffff000edd0a00) at
> /usr/src/sys/fs/nfsserver/nfs_nfsdkrpc.c:333
> #14 0xffffffff8084c76b in svc_run_internal (pool=0xffffff000c876600,
> ismaster=0) at /usr/src/sys/rpc/svc.c:895
> #15 0xffffffff8084cc8b in svc_thread_start (arg=Variable "arg" is not
> available.
> )
> at /usr/src/sys/rpc/svc.c:1200
> #16 0xffffffff80640865 in fork_exit (
> callout=0xffffffff8084cc80 <svc_thread_start>, arg=0xffffff000c876600,
> frame=0xffffff86c5f7ec50) at /usr/src/sys/kern/kern_fork.c:876
> #17 0xffffffff8092d86e in fork_trampoline ()
> at /usr/src/sys/amd64/amd64/exception.S:602
> #18 0x0000000000000080 in ?? ()
> #19 0x00007fffffffe700 in ?? ()
> #20 0x000000000000002e in ?? ()
> #21 0x0000000000000000 in ?? ()
> #22 0xfffffffffffffef4 in ?? ()
> #23 0xffffff000e1028c0 in ?? ()
> #24 0x000000000000009b in ?? ()
> #25 0x00007fffffffe700 in ?? ()
> #26 0x0000000000000006 in ?? ()
> #27 0x0000000000000003 in ?? ()
> #28 0x00000000ffffffff in ?? ()
> #29 0x00007fffffffe720 in ?? ()
> #30 0x0000000000000000 in ?? ()
> #31 0x0000000000000000 in ?? ()
> #32 0x0000000000000001 in ?? ()
> #33 0x001b00130000000c in ?? ()
> #34 0x00007fffffffffe8 in ?? ()
> #35 0x003b003b00000001 in ?? ()
> #36 0x0000000000000002 in ?? ()
> #37 0x00000008006a1dac in ?? ()
> #38 0x0000000000000043 in ?? ()
> #39 0x0000000000000202 in ?? ()
> #40 0x00007fffffffe6c8 in ?? ()
> #41 0x000000000000003b in ?? ()
> #42 0xffffff0022262470 in ?? ()
> #43 0x0000000000000000 in ?? ()
> #44 0xffffffff80d80e40 in tdq_cpu ()
> #45 0xffffff00057958c0 in ?? ()
> #46 0xffffff86c5f7e930 in ?? ()
> #47 0xffffff86c5f7e8d8 in ?? ()
> #48 0xffffff002218c8c0 in ?? ()
> #49 0xffffffff80691397 in sched_switch (td=0xffffff000c876600,
> newtd=0xffffffff8084cc80, flags=Variable "flags" is not available.
> ) at /usr/src/sys/kern/sched_ule.c:1861
> Previous frame inner to this frame (corrupt stack?)
> (kgdb)
> 
> ------------------------------------------------------------------------
> ps -axl
> 
> UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
> 0 0 0 0 -8 0 0 0 - DLs ?? 138141186720:38.04 [kernel]
> 0 1 0 0 46 0 3200 0 wait DLs ?? 32872919:34.00 [init]
> 0 2 0 0 -8 0 0 0 - DL ?? 2384800:02.00 [g_event]
> 0 3 0 0 -8 0 0 0 - DL ?? 34443954063:22.00 [g_up]
> 0 4 0 0 -8 0 0 0 - DL ?? 52261177097:30.00 [g_down]
> 0 5 0 0 -16 0 0 0 mps_sc DL ?? 22268598:50.00 [mps_scan0]
> 0 6 0 0 -16 0 0 0 waitin DL ?? 1938:00.00 [sctp_itera
> 0 7 0 0 -16 0 0 0 ccb_sc DL ?? 0:00.00 [xpt_thrd]
> 0 8 0 0 -16 0 0 0 zfs:lo DL ?? 279189757877:10.00 [pagedaemon
> 0 9 0 0 -16 0 0 0 psleep DL ?? 30647760:24.00 [vmdaemon]
> 0 10 0 0 -16 0 0 0 audit_ DL ?? 0:00.00 [audit]
> 0 11 0 0 171 0 0 0 - RL ?? 98310602660:37.92 [idle]
> 0 12 0 0 -60 0 0 0 - WL ?? 128367001717:26.00 [intr]
> 0 13 0 0 -16 0 0 0 - DL ?? 13126281049:04.00 [yarrow]
> 0 14 0 0 -40 0 0 0 - DL ?? 355171576:34.00 [usb]
> 0 15 0 0 76 0 0 0 pgzero DL ?? 83753:16.00 [pagezero]
> 0 16 0 0 -16 0 0 0 psleep DL ?? 28138575:06.00 [bufdaemon]
> 0 17 0 0 47 0 0 0 vlruwt DL ?? 4907694216:30.00 [vnlru]
> 0 18 0 0 20 0 0 0 vmwait DL ?? 25925591442:54.00 [syncer]
> 0 19 0 0 -16 0 0 0 sdflus DL ?? 275943437:00.00 [softdepflu
> 0 20 0 0 -8 0 0 0 m:w1 DL ?? 210842046:32.00 [g_mirror g
> 0 60 0 0 -8 0 0 0 zio->i DL ?? 178867118477:46.00 [zfskern]
> 0 110 0 0 -8 0 0 0 mdwait DL ?? 99721:48.00 [md0]
> 0 150 1 0 76 0 5832 40 pause DWs ?? 0:00.00 [adjkerntz]
> 0 735 1 0 44 0 6920 0 pfault DLs ?? 55753471:38.00 [syslogd]
> 0 805 1 0 44 0 7976 0 pfault DLs ?? 42986590:04.00 [rpcbind]
> 0 840 1 0 76 0 6920 0 select Ds ?? 65452:44.00 [mountd]
> 0 858 1 0 76 0 5832 40 pause DWs ?? 0:00.00 [nfsuserd]
> 0 859 858 0 44 0 5832 0 pfault DL ?? 25445708:36.00 [nfsuserd]
> 0 860 858 0 44 0 5832 0 pfault DL ?? 26084710:00.00 [nfsuserd]
> 0 861 858 0 44 0 5832 0 pfault DL ?? 25778143:28.00 [nfsuserd]
> 0 862 858 0 44 0 5832 0 pfault DL ?? 25787518:58.00 [nfsuserd]
> 0 864 1 0 4 0 5828 0 pfault DLs ?? 5920534:50.00 [nfsd]
> 0 865 864 0 44 0 5828 0 tx->tx D ?? 86066872402:20.97 [nfsd]
> 0 868 1 0 44 0 269036 0 pfault DLs ?? 24517994:48.00 [rpc.statd]
> 0 871 1 0 44 0 7976 0 rpcsvc Ds ?? 6817289856:50.00 [rpc.lockd]
> 0 907 1 0 44 0 11804 0 pfault DLs ?? 992700928:44.00 [ntpd]
> 1 915 1 0 44 0 5828 0 - WWs ?? 0:00.00 [rwhod]
> 0 926 1 0 44 0 20908 0 pfault DLs ?? 2969327208:22.00 [perl5.10.1
> 0 1015 1 0 4 0 26172 0 pfault DLs ?? 27567638:00.00 [sshd]
> 0 1046 1 0 44 0 12024 0 pfault DLs ?? 672303813:46.00 [sendmail]
> 25 1059 1 0 44 0 12024 0 - WWs ?? 0:00.00 [sendmail]
> 0 1073 1 0 44 0 7976 0 - WWs ?? 0:00.00 [cron]
> 0 1165 1 0 76 0 6916 0 ttyin Ds+ ?? 84842:48.00 [getty]
> 0 1166 1 0 76 0 6916 0 ttyin Ds+ ?? 76490:46.00 [getty]
> 0 1167 1 0 44 0 6916 0 ttyin Ds+ ?? 87267:10.00 [getty]
> 0 1169 1015 0 45 0 29808 112 sbwait DWs ?? 0:00.00 [sshd]
> 20001 1171 1169 0 44 0 29808 0 select D ?? 1745296:04.00 [sshd]
> 20001 1172 1171 0 44 0 10336 0 ttyin Ds+ ?? 2023326:04.00 [tcsh]
> 
> ------------------------------------------------------------------------
> vmstat -s
> 
> 2457092079 cpu context switches
> 1948268860 device interrupts
> 114326248 software interrupts
> 94980728 traps
> 57483687 system calls
> 22 kernel threads created
> 288912 fork() calls
> 1543 vfork() calls
> 0 rfork() calls
> 1942408 swap pager pageins
> 2087687 swap pager pages paged in
> 10577326 swap pager pageouts
> 11536354 swap pager pages paged out
> 419067 vnode pager pageins
> 536269 vnode pager pages paged in
> 5 vnode pager pageouts
> 5 vnode pager pages paged out
> 23209842 page daemon wakeups
> 1235694508 pages examined by the page daemon
> 48357847 pages reactivated
> 19134152 copy-on-write faults
> 6670 copy-on-write optimized faults
> 14214203 zero fill pages zeroed
> 1133 zero fill pages prezeroed
> 2094959 intransit blocking page faults
> 92125016 total VM faults taken
> 0 pages affected by kernel thread creation
> 75840248 pages affected by fork()
> 430154 pages affected by vfork()
> 0 pages affected by rfork()
> 58565695 pages cached
> 981678745 pages freed
> 8 pages freed by daemon
> 19820409 pages freed by exiting processes
> 0 pages active
> 0 pages inactive
> 0 pages in VM cache
> 6092264 pages wired down
> 0 pages free
> 4096 bytes per page
> 556146802 total name lookups
> cache hits (11% pos + 1% neg) system 0% per-directory
> deletions 0%, falsehits 0%, toolong 0%
> 
> ------------------------------------------------------------------------
> vmstat -m
> 
> Type InUse MemUse HighUse Requests Size(s)
> isadev 6 1K - 6 128
> ata_pci 2 1K - 2 64
> acpidev 106 7K - 106 64
> cdev 8 2K - 8 256
> entropy 1024 64K - 1024 64
> sigio 1 1K - 1 64
> filedesc 51 27K - 290480 512,1024
> kenv 117 12K - 125 16,32,64,128
> kqueue 0 0K - 296 256,2048
> proc-args 27 2K - 227134 16,32,64,128,256
> hhook 2 1K - 2 128
> ithread 151 26K - 151 32,128,256
> KTRACE 100 13K - 100 128
> linker 194 882K - 220 16,32,64,128,256,512,1024,2048,4096
> lockf 20 3K - 572 64,128
> ip6ndp 19 2K - 23 64,128
> temp 112 28K - 276586783 16,32,64,128,256,512,1024,2048,4096
> devbuf 5153 17331K - 8647 16,32,64,128,256,512,1024,2048,4096
> module 432 54K - 432 128
> mtx_pool 2 16K - 2
> osd 259 5K - 260 16,64
> subproc 1971 1157K - 292401 512,4096
> proc 2 16K - 2
> session 21 3K - 38828 128
> pgrp 21 3K - 38840 128
> cred 624 98K - 3107692200 64,256
> uidinfo 5 3K - 74066 128,2048
> plimit 9 3K - 19773 256
> UART 6 4K - 6 16,512,1024
> sysctltmp 0 0K - 11884 16,32,64,128,256,4096
> sysctloid 7764 385K - 7945 16,32,64,128
> sysctl 0 0K - 238540 16,32,64
> callout 11 5632K - 11
> umtx 2688 336K - 2688 128
> p1003.1b 1 1K - 1 16
> SWAP 2 4373K - 2 64
> SCSI SES 1 2K - 1 2048
> bus-sc 146 437K - 8556 16,32,64,128,256,512,1024,2048,4096
> bus 2313 424K - 13021 16,32,64,128,256,512,1024,2048
> devstat 40 81K - 40 32,4096
> eventhandler 81 7K - 81 64,128
> ddb_capture 1 48K - 1
> kobj 299 1196K - 463 4096
> Per-cpu 1 1K - 1 32
> pci_link 16 2K - 16 64,128
> rman 250 31K - 750 16,32,128
> acpi_perf 12 3K - 12 256
> sbuf 0 0K - 3404 16,32,64,128,256,512,1024,2048,4096
> acpica 5270 577K - 101779 16,32,64,128,256,512,1024,2048
> stack 0 0K - 2 256
> taskqueue 75 7K - 105 16,32,64,128,1024
> Unitno 12 1K - 368 32,64
> USBdev 40 12K - 40 64,128,512,1024
> USB 66 36K - 68 16,32,64,128,256,2048,4096
> kbdmux 7 10K - 7 16,512,1024,2048,4096
> Witness 1 128K - 1
> iov 0 0K - 18370 16,64,128,256,512
> select 1679 210K - 1679 128
> ioctlops 0 0K - 332354 16,32,64,128,256,512,1024
> msg 4 30K - 4 2048,4096
> sem 4 11K - 4 512,1024
> shm 1 20K - 1
> tty 22 22K - 24 1024,2048
> pts 1 1K - 1 256
> mbuf_tag 8 1K - 61159597 32,128
> ksem 1 8K - 1
> shmfd 1 8K - 1
> LED 8 1K - 8 16,128
> pcb 35 157K - 14585 16,32,128,1024,2048,4096
> soname 7 1K - 3119925 16,32,128
> acl 0 0K - 5960255 4096
> biobuf 0 0K - 6 2048
> vfscache 1 4096K - 1
> cl_savebuf 0 0K - 1556 64,128
> export_host 166 42K - 166 256
> vfs_hash 1 2048K - 1
> vnodes 2 1K - 2 256
> md_disk 1 2K - 1 2048
> vnodemarker 0 0K - 126408 512
> mount 255 15K - 8568 16,32,64,128,256,512
> BPF 14 2K - 14 128
> ether_multi 78 5K - 92 16,32,64
> ifaddr 131 30K - 131 32,64,128,256,512,4096
> ifnet 15 29K - 15 128,2048
> clone 6 24K - 6 4096
> arpcom 5 1K - 5 16
> lltable 63 23K - 177 256,512
> acpitask 1 2K - 1 2048
> CAM queue 45 27K - 3661 16,32,64,128,256,512,1024,2048
> mps 27 464K - 142 16,32,64,128,256,512,1024,2048,4096
> acpisem 16 2K - 16 128
> routetbl 194 76K - 7875 32,64,128,256,512
> igmp 14 4K - 14 256
> CAM SIM 6 2K - 6 256
> CAM periph 30 8K - 543 16,32,64,128,256
> DEVFS1 175 88K - 195 512
> in_multi 3 1K - 3 256
> sctp_iter 0 0K - 5 256
> sctp_ifn 3 1K - 3 128
> sctp_ifa 9 2K - 9 128
> sctp_vrf 1 1K - 1 64
> sctp_a_it 0 0K - 5 16
> hostcache 1 28K - 1
> syncache 1 96K - 1
> DEVFS3 201 51K - 222 256
> ip6_moptions 2 1K - 2 32,256
> in6_multi 41 5K - 41 32,256
> in6_mfilter 1 1K - 1 1024
> DEVFS 20 1K - 21 16,128
> mld 14 2K - 14 128
> NLM 2 4K - 3 32,2048
> rpc 498 295K - 3136399322 16,32,64,128,256,512,1024,2048
> audit_evclass 172 6K - 211 32
> savedino 0 0K - 381 256
> dirrem 0 0K - 2552 64
> mkdir 0 0K - 12 64
> diradd 0 0K - 2556 64
> freefile 0 0K - 457 64
> freeblks 0 0K - 492 256
> freefrag 0 0K - 3510 64
> allocindir 0 0K - 1576357 128
> indirdep 0 0K - 1989 64
> allocdirect 0 0K - 904 256
> bmsafemap 0 0K - 2063 128
> newblk 1 1K - 1577262 64,512
> inodedep 1 2048K - 3097 256
> pagedep 1 512K - 433 128
> ufs_dirhash 307 154K - 37379 16,32,64,128,256,512
> ufs_mount 16 45K - 25 128,512,2048,4096
> UMAHash 3 4101K - 20 512,1024,2048,4096
> vm_pgdata 2 129K - 2 128
> io_apic 2 4K - 2 2048
> memdesc 1 4K - 1 4096
> NFSD usrgroup 76 10K - 76 128
> atkbddev 2 1K - 2 64
> NFSD string 1 1K - 1 16
> NFSD srvcache 406 51K - 1548524470 128
> pfs_nodes 21 6K - 21 256
> CAM XPT 661 1112K - 3885 16,32,64,128,256,1024,2048
> GEOM 466 92K - 2728 16,32,64,128,256,512,1024
> scsi_da 0 0K - 366 16
> CAM dev queue 6 1K - 6 128
> qpidrv 1 1K - 1 16
> MCA 13 2K - 13 128
> msi 9 2K - 9 128
> nexusdev 4 1K - 4 16
> mirror_data 3 1K - 39945 64,128,512
> solaris 11691962 13925065K - 2722517546
> 16,32,64,128,256,512,1024,2048,4096
> kstat_data 4 1K - 4 64
> IpFw/IpAcct 36 5K - 70 16,32,64,128,256,512
> 
> ------------------------------------------------------------------------
> vmstat -z
> 
> ITEM SIZE LIMIT USED FREE REQUESTS FAILURES
> 
> UMA Kegs: 208, 0, 184, 3, 184, 0
> UMA Zones: 576, 0, 184, 2, 184, 0
> UMA Slabs: 568, 0, 1204399, 868, 136164851, 2
> UMA RCntSlabs: 568, 0, 3007, 458, 59379755, 0
> UMA Hash: 256, 0, 78, 12, 81, 0
> 16 Bucket: 152, 0, 43, 132, 202, 0
> 32 Bucket: 280, 0, 156, 82, 431, 0
> 64 Bucket: 536, 0, 109, 66, 635, 52
> 128 Bucket: 1048, 0, 894, 150, 42524901, 249667
> VM OBJECT: 216, 0, 217809, 134145, 205023219, 0
> MAP: 232, 0, 7, 25, 7, 0
> KMAP ENTRY: 120, 786222, 34101, 66711, 356681687, 0
> MAP ENTRY: 120, 0, 626, 2071, 13286492, 0
> DP fakepg: 120, 0, 0, 0, 0, 0
> SG fakepg: 120, 0, 0, 0, 0, 0
> mt_zone: 2056, 0, 287, 35, 287, 0
> 16: 16, 0, 1675440, 672528, 260550357, 0
> 32: 32, 0, 2194930, 308254, 295507810, 0
> 64: 64, 0, 2752681, 166207, 2445436087, 0
> 128: 128, 0, 599877, 103663, 2012557000, 0
> 256: 256, 0, 130698, 1767, 1910531783, 0
> 512: 512, 0, 3600727, 170355, 632542169, 0
> 1024: 1024, 0, 41809, 1419, 17651556, 0
> 2048: 2048, 0, 45994, 1520, 3137694214, 0
> 4096: 4096, 0, 217698, 1305, 22805804, 0
> Files: 80, 0, 106, 1964, 5239206, 0
> TURNSTILE: 136, 0, 2689, 191, 2689, 0
> umtx pi: 96, 0, 0, 0, 0, 0
> MAC labels: 40, 0, 0, 0, 0, 0
> PROC: 1136, 0, 48, 1872, 290477, 0
> THREAD: 1120, 0, 2444, 244, 2602, 0
> SLEEPQUEUE: 88, 0, 2689, 240, 2689, 0
> VMSPACE: 392, 0, 27, 1833, 290457, 0
> cpuset: 72, 0, 2, 98, 2, 0
> audit_record: 952, 0, 0, 0, 0, 0
> mbuf_packet: 256, 0, 3463, 571, 3053225165, 14877915
> mbuf: 256, 0, 886, 718, 13477896975, 532
> mbuf_cluster: 2048, 25600, 4367, 791, 2946391169, 14863813
> mbuf_jumbo_page: 4096, 12800, 0, 422, 4199, 0
> mbuf_jumbo_9k: 9216, 19200, 0, 0, 0, 0
> mbuf_jumbo_16k: 16384, 12800, 0, 0, 0, 0
> mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0
> g_bio: 232, 0, 0, 1232, 275916552, 0
> ttyinq: 160, 0, 225, 183, 630, 0
> ttyoutq: 256, 0, 117, 168, 327, 0
> ata_request: 328, 0, 1, 803, 40002602, 0
> ata_composite: 336, 0, 0, 0, 0, 0
> VNODE: 472, 0, 215060, 72084, 386781863, 0
> VNODEPOLL: 112, 0, 0, 0, 0, 0
> NAMEI: 1024, 0, 1944818, 1394, 534155455, 0
> S VFS Cache: 108, 0, 211506, 103644, 467683632, 0
> L VFS Cache: 328, 0, 493, 6683, 9684321, 0
> DIRHASH: 1024, 0, 0, 1756, 50430, 0
> NCLNODE: 600, 0, 0, 0, 0, 0
> pipe: 728, 0, 1, 1634, 236978, 0
> ksiginfo: 112, 0, 1913, 1420, 16178, 0
> itimer: 344, 0, 1, 32, 2, 0
> KNOTE: 128, 0, 0, 290, 296, 0
> socket: 680, 25602, 95, 475, 49127, 11600
> unpcb: 240, 25600, 10, 486, 8807, 0
> ipq: 56, 819, 0, 0, 0, 0
> udp_inpcb: 336, 25608, 28, 258, 27781, 0
> udpcb: 16, 25704, 28, 1652, 27781, 0
> tcp_inpcb: 336, 25608, 56, 681, 9316, 0
> tcpcb: 944, 25600, 56, 296, 9316, 0
> tcptw: 72, 5150, 0, 800, 1020, 0
> syncache: 144, 15366, 10, 224, 10161216, 0
> hostcache: 136, 15372, 13, 295, 92, 0
> tcpreass: 40, 1680, 0, 1428, 31283, 0
> sackhole: 32, 0, 0, 2525, 263849, 0
> sctp_ep: 1304, 25602, 0, 0, 0, 0
> sctp_asoc: 2288, 40000, 0, 0, 0, 0
> sctp_laddr: 48, 80064, 0, 216, 8, 0
> sctp_raddr: 696, 80000, 0, 0, 0, 0
> sctp_chunk: 136, 400008, 0, 0, 0, 0
> sctp_readq: 104, 400032, 0, 0, 0, 0
> sctp_stream_msg_out: 112, 400026, 0, 0, 0, 0
> sctp_asconf: 40, 400008, 0, 0, 0, 0
> sctp_asconf_ack: 48, 400032, 0, 0, 0, 0
> ripcb: 336, 25608, 0, 231, 3216, 0
> rtentry: 200, 0, 28, 29, 28, 0
> selfd: 56, 0, 2191, 1778, 2855424, 0
> SWAPMETA: 288, 116519, 511, 2349, 2187939, 0
> Mountpoints: 752, 0, 12, 13, 12, 0
> FFS inode: 168, 0, 85761, 96377, 974750, 0
> FFS1 dinode: 128, 0, 0, 0, 0, 0
> FFS2 dinode: 256, 0, 85761, 94059, 974103, 0
> taskq_zone: 48, 0, 0, 2232, 661225, 0
> zio_cache: 880, 0, 122, 1042, 488025233, 0
> zio_link_cache: 48, 0, 104, 1048, 314016714, 0
> zio_buf_512: 512, 0, 0, 0, 0, 0
> zio_data_buf_512: 512, 0, 0, 0, 0, 0
> zio_buf_1024: 1024, 0, 0, 0, 0, 0
> zio_data_buf_1024: 1024, 0, 0, 0, 0, 0
> zio_buf_1536: 1536, 0, 0, 0, 0, 0
> zio_data_buf_1536: 1536, 0, 0, 0, 0, 0
> zio_buf_2048: 2048, 0, 0, 0, 0, 0
> zio_data_buf_2048: 2048, 0, 0, 0, 0, 0
> zio_buf_2560: 2560, 0, 0, 0, 0, 0
> zio_data_buf_2560: 2560, 0, 0, 0, 0, 0
> zio_buf_3072: 3072, 0, 0, 0, 0, 0
> zio_data_buf_3072: 3072, 0, 0, 0, 0, 0
> zio_buf_3584: 3584, 0, 0, 0, 0, 0
> zio_data_buf_3584: 3584, 0, 0, 0, 0, 0
> zio_buf_4096: 4096, 0, 0, 0, 0, 0
> zio_data_buf_4096: 4096, 0, 0, 0, 0, 0
> zio_buf_5120: 5120, 0, 0, 0, 0, 0
> zio_data_buf_5120: 5120, 0, 0, 0, 0, 0
> zio_buf_6144: 6144, 0, 0, 0, 0, 0
> zio_data_buf_6144: 6144, 0, 0, 0, 0, 0
> zio_buf_7168: 7168, 0, 0, 0, 0, 0
> zio_data_buf_7168: 7168, 0, 0, 0, 0, 0
> zio_buf_8192: 8192, 0, 0, 0, 0, 0
> zio_data_buf_8192: 8192, 0, 0, 0, 0, 0
> zio_buf_10240: 10240, 0, 0, 0, 0, 0
> zio_data_buf_10240: 10240, 0, 0, 0, 0, 0
> zio_buf_12288: 12288, 0, 0, 0, 0, 0
> zio_data_buf_12288: 12288, 0, 0, 0, 0, 0
> zio_buf_14336: 14336, 0, 0, 0, 0, 0
> zio_data_buf_14336: 14336, 0, 0, 0, 0, 0
> zio_buf_16384: 16384, 0, 0, 0, 0, 0
> zio_data_buf_16384: 16384, 0, 0, 0, 0, 0
> zio_buf_20480: 20480, 0, 0, 0, 0, 0
> zio_data_buf_20480: 20480, 0, 0, 0, 0, 0
> zio_buf_24576: 24576, 0, 0, 0, 0, 0
> zio_data_buf_24576: 24576, 0, 0, 0, 0, 0
> zio_buf_28672: 28672, 0, 0, 0, 0, 0
> zio_data_buf_28672: 28672, 0, 0, 0, 0, 0
> zio_buf_32768: 32768, 0, 0, 0, 0, 0
> zio_data_buf_32768: 32768, 0, 0, 0, 0, 0
> zio_buf_36864: 36864, 0, 0, 0, 0, 0
> zio_data_buf_36864: 36864, 0, 0, 0, 0, 0
> zio_buf_40960: 40960, 0, 0, 0, 0, 0
> zio_data_buf_40960: 40960, 0, 0, 0, 0, 0
> zio_buf_45056: 45056, 0, 0, 0, 0, 0
> zio_data_buf_45056: 45056, 0, 0, 0, 0, 0
> zio_buf_49152: 49152, 0, 0, 0, 0, 0
> zio_data_buf_49152: 49152, 0, 0, 0, 0, 0
> zio_buf_53248: 53248, 0, 0, 0, 0, 0
> zio_data_buf_53248: 53248, 0, 0, 0, 0, 0
> zio_buf_57344: 57344, 0, 0, 0, 0, 0
> zio_data_buf_57344: 57344, 0, 0, 0, 0, 0
> zio_buf_61440: 61440, 0, 0, 0, 0, 0
> zio_data_buf_61440: 61440, 0, 0, 0, 0, 0
> zio_buf_65536: 65536, 0, 0, 0, 0, 0
> zio_data_buf_65536: 65536, 0, 0, 0, 0, 0
> zio_buf_69632: 69632, 0, 0, 0, 0, 0
> zio_data_buf_69632: 69632, 0, 0, 0, 0, 0
> zio_buf_73728: 73728, 0, 0, 0, 0, 0
> zio_data_buf_73728: 73728, 0, 0, 0, 0, 0
> zio_buf_77824: 77824, 0, 0, 0, 0, 0
> zio_data_buf_77824: 77824, 0, 0, 0, 0, 0
> zio_buf_81920: 81920, 0, 0, 0, 0, 0
> zio_data_buf_81920: 81920, 0, 0, 0, 0, 0
> zio_buf_86016: 86016, 0, 0, 0, 0, 0
> zio_data_buf_86016: 86016, 0, 0, 0, 0, 0
> zio_buf_90112: 90112, 0, 0, 0, 0, 0
> zio_data_buf_90112: 90112, 0, 0, 0, 0, 0
> zio_buf_94208: 94208, 0, 0, 0, 0, 0
> zio_data_buf_94208: 94208, 0, 0, 0, 0, 0
> zio_buf_98304: 98304, 0, 0, 0, 0, 0
> zio_data_buf_98304: 98304, 0, 0, 0, 0, 0
> zio_buf_102400: 102400, 0, 0, 0, 0, 0
> zio_data_buf_102400: 102400, 0, 0, 0, 0, 0
> zio_buf_106496: 106496, 0, 0, 0, 0, 0
> zio_data_buf_106496: 106496, 0, 0, 0, 0, 0
> zio_buf_110592: 110592, 0, 0, 0, 0, 0
> zio_data_buf_110592: 110592, 0, 0, 0, 0, 0
> zio_buf_114688: 114688, 0, 0, 0, 0, 0
> zio_data_buf_114688: 114688, 0, 0, 0, 0, 0
> zio_buf_118784: 118784, 0, 0, 0, 0, 0
> zio_data_buf_118784: 118784, 0, 0, 0, 0, 0
> zio_buf_122880: 122880, 0, 0, 0, 0, 0
> zio_data_buf_122880: 122880, 0, 0, 0, 0, 0
> zio_buf_126976: 126976, 0, 0, 0, 0, 0
> zio_data_buf_126976: 126976, 0, 0, 0, 0, 0
> zio_buf_131072: 131072, 0, 0, 0, 0, 0
> zio_data_buf_131072: 131072, 0, 0, 0, 0, 0
> sa_cache: 80, 0, 129266, 27244, 385801818, 0
> dnode_t: 856, 0, 3449429, 67491, 28031304, 0
> dmu_buf_impl_t: 224, 0, 4169264, 253694, 64122423, 0
> arc_buf_hdr_t: 216, 0, 2429176, 277376, 13824588, 0
> arc_buf_t: 104, 0, 883770, 96294, 36277716, 0
> zil_lwb_cache: 192, 0, 6, 2054, 2397885, 0
> zfs_znode_cache: 400, 0, 129266, 21628, 385801818, 0
> IPFW dynamic rule: 120, 0, 0, 0, 0, 0
> 
> 
> ------------------------------------------------------------------------
> vmstat -i
> 
> interrupt total rate
> irq0: 1 0
> stray irq0 1 0
> irq3: uart1 4419 7
> irq18: ehci0 uhci5 2 0
> irq19: uhci2 uhci4* 39609030 64404
> irq21: uhci1 21 0
> cpu0: timer 344418159 560029
> irq256: mps0 44097160 71702
> irq257: em0 1140342912 1854216
> irq258: em1 724215315 1177585
> cpu1: timer 344386653 559978
> cpu9: timer 344386682 559978
> cpu8: timer 344386687 559978
> cpu3: timer 344386670 559978
> cpu6: timer 344386654 559978
> cpu2: timer 344386597 559978
> cpu11: timer 344386687 559978
> cpu5: timer 344386682 559978
> cpu10: timer 344386685 559978
> cpu7: timer 344386647 559978
> cpu4: timer 344386688 559978
> Total 6080940352 9887707
> 
> ------------------------------------------------------------------------
> pstat -T
> 
> 106/131072 files
> 16M/30719M swap space
> 
> ------------------------------------------------------------------------
> pstat -s
> 
> Device 512-blocks Used Avail Capacity
> /dev/ada0p3 62914304 34672 62879632 0%
> 
> ------------------------------------------------------------------------
> ----(to here)----
> _______________________________________________
> freebsd-stable at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to
> "freebsd-stable-unsubscribe at freebsd.org"
-------------- next part --------------
A non-text attachment was scrubbed...
Name: tsleep.patch
Type: text/x-patch
Size: 866 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20120222/e6285098/tsleep.bin