Server restarts about twice a day

Doug Penner darwinsurvivor at gmail.com
Tue Nov 24 07:52:55 UTC 2015


The following packages were updated/installed into the various jails (and the host)
autoconf-2.69
autoconf-wrapper-20131203
binutils-2.25.1
bison-2.7.1,1
curl-7.45.0
expat-2.1.0_3
ffmpeg-2.8.1,1
frei0r-1.3_1
gettext-tools-0.19.6
glib-2.44.1_2
gmake-4.1_2
gmake-lite-4.1_1
help2man-1.43.3_1
indexinfo-0.2.4
libiconv-1.14_9
m4-1.4.17_1,1
mpfr-3.1.2_2
owncloud-8.2.0
p5-Locale-gettext-1.06
perl5-5.20.3_8
php5-curl-5.4.45
pkg-1.6.1_1
pkgconf-0.9.12_1
python27-2.7.10_1
smartmontools-6.4_1
texi2html-5.0_1,1
yasm-1.2.0


I restarted the server and turned off most of my jails. The server has been
stable thus far. I am going to try turning on a jail a day and see if/when it
crashes again.

If any of the above packages looks suspicious, let me know and I'll do some
testing on the jail(s) that got that particular upgrade.



~Doug



On Tue, Nov 17, 2015 at 05:42:42AM +0100, Polytropon wrote:
> On Mon, 16 Nov 2015 21:24:58 -0500, kpneal at pobox.com wrote:
> > Attachments to the list get stripped. 
> 
> Not in all cases. In this case, he appended
> 
> 	[core.txt.5  application/octet-stream (89.7KB)]
> 
> which the list properly transmitted, even though it should
> have been declared as text/plain. However, binary attachments
> such as screenshots usually get stripped, that's right.
> 
> There's another
> 
> 	[text/plain (229B)]
> 
> attached which appears to be empty.
> 
> 
> The core text attachment can properly display as text:
> 
> 
> 
> jails-1 dumped core - see /var/crash/vmcore.5
> 
> Sun Nov 15 15:24:15 PST 2015
> 
> FreeBSD jails-1 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 22:34:59 UTC 2014     root at snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC  amd64
> 
> panic: solaris assert: sa.sa_magic == 0x2F505A (0x2f505a00 == 0x2f505a), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c, line: 625
> 
> GNU gdb 6.1.1 [FreeBSD]
> Copyright 2004 Free Software Foundation, Inc.
> GDB is free software, covered by the GNU General Public License, and you are
> welcome to change it and/or distribute copies of it under certain conditions.
> Type "show copying" to see the conditions.
> There is absolutely no warranty for GDB.  Type "show warranty" for details.
> This GDB was configured as "amd64-marcel-freebsd"...
> 
> Unread portion of the kernel message buffer:
> panic: solaris assert: sa.sa_magic == 0x2F505A (0x2f505a00 == 0x2f505a), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c, line: 625
> cpuid = 1
> KDB: stack backtrace:
> #0 0xffffffff808e7dd0 at kdb_backtrace+0x60
> #1 0xffffffff808af8b5 at panic+0x155
> #2 0xffffffff81a2c23f at assfail3+0x2f
> #3 0xffffffff8189e34e at zfs_space_delta_cb+0xce
> #4 0xffffffff81824562 at dmu_objset_userquota_get_ids+0x202
> #5 0xffffffff818290f7 at dnode_setdirty+0x37
> #6 0xffffffff8182942e at dnode_allocate+0x15e
> #7 0xffffffff8182203a at dmu_object_alloc+0x15a
> #8 0xffffffff81874e1b at zfs_mknode+0x15b
> #9 0xffffffff818a143f at zfs_freebsd_create+0x4df
> #10 0xffffffff80d97d32 at VOP_CREATE_APV+0x92
> #11 0xffffffff80957ea9 at vn_open_cred+0x2c9
> #12 0xffffffff809515b1 at kern_openat+0x261
> #13 0xffffffff80c8ef87 at amd64_syscall+0x357
> #14 0xffffffff80c7567b at Xfast_syscall+0xfb
> Uptime: 6h58m44s
> Dumping 4711 out of 7764 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%
> 
> Reading symbols from /bootpool/boot/kernel/zfs.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/zfs.ko.symbols
> Reading symbols from /bootpool/boot/kernel/opensolaris.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/opensolaris.ko.symbols
> Reading symbols from /bootpool/boot/kernel/geom_eli.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/geom_eli.ko.symbols
> Reading symbols from /bootpool/boot/kernel/crypto.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/crypto.ko.symbols
> Reading symbols from /bootpool/boot/kernel/aesni.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/aesni.ko.symbols
> Reading symbols from /bootpool/boot/kernel/pflog.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/pflog.ko.symbols
> Reading symbols from /bootpool/boot/kernel/pf.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/pf.ko.symbols
> Reading symbols from /bootpool/boot/kernel/linprocfs.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/linprocfs.ko.symbols
> Reading symbols from /bootpool/boot/kernel/linux.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/linux.ko.symbols
> Reading symbols from /bootpool/boot/kernel/nullfs.ko.symbols...done.
> Loaded symbols for /bootpool/boot/kernel/nullfs.ko.symbols
> #0  doadump (textdump=<value optimized out>) at pcpu.h:219
> 219	pcpu.h: No such file or directory.
> 	in pcpu.h
> (kgdb) #0  doadump (textdump=<value optimized out>) at pcpu.h:219
> #1  0xffffffff808af530 in kern_reboot (howto=260)
>     at /usr/src/sys/kern/kern_shutdown.c:447
> #2  0xffffffff808af8f4 in panic (fmt=<value optimized out>)
>     at /usr/src/sys/kern/kern_shutdown.c:754
> #3  0xffffffff81a2c23f in assfail3 (a=<value optimized out>, 
>     lv=<value optimized out>, op=<value optimized out>, 
>     rv=<value optimized out>, f=<value optimized out>, 
>     l=<value optimized out>)
>     at /usr/src/sys/modules/opensolaris/../../cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91
> #4  0xffffffff8189e34e in zfs_space_delta_cb (
>     bonustype=<value optimized out>, data=0xfffffe0138bdbec0, 
>     userp=0xfffff80064bf1d00, groupp=0xfffff80064bf1d08)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:625
> #5  0xffffffff81824562 in dmu_objset_userquota_get_ids (
>     dn=0xfffff80064bf1a20, before=1, tx=<value optimized out>)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_objset.c:1285
> #6  0xffffffff818290f7 in dnode_setdirty (dn=0xfffff80064bf1a20, 
>     tx=0xfffff801d7f2c900)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:1238
> #7  0xffffffff8182942e in dnode_allocate (dn=0xfffff80064bf1a20, 
>     ot=<value optimized out>, blocksize=<value optimized out>, 
>     ibs=<value optimized out>, bonustype=<value optimized out>, 
>     bonuslen=<value optimized out>, tx=0xfffff801d7f2c900)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c:563
> #8  0xffffffff8182203a in dmu_object_alloc (os=0xfffff80022100000, 
>     ot=DMU_OT_PLAIN_FILE_CONTENTS, blocksize=0, bonustype=DMU_OT_SA, 
>     bonuslen=320, tx=0xfffff801d7f2c900)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_object.c:77
> #9  0xffffffff81874e1b in zfs_mknode (dzp=0xfffff8003371aa10, 
>     vap=<value optimized out>, tx=<value optimized out>, 
>     cr=0xfffff80022805c00, flag=0, zpp=0xfffffe021ed5d7c0, 
>     acl_ids=<value optimized out>)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_znode.c:829
> #10 0xffffffff818a143f in zfs_freebsd_create (ap=<value optimized out>)
>     at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:1753
> #11 0xffffffff80d97d32 in VOP_CREATE_APV (vop=<value optimized out>, 
>     a=<value optimized out>) at vnode_if.c:265
> #12 0xffffffff80957ea9 in vn_open_cred (ndp=0xfffffe021ed5d9c0, 
>     flagp=0xfffffe021ed5da9c, cmode=384, vn_open_flags=<value optimized out>, 
>     cred=0xfffff80022805c00, fp=0xfffff801d2dff640) at vnode_if.h:109
> #13 0xffffffff809515b1 in kern_openat (td=0xfffff8017fefb000, fd=-100, 
>     path=0x80281da10 <Address 0x80281da10 out of bounds>, 
>     pathseg=UIO_USERSPACE, flags=522, mode=<value optimized out>)
>     at /usr/src/sys/kern/vfs_syscalls.c:1096
> #14 0xffffffff80c8ef87 in amd64_syscall (td=0xfffff8017fefb000, traced=0)
>     at subr_syscall.c:134
> #15 0xffffffff80c7567b in Xfast_syscall ()
>     at /usr/src/sys/amd64/amd64/exception.S:391
> #16 0x000000080182892a in ?? ()
> Previous frame inner to this frame (corrupt stack?)
> Current language:  auto; currently minimal
> (kgdb) 
> 
> ------------------------------------------------------------------------
> ps -axl
> 
> UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT  TIME COMMAND
> 
> ------------------------------------------------------------------------
> vmstat -s
> 
>  66076213 cpu context switches
>  19443835 device interrupts
>    948934 software interrupts
>   9228656 traps
>  87668694 system calls
>        22 kernel threads created
>     11890  fork() calls
>      9982 vfork() calls
>         0 rfork() calls
>      1372 swap pager pageins
>      3516 swap pager pages paged in
>      6327 swap pager pageouts
>     38088 swap pager pages paged out
>     13640 vnode pager pageins
>     90114 vnode pager pages paged in
>         0 vnode pager pageouts
>         0 vnode pager pages paged out
>         4 page daemon wakeups
>         0 pages examined by the page daemon
>     16515 pages reactivated
>    888125 copy-on-write faults
>       924 copy-on-write optimized faults
>   3169332 zero fill pages zeroed
>       193 zero fill pages prezeroed
>      1550 intransit blocking page faults
>   4676737 total VM faults taken
>     13496 page faults requiring I/O
>         0 pages affected by kernel thread creation
>    433247 pages affected by  fork()
>    349368 pages affected by vfork()
>         0 pages affected by rfork()
>         0 pages cached
>  15662085 pages freed
>         0 pages freed by daemon
>         0 pages freed by exiting processes
>     12808 pages active
>     22238 pages inactive
>      1599 pages in VM cache
>   1809728 pages wired down
>     80123 pages free
>      4096 bytes per page
>  42304754 total name lookups
>           cache hits (12% pos + 0% neg) system 0% per-directory
>           deletions 0%, falsehits 0%, toolong 0%
> 
> ------------------------------------------------------------------------
> vmstat -m
> 
>          Type InUse MemUse HighUse Requests  Size(s)
>        USBdev    35     3K       -       35  32,64,128
>          cdev     7     2K       -        7  256
>       entropy  1026    65K       -     1834  32,64,4096
>       CAM SIM     7     2K       -        7  256
>      filedesc   243   536K       -    22829  16,32,128,2048,4096
>         sigio     2     1K       -        2  64
>      filecaps     0     0K       -       32  16,64
>       kdtrace   783   173K       -    22837  64,256
>          kenv    82    12K       -       94  16,32,64,128
>        kqueue    27    36K       -     6200  256,512,2048
>     proc-args    97     6K       -    28776  16,32,64,128,256
>        kbdmux     6    18K       -        6  16,512,1024,2048
>         hhook     2     1K       -        2  256
>       ithread    81    14K       -       81  32,128,256
>        prison    51    73K       -       51  16,256,4096
>        KTRACE   100    13K       -      100  128
>       CAM XPT    32     3K       -      113  16,32,64,128,256,1024
>        linker   266   639K       -      321  16,32,64,128,256,512,1024,2048,4096
>         lockf   165    18K       -    13665  64,128
>    loginclass     2     1K       -     2527  64
>        devbuf 17478 35451K       -    17563  16,32,64,128,256,512,1024,2048,4096
>          temp    30    19K       -  2891942  16,32,64,128,256,512,1024,2048,4096
>        ip6ndp     5     1K       -        6  64,128
>        module   488    61K       -      488  128
>      mtx_pool     2    16K       -        2  
>           osd    31     1K       -       97  16,32,64,128
>      pmchooks     1     1K       -        1  128
>          hdaa     5    19K       -        5  512,2048
>          hdac     1     1K       -        1  1024
>         hdacc     1     1K       -        1  32
>          pgrp    78    10K       -     3423  128
>       session    74    10K       -     3253  128
>          proc     2    32K       -        2  
>       subproc   369   608K       -    22143  512,4096
>          cred   432    68K       -   399566  64,256
>        plimit    23     6K       -    33012  256
>       uidinfo    12     6K       -     1116  128,4096
>       CAM DEV     9    18K       -       28  2048
>      pci_link    16     2K       -       16  32,128
>        sysctl     0     0K       -    12420  16,32,64
>     sysctloid  4090   202K       -     4210  16,32,64,128
>     sysctltmp     0     0K       -    71852  16,32,64,128
>       tidhash     1    32K       -        1  
>       callout     3  1672K       -        3  
>          umtx  1332   167K       -     1332  128
>      p1003.1b     1     1K       -        1  16
>          SWAP     2  4373K       -        2  64
>           bus  1208   100K       -     6066  16,32,64,128,256,1024
>        bus-sc    75   258K       -     3847  16,32,64,128,256,512,1024,2048,4096
>       devstat     8    17K       -        8  32,4096
>  eventhandler    97     8K       -       97  64,128
>          kobj   330  1320K       -      541  4096
>       Per-cpu     1     1K       -        1  32
>        DEVFS2   112    28K       -     1343  16,32,64,128,256
>        DEVFS3  2396   599K       -     2491  256
>        DEVFS1   112    56K       -      134  512
>          rman   228    27K       -      647  16,32,128
>          sbuf     0     0K       -   142846  16,32,64,128,256,512,1024,2048,4096
>    DEVFS_RULE     1     1K       -        1  64
>         DEVFS   398     9K       -      399  16,128
>        DEVFSP     2     1K       -        2  64
>     taskqueue   171    26K       -      231  16,32,64,256,1024
>        Unitno    24     2K       -    10646  32,64
>          vmem     2  1152K       -        8  4096
>      ioctlops     0     0K       -   179922  16,32,64,128,256,512,1024,2048,4096
>        select   152    19K       -      152  128
>           iov     0     0K       -   163089  16,32,64,128,256,512
>           msg     4    30K       -        4  2048,4096
>           sem     4   106K       -        4  2048,4096
>           shm     1    20K       -        1  
>           tty    22    22K       -       36  1024
>           pts     4     1K       -       18  256
>      mbuf_tag     0     0K       -       65  32
>         shmfd     1     8K       -        1  
>        soname    70     5K       -   128884  16,32,128
>           pcb    47  1174K       -    12469  16,32,128,1024,2048
>           acl     0     0K       -     1177  4096
>      vfscache     1  2048K       -        1  
>   export_host     1     1K       -       15  256
>      vfs_hash     1  1024K       -        1  
>        vnodes     1     1K       -        1  256
>         mount  1359    65K       -    53906  16,32,64,128,256,512,1024
>   vnodemarker     0     0K       -    91066  512
>           BPF    12  1034K       -       15  16,128,512,4096
>         ifnet     5     9K       -        5  128,2048
>        ifaddr    72    24K       -       73  32,64,128,256,512,2048,4096
>   ether_multi    47     3K       -       54  16,32,64
>         clone     8     1K       -        8  128
>        arpcom     1     1K       -        1  16
>       lltable    30    10K       -       34  256,512
>           tun     1     1K       -        1  256
>   NFSD string     1     1K       -        1  16
> NFSD usrgroup    79    10K       -       79  128
>      routetbl   109    24K       -     2496  32,64,128,256,512
>          igmp     4     1K       -        4  256
>      in_multi     2     1K       -        2  256
>     sctp_a_it     0     0K       -       18  16
>      sctp_vrf     1     1K       -        1  64
>      sctp_ifa    22     3K       -       23  128
>      sctp_ifn     2     1K       -        2  128
>     sctp_iter     0     0K       -       18  256
>     hostcache     1    28K       -        1  
>      syncache     1    64K       -        1  
>   in6_mfilter     1     1K       -        1  1024
>     in6_multi    27     4K       -       27  32,256
>  ip6_moptions     2     1K       -        2  32,256
>           mld     3     1K       -        3  128
>       NFS FHA     1     2K       -        1  2048
>           rpc    15     3K       -       15  32,64,128,256,512
> audit_evclass   187     6K       -      228  32
>       pagedep     1   256K       -        1  
>      inodedep     1  1024K       -        1  
>     bmsafemap     1     8K       -        1  
>        newblk     1  2048K       -        1  
>      freework     1     4K       -        1  4096
>     ufs_quota     1  1024K       -        1  
>     vm_pgdata     2  1025K       -        2  128
>       UMAHash     2    96K       -       15  512,1024,2048,4096
>     pfs_nodes    73    19K       -       73  256
>       memdesc     1     4K       -        1  4096
>   pfs_vncache     0     0K       -      474  64
>          GEOM   112    18K       -      760  16,32,64,128,256,512,1024,2048,4096
>        feeder    13     1K       -       15  32,128
>      atkbddev     2     1K       -        2  64
>       CAM CCB    28    56K       -       52  2048
>         mixer     1     4K       -        1  4096
>     raid_data     0     0K       -      114  32,128,256
>      acpiintr     1     1K       -        1  64
>          UART     3     3K       -        3  16,1024
> md_nvidia_data     0     0K       -       15  512
>        acpica  3126   312K       -    47320  16,32,64,128,256,512,1024,4096
>   md_sii_data     0     0K       -       15  512
>      CAM path    11     1K       -       59  32
>    CAM periph     6     2K       -       28  16,32,64,128,256
>      acpitask     1     8K       -        1  
>        apmdev     1     1K       -        1  128
>    madt_table     0     0K       -        1  4096
>       acpisem    26     4K       -       26  128
>     CAM queue    19     5K       -      104  16,32,512
>       acpidev    32     2K       -       32  64
> CAM dev queue     7     1K       -        7  32
>       io_apic     1     2K       -        1  2048
>           MCA     6     1K       -        6  128
>           msi     4     1K       -        4  128
>      nexusdev     5     1K       -        5  16
>        isadev     7     1K       -        7  128
>           USB    42    33K       -       42  16,128,512,4096
>       solaris 1251043 4000534K       - 202122914  16,32,64,128,256,512,1024,2048,4096
>    kstat_data     6     1K       -        6  64
>        crypto     6     3K       -  5700302  64,256,512,1024
>      eli data   461   116K       -  4241092  64,256,512,1024,2048,4096
>       pf_hash     3  2880K       -        3  
>      pf_ifnet     9     4K       -       12  256,2048
>       pf_osfp  1130   115K       -     1130  64,128
>       pf_rule     4     4K       -        4  1024
>      pf_table     1     2K       -        2  2048
>         linux    15     1K       -       15  64
>   nullfs_hash     1  1024K       -        1  
>   nullfs_node    54     4K       -     7305  64
>  nullfs_mount    24     1K       -       24  32
> 
> ------------------------------------------------------------------------
> vmstat -z
> 
> ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP
> 
> UMA Kegs:               384,      0,     114,       6,     114,   0,   0
> UMA Zones:              896,      0,     114,       2,     114,   0,   0
> UMA Slabs:               80,      0,  322217,   14083, 1983613,   0,   0
> UMA RCntSlabs:           88,      0,     276,      84,     358,   0,   0
> UMA Hash:               256,      0,       7,       8,       9,   0,   0
> 4 Bucket:                32,      0,      19,     356,   12586,   0,   0
> 8 Bucket:                64,      0,     121,    1181,   66928,   0,   0
> 16 Bucket:              128,      0,     885,    1533,  903088,  77,   0
> 32 Bucket:              256,      0,   19712,    5713, 3003900, 118,   0
> 64 Bucket:              512,      0,   16433,    5143,  934437,2919,   0
> 128 Bucket:            1024,      0,    2593,      23,  971586,  11,   0
> vmem btag:               56,      0,   80427,   14216,  232514,1333,   0
> VM OBJECT:              256,      0,   14543,   51877, 4072719,   0,   0
> RADIX NODE:             144,      0,   68702,   31576, 1179340,  49,   0
> MAP:                    240,      0,       3,      61,       3,   0,   0
> KMAP ENTRY:             128,      0,      10,     269,      10,   0,   0
> MAP ENTRY:              128,      0,    4073,    2685, 1279943,   0,   0
> VMSPACE:                448,      0,     100,     134,   21874,   0,   0
> fakepg:                 104,      0,       0,       0,       0,   0,   0
> mt_zone:               4112,      0,     363,       0,     363,   0,   0
> 16:                      16,      0,    8834,     453, 1230820,   0,   0
> 32:                      32,      0,   14350,   51400, 4108814,   0,   0
> 64:                      64,      0,   68640, 1399954,71265573,   0,   0
> 128:                    128,      0,   24578,  195894,19352073,   0,   0
> 256:                    256,      0,   16870,   49115, 8645364,   0,   0
> 512:                    512,      0, 1047317,  548107,88484895,   0,   0
> 1024:                  1024,      0,    1094,    8906, 8792272,   0,   0
> 2048:                  2048,      0,    2613,    2735,  372185,   0,   0
> 4096:                  4096,      0,   37978,   15044,12547888,   0,   0
> SLEEPQUEUE:              80,      0,     667,     108,     667,   0,   0
> uint64 pcpu:              8,      0,    1386,     150,    1386,   0,   0
> Files:                   80,      0,     676,     324, 7538849,   0,   0
> TURNSTILE:              136,      0,     667,      73,     667,   0,   0
> rl_entry:                40,      0,     199,     101,     199,   0,   0
> umtx pi:                 96,      0,       0,       0,       0,   0,   0
> MAC labels:              40,      0,       0,       0,       0,   0,   0
> PROC:                  1208,      0,     121,     125,   21895,   0,   0
> THREAD:                1168,      0,     660,       6,     940,   0,   0
> cpuset:                  72,      0,     428,     122,     877,   0,   0
> audit_record:          1248,      0,       0,       0,       0,   0,   0
> mbuf_packet:            256, 3084285,     257,     353,  132085, 519,   0
> mbuf:                   256, 3084285,       1,     365,  308129, 400,   0
> mbuf_cluster:          2048, 481918,     519,       1,     519, 259,   0
> mbuf_jumbo_page:       4096, 240958,       0,      16,   14640,  89,   0
> mbuf_jumbo_9k:         9216, 214185,       0,       0,       0,   0,   0
> mbuf_jumbo_16k:       16384, 160636,       0,       0,       0,   0,   0
> mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
> ttyinq:                 160,      0,     180,     270,    1155,   0,   0
> ttyoutq:                256,      0,      96,     219,     607,   0,   0
> g_bio:                  248,      0,       3,     253,17208639,   0,   0
> ata_request:            336,      0,       0,       0,       0,   0,   0
> vtnet_tx_hdr:            24,      0,       0,       0,       0,   0,   0
> cryptop:                 88,      0,       0,       0,       0,   0,   0
> cryptodesc:              72,      0,       0,       0,       0,   0,   0
> FPU_save_area:          512,      0,       0,       0,       0,   0,   0
> taskq_zone:              48,      0,       0,     415,    5641,   0,   0
> VNODE:                  472,      0,   59246,   51234,31135335,   0,   0
> VNODEPOLL:              112,      0,       1,     139,       1,   0,   0
> BUF TRIE:               144,      0,       0,   50382,       0,   0,   0
> NAMEI:                 1024,      0,       1,      67,44743823,   0,   0
> S VFS Cache:            108,      0,   37167,  415313,31070956,   0,   0
> STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
> L VFS Cache:            328,      0,   25697,   23731, 2343708,   0,   0
> LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
> NCLNODE:                528,      0,       0,       0,       0,   0,   0
> DIRHASH:               1024,      0,       0,       0,       0,   0,   0
> procdesc:               128,      0,       0,       0,       0,   0,   0
> space_seg_cache:         64,      0,   36892,   14568,  290891,   0,   0
> zio_cache:              944,      0,       5,    1035,34229098,   0,   0
> zio_link_cache:          48,      0,       2,    1575,10947095,   0,   0
> sa_cache:                80,      0,   58978,   51922,31126155,   0,   0
> dnode_t:                864,      0, 1040985,  529275,18658334,   0,   0
> dmu_buf_impl_t:         224,      0, 1111500,  569358,23202088,   0,   0
> arc_buf_hdr_t:          216,      0, 1588576,      50, 2334581,   0,   0
> arc_buf_t:               72,      0,   73318,  195577, 4720877,   0,   0
> zil_lwb_cache:          192,      0,      24,     176,    1573,   0,   0
> zfs_znode_cache:        368,      0,   58978,   51502,31126155,   0,   0
> Mountpoints:            816,      0,      90,      15,      90,   0,   0
> pipe:                   744,      0,      42,     128,   10503,   0,   0
> ksiginfo:               112,      0,     236,     289,   15742,   0,   0
> itimer:                 352,      0,       1,      32,       1,   0,   0
> KNOTE:                  128,      0,      91,     312,  266544,   0,   0
> socket:                 696, 248465,     199,      51,   23887,   0,   0
> unpcb:                  240, 248480,     123,     197,    8570,   0,   0
> ipq:                     56,  15123,       0,     142,      10,   0,   0
> udp_inpcb:              392, 248470,      42,     108,   13268,   0,   0
> udpcb:                   16, 248490,      42,     460,   13268,   0,   0
> tcp_inpcb:              392, 248470,      32,      88,    2040,   0,   0
> tcpcb:                 1024, 248468,      32,      36,    2040,   0,   0
> tcptw:                   88,  27810,       0,     405,     357,   0,   0
> syncache:               160,  15375,       0,     125,     688,   0,   0
> hostcache:              136,  15370,       3,     142,      13,   0,   0
> tcpreass:                40,  30200,       0,       0,       0,   0,   0
> sackhole:                32,      0,       0,     250,      24,   0,   0
> sctp_ep:               1408, 248466,       0,       0,       0,   0,   0
> sctp_asoc:             2352,  40000,       0,       0,       0,   0,   0
> sctp_laddr:              48,  80012,       0,     332,      23,   0,   0
> sctp_raddr:             728,  80000,       0,       0,       0,   0,   0
> sctp_chunk:             136, 400026,       0,       0,       0,   0,   0
> sctp_readq:             104, 400026,       0,       0,       0,   0,   0
> sctp_stream_msg_out:    104, 400026,       0,       0,       0,   0,   0
> sctp_asconf:             40, 400000,       0,       0,       0,   0,   0
> sctp_asconf_ack:         48, 400060,       0,       0,       0,   0,   0
> ripcb:                  392, 248470,       0,      30,       1,   0,   0
> rtentry:                200,      0,      51,      89,      53,   0,   0
> selfd:                   56,      0,     337,     302, 4539051,   0,   0
> SWAPMETA:               288, 963846,    2440,     147,   20323,   0,   0
> pf states:              296,  10010,       0,    1313,   29841,   0,   0
> pf state keys:           88,      0,       0,    1530,   29841,   0,   0
> pf source nodes:        136,  10005,       0,       0,       0,   0,   0
> pf mtags:                40,      0,       0,       0,       0,   0,   0
> pf table entries:       160, 200000,       3,      72,       3,   0,   0
> pf table counters:       64,      0,       0,       0,       0,   0,   0
> pf frags:                80,      0,       0,       0,       0,   0,   0
> pf frag entries:         32,   5000,       0,       0,       0,   0,   0
> pf state scrubs:         40,      0,       0,       0,       0,   0,   0
> 
> 
> ------------------------------------------------------------------------
> vmstat -i
> 
> interrupt                          total       rate
> irq1: atkbd0                           3          0
> irq4: uart0                      5472602        378
> irq16: hdac0                          73          0
> irq18: ohci0 ohci1*                    6          0
> irq19: ahci0                     4287400        296
> irq256: hpet0:t0                 4625653        319
> irq257: hpet0:t1                 4816842        332
> irq259: re0                       241258         16
> Total                           19443837       1343
> 
> ------------------------------------------------------------------------
> pstat -T
> 
> 676/248462 files
> 134M/32767M swap space
> 
> ------------------------------------------------------------------------
> pstat -s
> 
> Device          512-blocks     Used    Avail Capacity
> /dev/gpt/swap0    67108608   276360 66832248     0%
> 
> ------------------------------------------------------------------------
> iostat
> 
> iostat: kvm_read(_tk_nin): invalid address (0x0)
> iostat: disabling TTY statistics
>             ada0             ada1            pass0             cpu
>   KB/t tps  MB/s   KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
>   6.47 296  1.87  41.74   0  0.00   0.00   0  0.00   1  0  7  0 91
> 
> ------------------------------------------------------------------------
> ipcs -a
> 
> Message Queues:
> T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP                 CBYTES                 QNUM               QBYTES        LSPID        LRPID STIME    RTIME    CTIME   
> 
> Shared Memory:
> T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP         NATTCH        SEGSZ         CPID         LPID ATIME    DTIME    CTIME   
> 
> Semaphores:
> T           ID          KEY MODE        OWNER    GROUP    CREATOR  CGROUP          NSEMS OTIME    CTIME   
> 
> 
> ------------------------------------------------------------------------
> ipcs -T
> 
> msginfo:
> 	msgmax:        16384	(max characters in a message)
> 	msgmni:           40	(# of message queues)
> 	msgmnb:         2048	(max characters in a message queue)
> 	msgtql:           40	(max # of messages in system)
> 	msgssz:            8	(size of a message segment)
> 	msgseg:         2048	(# of message segments in system)
> 
> shminfo:
> 	shmmax:    536870912	(max shared memory segment size)
> 	shmmin:            1	(min shared memory segment size)
> 	shmmni:          192	(max number of shared memory identifiers)
> 	shmseg:          128	(max shared memory segments per process)
> 	shmall:       131072	(max amount of shared memory in pages)
> 
> seminfo:
> 	semmni:           50	(# of semaphore identifiers)
> 	semmns:          340	(# of semaphores in system)
> 	semmnu:          150	(# of undo structures in system)
> 	semmsl:          340	(max # of semaphores per id)
> 	semopm:          100	(max # of operations per semop call)
> 	semume:           50	(max # of undo entries per process)
> 	semusz:          632	(size in bytes of undo structure)
> 	semvmx:        32767	(semaphore maximum value)
> 	semaem:        16384	(adjust on exit max value)
> 
> 
> ------------------------------------------------------------------------
> nfsstat
> 
> Client Info:
> Rpc Counts:
>   Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
>         0         0         0         0         0         0         0         0
>    Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
>         0         0         0         0         0         0         0         0
>     Mknod    Fsstat    Fsinfo  PathConf    Commit
>         0         0         0         0         0
> Rpc Info:
>  TimedOut   Invalid X Replies   Retries  Requests
>         0         0         0         0         0
> Cache Info:
> Attr Hits    Misses Lkup Hits    Misses BioR Hits    Misses BioW Hits    Misses
>         0         0         0         0         0         0         0         0
> BioRLHits    Misses BioD Hits    Misses DirE Hits    Misses Accs Hits    Misses
>         0         0         0         0         0         0         0         0
> 
> Server Info:
>   Getattr   Setattr    Lookup  Readlink      Read     Write    Create    Remove
>         0         0         0         0         0         0         0         0
>    Rename      Link   Symlink     Mkdir     Rmdir   Readdir  RdirPlus    Access
>         0         0         0         0         0         0         0         0
>     Mknod    Fsstat    Fsinfo  PathConf    Commit
>         0         0         0         0         0
> Server Ret-Failed
>                 0
> Server Faults
>             0
> Server Cache Stats:
>    Inprog      Idem  Non-idem    Misses
>         0         0         0         0
> Server Write Gathering:
>  WriteOps  WriteRPC   Opsaved
>         0         0         0
> 
> ------------------------------------------------------------------------
> netstat -s
> 
> tcp:
> 	75921 packets sent
> 		52010 data packets (47209361 bytes)
> 		144 data packets (189124 bytes) retransmitted
> 		1 data packet unnecessarily retransmitted
> 		0 resends initiated by MTU discovery
> 		22137 ack-only packets (8562 delayed)
> 		0 URG only packets
> 		0 window probe packets
> 		17 window update packets
> 		1613 control packets
> 	74868 packets received
> 		29863 acks (for 47210572 bytes)
> 		1005 duplicate acks
> 		0 acks for unsent data
> 		42737 packets (27579524 bytes) received in-sequence
> 		8 completely duplicate packets (4808 bytes)
> 		0 old duplicate packets
> 		0 packets with some dup. data (0 bytes duped)
> 		0 out-of-order packets (0 bytes)
> 		0 packets (0 bytes) of data after window
> 		0 window probes
> 		6 window update packets
> 		4 packets received after close
> 		0 discarded for bad checksums
> 		0 discarded for bad header offset fields
> 		0 discarded because packet too short
> 		0 discarded due to memory problems
> 	486 connection requests
> 	675 connection accepts
> 	0 bad connection attempts
> 	0 listen queue overflows
> 	4 ignored RSTs in the windows
> 	1139 connections established (including accepts)
> 	2008 connections closed (including 3 drops)
> 		740 connections updated cached RTT on close
> 		740 connections updated cached RTT variance on close
> 		357 connections updated cached ssthresh on close
> 	21 embryonic connections dropped
> 	29862 segments updated rtt (of 25133 attempts)
> 	18 retransmit timeouts
> 		1 connection dropped by rexmit timeout
> 	0 persist timeouts
> 		0 connections dropped by persist timeout
> 	0 Connections (fin_wait_2) dropped because of timeout
> 	0 keepalive timeouts
> 		0 keepalive probes sent
> 		0 connections dropped by keepalive
> 	18047 correct ACK header predictions
> 	34276 correct data packet header predictions
> 	688 syncache entries added
> 		3 retransmitted
> 		0 dupsyn
> 		0 dropped
> 		675 completed
> 		0 bucket overflow
> 		0 cache overflow
> 		12 reset
> 		1 stale
> 		0 aborted
> 		0 badack
> 		0 unreach
> 		0 zone failures
> 	688 cookies sent
> 	0 cookies received
> 	13 hostcache entries added
> 		0 bucket overflow
> 	8 SACK recovery episodes
> 	87 segment rexmits in SACK recovery episodes
> 	123936 byte rexmits in SACK recovery episodes
> 	296 SACK options (SACK blocks) received
> 	0 SACK options (SACK blocks) sent
> 	0 SACK scoreboard overflow
> 	0 packets with ECN CE bit set
> 	0 packets with ECN ECT(0) bit set
> 	0 packets with ECN ECT(1) bit set
> 	0 successful ECN handshakes
> 	0 times ECN reduced the congestion window
> udp:
> 	37440 datagrams received
> 	0 with incomplete header
> 	0 with bad data length field
> 	0 with bad checksum
> 	82 with no checksum
> 	237 dropped due to no socket
> 	13 broadcast/multicast datagrams undelivered
> 	0 dropped due to full socket buffers
> 	0 not for hashed pcb
> 	37190 delivered
> 	37360 datagrams output
> 	0 times multicast source filter matched
> ip:
> 	112388 total packets received
> 	0 bad header checksums
> 	0 with size smaller than minimum
> 	0 with data size < data length
> 	0 with ip length > max ip packet size
> 	0 with header length < data size
> 	0 with data length < header length
> 	0 with bad options
> 	0 with incorrect version number
> 	20 fragments received
> 	0 fragments dropped (dup or out of space)
> 	0 fragments dropped after timeout
> 	10 packets reassembled ok
> 	112327 packets for this host
> 	25 packets for unknown/unsupported protocol
> 	0 packets forwarded (0 packets fast forwarded)
> 	26 packets not forwardable
> 	0 packets received for unknown multicast group
> 	0 redirects sent
> 	122103 packets sent from this host
> 	0 packets sent with fabricated ip header
> 	0 output packets dropped due to no bufs, etc.
> 	0 output packets discarded due to no route
> 	0 output datagrams fragmented
> 	0 fragments created
> 	0 datagrams that can't be fragmented
> 	0 tunneling packets that can't find gif
> 	0 datagrams with bad address in header
> icmp:
> 	237 calls to icmp_error
> 	0 errors not generated in response to an icmp message
> 	Output histogram:
> 		echo reply: 19
> 		destination unreachable: 237
> 	0 messages with bad code fields
> 	0 messages less than the minimum length
> 	0 messages with bad checksum
> 	0 messages with bad length
> 	0 multicast echo requests ignored
> 	0 multicast timestamp requests ignored
> 	Input histogram:
> 		destination unreachable: 25
> 		echo: 19
> 	19 message responses generated
> 	0 invalid return addresses
> 	0 no return routes
> igmp:
> 	0 messages received
> 	0 messages received with too few bytes
> 	0 messages received with wrong TTL
> 	0 messages received with bad checksum
> 	0 V1/V2 membership queries received
> 	0 V3 membership queries received
> 	0 membership queries received with invalid field(s)
> 	0 general queries received
> 	0 group queries received
> 	0 group-source queries received
> 	0 group-source queries dropped
> 	0 membership reports received
> 	0 membership reports received with invalid field(s)
> 	0 membership reports received for groups to which we belong
> 	0 V3 reports received without Router Alert
> 	0 membership reports sent
> arp:
> 	31 ARP requests sent
> 	2526 ARP replies sent
> 	3649 ARP requests received
> 	3 ARP replies received
> 	3652 ARP packets received
> 	106 total packets dropped due to no ARP entry
> 	3 ARP entrys timed out
> 	0 Duplicate IPs seen
> ip6:
> 	0 total packets received
> 	0 with size smaller than minimum
> 	0 with data size < data length
> 	0 with bad options
> 	0 with incorrect version number
> 	0 fragments received
> 	0 fragments dropped (dup or out of space)
> 	0 fragments dropped after timeout
> 	0 fragments that exceeded limit
> 	0 packets reassembled ok
> 	0 packets for this host
> 	0 packets forwarded
> 	0 packets not forwardable
> 	0 redirects sent
> 	5 packets sent from this host
> 	0 packets sent with fabricated ip header
> 	0 output packets dropped due to no bufs, etc.
> 	6 output packets discarded due to no route
> 	0 output datagrams fragmented
> 	0 fragments created
> 	0 datagrams that can't be fragmented
> 	0 packets that violated scope rules
> 	0 multicast packets which we don't join
> 	Mbuf statistics:
> 		0 one mbuf
> 		0 one ext mbuf
> 		0 two or more ext mbuf
> 	0 packets whose headers are not contiguous
> 	0 tunneling packets that can't find gif
> 	0 packets discarded because of too many headers
> 	0 failures of source address selection
> 	Source addresses selection rule applied:
> icmp6:
> 	0 calls to icmp6_error
> 	0 errors not generated in response to an icmp6 message
> 	0 errors not generated because of rate limitation
> 	Output histogram:
> 		neighbor solicitation: 1
> 	0 messages with bad code fields
> 	0 messages < minimum length
> 	0 bad checksums
> 	0 messages with bad length
> 	Histogram of error messages to be generated:
> 		0 no route
> 		0 administratively prohibited
> 		0 beyond scope
> 		0 address unreachable
> 		0 port unreachable
> 		0 packet too big
> 		0 time exceed transit
> 		0 time exceed reassembly
> 		0 erroneous header field
> 		0 unrecognized next header
> 		0 unrecognized option
> 		0 redirect
> 		0 unknown
> 	0 message responses generated
> 	0 messages with too many ND options
> 	0 messages with bad ND options
> 	0 bad neighbor solicitation messages
> 	0 bad neighbor advertisement messages
> 	0 bad router solicitation messages
> 	0 bad router advertisement messages
> 	0 bad redirect messages
> 	0 path MTU changes
> rip6:
> 	0 messages received
> 	0 checksum calculations on inbound
> 	0 messages with bad checksum
> 	0 messages dropped due to no socket
> 	0 multicast messages dropped due to no socket
> 	0 messages dropped due to full socket buffers
> 	0 delivered
> 	0 datagrams output
> 
> ------------------------------------------------------------------------
> netstat -m
> 
> 258/718/976 mbufs in use (current/cache/total)
> 166/354/520/481918 mbuf clusters in use (current/cache/total/max)
> 257/353 mbuf+clusters out of packet secondary zone in use (current/cache)
> 0/16/16/240958 4k (page size) jumbo clusters in use (current/cache/total/max)
> 0/0/0/214185 9k jumbo clusters in use (current/cache/total/max)
> 0/0/0/160636 16k jumbo clusters in use (current/cache/total/max)
> 396K/951K/1348K bytes allocated to network (current/cache/total)
> 400/259/519 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
> 89/0/0 requests for jumbo clusters denied (4k/9k/16k)
> 0 requests for sfbufs denied
> 0 requests for sfbufs delayed
> 0 requests for I/O initiated by sendfile
> 
> ------------------------------------------------------------------------
> netstat -idW
> 
> Name      Mtu Network       Address              Ipkts Ierrs Idrop    Opkts Oerrs  Coll Drop
> re0      1500 <Link#1>      f4:6d:04:73:bb:47   108497     0     0   117013     0     0    0 
> re0      1500 10.1.0.0&0xff 10.1.0.2              6798     -     -   114558     -     -    - 
> re0      1500 fe80::f66d:4f fe80::f66d:4ff:fe        0     -     -        3     -     -    - 
> re0      1500 10.1.0.22/32  10.1.0.22            12718     -     -        0     -     -    - 
> re0      1500 10.1.0.25/32  10.1.0.25                0     -     -        0     -     -    - 
> re0      1500 10.1.0.26/32  10.1.0.26                0     -     -        0     -     -    - 
> re0      1500 10.1.0.23/32  10.1.0.23              243     -     -        0     -     -    - 
> re0      1500 10.1.0.24/32  10.1.0.24            35780     -     -        0     -     -    - 
> re0      1500 10.1.0.21/32  10.1.0.21            48041     -     -        0     -     -    - 
> re0      1500 10.1.0.27/32  10.1.0.27             8528     -     -        0     -     -    - 
> re0      1500 10.1.0.28/32  10.1.0.28                0     -     -        0     -     -    - 
> re0      1500 10.1.0.30/32  10.1.0.30                0     -     -        0     -     -    - 
> re0      1500 10.1.0.36/32  10.1.0.36                0     -     -        0     -     -    - 
> re0      1500 10.1.0.32/32  10.1.0.32                0     -     -        0     -     -    - 
> re0      1500 10.1.0.35/32  10.1.0.35                0     -     -        0     -     -    - 
> re0      1500 10.1.0.37/32  10.1.0.37                0     -     -        0     -     -    - 
> re0      1500 10.1.0.42/32  10.1.0.42                0     -     -        0     -     -    - 
> re0      1500 10.1.0.39/32  10.1.0.39                0     -     -        0     -     -    - 
> re0      1500 10.1.0.38/32  10.1.0.38                0     -     -        0     -     -    - 
> re0      1500 10.1.0.29/32  10.1.0.29              110     -     -        0     -     -    - 
> lo0     16384 <Link#2>                            7544     0     0     7544     0     0    0 
> lo0     16384 localhost     ::1                      0     -     -        0     -     -    - 
> lo0     16384 fe80::1%lo0   fe80::1                  0     -     -        0     -     -    - 
> lo0     16384 your-net      localhost              131     -     -     7544     -     -    - 
> tun0*    1500 <Link#3>                               0     0     0        0     0     0    0 
> pflog0  33160 <Link#4>                               0     0     0        0     0     0    0 
> 
> ------------------------------------------------------------------------
> netstat -anr
> 
> Routing tables
> 
> Internet:
> Destination        Gateway            Flags    Refs      Use  Netif Expire
> default            10.1.0.1           UGS         0    30709    re0
> 10.1.0.0&0xffff0400 link#1             U           0    83850    re0
> 10.1.0.2           link#1             UHS         0       34    lo0
> 10.1.0.21          link#1             UHS         0     3327    lo0 =>
> 10.1.0.21/32       link#1             U           0        0    re0
> 10.1.0.22          link#1             UHS         0      894    lo0 =>
> 10.1.0.22/32       link#1             U           0        0    re0
> 10.1.0.23          link#1             UHS         0        3    lo0 =>
> 10.1.0.23/32       link#1             U           0        0    re0
> 10.1.0.24          link#1             UHS         0     3147    lo0 =>
> 10.1.0.24/32       link#1             U           0        0    re0
> 10.1.0.25          link#1             UHS         0        0    lo0 =>
> 10.1.0.25/32       link#1             U           0        0    re0
> 10.1.0.26          link#1             UHS         0        0    lo0 =>
> 10.1.0.26/32       link#1             U           0        0    re0
> 10.1.0.27          link#1             UHS         0        0    lo0 =>
> 10.1.0.27/32       link#1             U           0        0    re0
> 10.1.0.28          link#1             UHS         0        0    lo0 =>
> 10.1.0.28/32       link#1             U           0        0    re0
> 10.1.0.29          link#1             UHS         0        8    lo0 =>
> 10.1.0.29/32       link#1             U           0        0    re0
> 10.1.0.30          link#1             UHS         0        0    lo0 =>
> 10.1.0.30/32       link#1             U           0        0    re0
> 10.1.0.32          link#1             UHS         0        0    lo0 =>
> 10.1.0.32/32       link#1             U           0        0    re0
> 10.1.0.35          link#1             UHS         0        0    lo0 =>
> 10.1.0.35/32       link#1             U           0        0    re0
> 10.1.0.36          link#1             UHS         0        0    lo0 =>
> 10.1.0.36/32       link#1             U           0        0    re0
> 10.1.0.37          link#1             UHS         0        0    lo0 =>
> 10.1.0.37/32       link#1             U           0        0    re0
> 10.1.0.38          link#1             UHS         0        0    lo0 =>
> 10.1.0.38/32       link#1             U           0        0    re0
> 10.1.0.39          link#1             UHS         0        0    lo0 =>
> 10.1.0.39/32       link#1             U           0        0    re0
> 10.1.0.42          link#1             UHS         0        0    lo0 =>
> 10.1.0.42/32       link#1             U           0        0    re0
> 127.0.0.1          link#2             UH          0      131    lo0
> 
> Internet6:
> Destination                       Gateway                       Flags      Netif Expire
> ::/96                             ::1                           UGRS        lo0
> ::1                               link#2                        UH          lo0
> ::ffff:0.0.0.0/96                 ::1                           UGRS        lo0
> fe80::/10                         ::1                           UGRS        lo0
> fe80::%re0/64                     link#1                        U           re0
> fe80::f66d:4ff:fe73:bb47%re0      link#1                        UHS         lo0
> fe80::%lo0/64                     link#2                        U           lo0
> fe80::1%lo0                       link#2                        UHS         lo0
> ff01::%re0/32                     fe80::f66d:4ff:fe73:bb47%re0  U           re0
> ff01::%lo0/32                     ::1                           U           lo0
> ff02::/16                         ::1                           UGRS        lo0
> ff02::%re0/32                     fe80::f66d:4ff:fe73:bb47%re0  U           re0
> ff02::%lo0/32                     ::1                           U           lo0
> 
> ------------------------------------------------------------------------
> netstat -anA
> 
> Active Internet connections (including servers)
> Tcpcb            Proto Recv-Q Send-Q Local Address      Foreign Address    (state)
> fffff8013317fc00 tcp4       0      0 10.1.0.21.48241    74.125.25.108.993  ESTABLISHED
> fffff801330e2c00 tcp4       0      0 10.1.0.22.32547    199.59.148.241.443 ESTABLISHED
> fffff801330adc00 tcp4       0      0 10.1.0.22.20337    66.196.114.82.5050 ESTABLISHED
> fffff801330ad000 tcp4       0      0 10.1.0.22.56917    173.194.203.125.52 ESTABLISHED
> fffff801330e1400 tcp4       0      0 10.1.0.22.62204    173.194.79.125.522 ESTABLISHED
> fffff80133181c00 tcp4       0      0 10.1.0.22.35610    173.194.79.125.522 ESTABLISHED
> fffff801330e1000 tcp4       0      0 10.1.0.21.11634    198.245.61.182.700 ESTABLISHED
> fffff801330e0000 tcp4       0      0 10.1.0.22.6667     10.1.0.21.46575    ESTABLISHED
> fffff801330ae400 tcp4       0      0 10.1.0.21.46575    10.1.0.22.6667     ESTABLISHED
> fffff801330e0400 tcp4       0      0 10.1.0.21.39673    31.13.222.109.7000 ESTABLISHED
> fffff800224a9800 tcp4       0      0 10.1.0.25.3306     *.*                LISTEN
> fffff800224ac400 tcp4       0      0 10.1.0.30.9000     *.*                LISTEN
> fffff800224acc00 tcp4       0      0 10.1.0.36.9000     *.*                LISTEN
> fffff801d2378000 tcp4       0      0 10.1.0.28.25       *.*                LISTEN
> fffff800224aa000 tcp4       0      0 10.1.0.38.9000     *.*                LISTEN
> fffff800224aa400 tcp4       0      0 10.1.0.22.6667     *.*                LISTEN
> fffff801d2378800 tcp4       0      0 10.1.0.29.443      *.*                LISTEN
> fffff801d2378400 tcp4       0      0 10.1.0.29.80       *.*                LISTEN
> fffff801d2378c00 tcp4       0      0 10.1.0.24.953      *.*                LISTEN
> fffff801d2379000 tcp4       0      0 10.1.0.24.53       *.*                LISTEN
> fffff800224aa800 tcp4       0      0 10.1.0.21.22       *.*                LISTEN
> fffff801d2379400 tcp4       0      0 10.1.0.32.80       *.*                LISTEN
> fffff800224aac00 tcp4       0      0 127.0.0.1.25       *.*                LISTEN
> fffff801d2379800 tcp4       0      0 10.1.0.2.22        *.*                LISTEN
> fffff801d2379c00 tcp6       0      0 *.2049             *.*                LISTEN
> fffff800224ab000 tcp4       0      0 *.2049             *.*                LISTEN
> fffff801d237a000 tcp4       0      0 *.817              *.*                LISTEN
> fffff801d237a400 tcp6       0      0 *.817              *.*                LISTEN
> fffff800224ab400 tcp4       0      0 10.1.0.2.111       *.*                LISTEN
> fffff800224ab800 tcp4       0      0 *.*                *.*                CLOSED
> fffff800224abc00 tcp4       0      0 127.0.0.1.111      *.*                LISTEN
> fffff800224ac000 tcp6       0      0 ::1.111            *.*                LISTEN
> fffff800222697a8 udp4       0      0 10.1.0.24.53       *.*                
> fffff80022231000 udp4       0      0 10.1.0.23.67       *.*                
> fffff80022231188 udp4       0      0 10.1.0.23.43298    *.*                
> fffff80022232dc8 udp4       0      0 10.1.0.42.69       *.*                
> fffff80022231310 udp4       0      0 10.1.0.29.123      *.*                
> fffff80022231498 udp4       0      0 10.1.0.38.123      *.*                
> fffff80022231620 udp4       0      0 10.1.0.39.123      *.*                
> fffff800222317a8 udp4       0      0 10.1.0.42.123      *.*                
> fffff80022231930 udp4       0      0 10.1.0.37.123      *.*                
> fffff80022231ab8 udp4       0      0 10.1.0.35.123      *.*                
> fffff80022231c40 udp4       0      0 10.1.0.32.123      *.*                
> fffff80022231dc8 udp4       0      0 10.1.0.36.123      *.*                
> fffff80022232000 udp4       0      0 10.1.0.30.123      *.*                
> fffff80022232188 udp4       0      0 10.1.0.28.123      *.*                
> fffff80022232310 udp4       0      0 10.1.0.27.123      *.*                
> fffff80022232498 udp4       0      0 10.1.0.21.123      *.*                
> fffff80022232620 udp4       0      0 10.1.0.24.123      *.*                
> fffff800222327a8 udp4       0      0 10.1.0.23.123      *.*                
> fffff80022232930 udp4       0      0 10.1.0.26.123      *.*                
> fffff80022232ab8 udp4       0      0 10.1.0.25.123      *.*                
> fffff80022232c40 udp4       0      0 10.1.0.22.123      *.*                
> fffff80022269930 udp4       0      0 127.0.0.1.123      *.*                
> fffff80022269ab8 udp6       0      0 fe80::1%lo0.123    *.*                
> fffff80022269c40 udp6       0      0 ::1.123            *.*                
> fffff80022269dc8 udp6       0      0 fe80::f66d:4ff:f.1 *.*                
> fffff80022241000 udp4       0      0 10.1.0.2.123       *.*                
> fffff80022241188 udp6       0      0 *.123              *.*                
> fffff80022241310 udp4       0      0 *.123              *.*                
> fffff80022233000 udp6       0      0 *.2049             *.*                
> fffff80022241498 udp4       0      0 *.2049             *.*                
> fffff80022241620 udp4       0      0 *.817              *.*                
> fffff800222417a8 udp6       0      0 *.817              *.*                
> fffff80022241930 udp4       0      0 *.664              *.*                
> fffff80022241ab8 udp6       0      0 *.*                *.*                
> fffff80022233188 udp4       0      0 *.1006             *.*                
> fffff80022233310 udp4       0      0 10.1.0.2.111       *.*                
> fffff80022233498 udp4       0      0 *.*                *.*                
> fffff80022233620 udp4       0      0 127.0.0.1.111      *.*                
> fffff800222337a8 udp6       0      0 *.971              *.*                
> fffff80022233930 udp6       0      0 ::1.111            *.*                
> fffff80022233ab8 udp4       0      0 *.514              *.*                
> fffff80022233c40 udp6       0      0 *.514              *.*                
> Active UNIX domain sockets
> Address  Type   Recv-Q Send-Q    Inode     Conn     Refs  Nextref Addr
> fffff801d2c2a3c0 stream    271      0        0 fffff80225dfa0f0        0        0 private/defer
> fffff80225dfa0f0 stream      0      0        0 fffff801d2c2a3c0        0        0
> fffff80022349c30 stream      0      0        0 fffff801d2c2ad20        0        0 private/defer
> fffff801d2c2ad20 stream      0      0        0 fffff80022349c30        0        0
> fffff80225dfa5a0 stream      0      0        0 fffff80225df9c30        0        0 private/local
> fffff80225df9c30 stream      0      0        0 fffff80225dfa5a0        0        0
> fffff80225df9a50 stream      0      0        0 fffff801d29c0960        0        0 private/local
> fffff801d29c0960 stream      0      0        0 fffff80225df9a50        0        0
> fffff80225df9e10 stream      0      0        0 fffff80225dfa3c0        0        0 private/rewrite
> fffff80225dfa3c0 stream      0      0        0 fffff80225df9e10        0        0
> fffff8002234cd20 stream      0      0 fffff8001951c1d8        0        0        0 /tmp/tmux-1001/default
> fffff8021ea7a870 stream      0      0        0 fffff800223654b0        0        0
> fffff800223654b0 stream      0      0        0 fffff8021ea7a870        0        0
> fffff8001b73f2d0 stream      0      0        0 fffff8001b73f960        0        0
> fffff8001b73f960 stream      0      0        0 fffff8001b73f2d0        0        0
> fffff8021ea7ac30 stream      0      0 fffff801e545c588        0        0        0 /tmp/tmux-1001/default
> fffff8001b73fc30 stream      0      0        0 fffff80120ff9d20        0        0
> fffff80120ff9d20 stream      0      0        0 fffff8001b73fc30        0        0
> fffff8021e47e5a0 stream      0      0 fffff8013327f760        0        0        0 /tmp/mysql.sock
> fffff8002234cb40 stream      0      0        0 fffff8002234cc30        0        0
> fffff8002234cc30 stream      0      0        0 fffff8002234cb40        0        0
> fffff8021ea7ad20 stream      0      0        0 fffff8021ea7ae10        0        0
> fffff8021ea7ae10 stream      0      0        0 fffff8021ea7ad20        0        0
> fffff800223a20f0 stream      0      0 fffff8021eb9e3b0        0        0        0 private/scache
> fffff800223a21e0 stream      0      0 fffff8021eb9e1d8        0        0        0 private/anvil
> fffff800223a22d0 stream      0      0 fffff8021eb9d3b0        0        0        0 private/lmtp
> fffff800223a23c0 stream      0      0 fffff8021eb9d760        0        0        0 private/virtual
> fffff800223a24b0 stream      0      0 fffff8021eb9db10        0        0        0 private/local
> fffff800223a25a0 stream      0      0 fffff8021eb9ece8        0        0        0 private/discard
> fffff800223a2690 stream      0      0 fffff8021eb9d1d8        0        0        0 private/retry
> fffff800223a2780 stream      0      0 fffff8021eb9d000        0        0        0 private/error
> fffff800223a2870 stream      0      0 fffff8021e740760        0        0        0 public/showq
> fffff800223a2960 stream      0      0 fffff8021eb9d588        0        0        0 private/relay
> fffff800223a2a50 stream      0      0 fffff8021eb9f000        0        0        0 private/smtp
> fffff800223a2b40 stream      0      0 fffff8021eb9e760        0        0        0 private/proxywrite
> fffff800223a2c30 stream      0      0 fffff8021eb9e000        0        0        0 private/proxymap
> fffff800223a2d20 stream      0      0 fffff8021e740588        0        0        0 public/flush
> fffff800223a2e10 stream      0      0 fffff8021eb9dce8        0        0        0 private/verify
> fffff80022365000 stream      0      0 fffff8021eb9f1d8        0        0        0 private/trace
> fffff800223650f0 stream      0      0 fffff8021eb9eb10        0        0        0 private/defer
> fffff800223651e0 stream      0      0 fffff8021eb9d938        0        0        0 private/bounce
> fffff800223652d0 stream      0      0 fffff8021eb9e588        0        0        0 private/rewrite
> fffff800223653c0 stream      0      0 fffff8021eb9e938        0        0        0 private/tlsmgr
> fffff80022365690 stream      0      0 fffff8021e740938        0        0        0 public/qmgr
> fffff80022365780 stream      0      0 fffff8021e740ce8        0        0        0 public/cleanup
> fffff80022365a50 stream      0      0 fffff8021e740b10        0        0        0 public/pickup
> fffff8002234d870 stream      0      0        0 fffff8002234d960        0        0
> fffff8002234d960 stream      0      0        0 fffff8002234d870        0        0
> fffff8002234dc30 stream      0      0        0 fffff800223480f0        0        0
> fffff800223480f0 stream      0      0        0 fffff8002234dc30        0        0
> fffff80022349b40 stream      0      0 fffff800223fd760        0        0        0 /var/run/rpcbind.sock
> fffff80022375780 stream      0      0        0 fffff80022375870        0        0
> fffff80022375870 stream      0      0        0 fffff80022375780        0        0
> fffff80022349a50 stream      0      0 fffff8002223fce8        0        0        0 /var/run/devd.pipe
> fffff80225dfa2d0 dgram       0      0        0 fffff80022360c30        0 fffff8002234d000
> fffff8002234d000 dgram       0      0        0 fffff80022360c30        0 fffff80225df95a0
> fffff80225df95a0 dgram       0      0        0 fffff80022360c30        0 fffff8021ea7a780
> fffff8021ea7a780 dgram       0      0        0 fffff80022360c30        0 fffff80225dfaa50
> fffff80225dfaa50 dgram       0      0        0 fffff80022360c30        0 fffff800223a2000
> fffff8002234ca50 dgram       0      0        0 fffff800223604b0        0        0
> fffff8002234d1e0 dgram       0      0        0 fffff80022348780        0        0
> fffff800223a2000 dgram       0      0        0 fffff80022360c30        0 fffff8002234d4b0
> fffff8002234d4b0 dgram       0      0        0 fffff80022360c30        0 fffff8002234d780
> fffff8002234d5a0 dgram       0      0        0 fffff80022348a50        0        0
> fffff8002234d690 dgram       0      0        0 fffff800223490f0        0        0
> fffff80022365b40 dgram       0      0        0 fffff800223491e0        0        0
> fffff8002234d780 dgram       0      0        0 fffff80022360c30        0        0
> fffff8002234da50 dgram       0      0        0 fffff800223750f0        0 fffff8002234dd20
> fffff8002234db40 dgram       0      0        0 fffff80022348e10        0        0
> fffff80022365c30 dgram       0      0        0 fffff80022360d20        0 fffff80022348000
> fffff80022348000 dgram       0      0        0 fffff80022360d20        0        0
> fffff8002234dd20 dgram       0      0        0 fffff800223750f0        0        0
> fffff8002234de10 dgram       0      0        0 fffff80022348960        0        0
> fffff800223481e0 dgram       0      0        0 fffff80022348c30        0        0
> fffff80022365d20 dgram       0      0        0 fffff80022360690        0        0
> fffff80022365e10 dgram       0      0        0 fffff800223485a0        0        0
> fffff80022360000 dgram       0      0        0 fffff80022360870        0 fffff800223601e0
> fffff800223600f0 dgram       0      0        0 fffff800223753c0        0        0
> fffff800223482d0 dgram       0      0        0 fffff800223602d0        0        0
> fffff800223483c0 dgram       0      0        0 fffff800223492d0        0        0
> fffff800223601e0 dgram       0      0        0 fffff80022360870        0        0
> fffff800223484b0 dgram       0      0        0 fffff80022360a50        0        0
> fffff800223485a0 dgram       0      0 fffff80167a52760        0 fffff80022365e10        0 /var/run/logpriv
> fffff80022348690 dgram       0      0 fffff80167c15b10        0        0        0 /var/run/log
> fffff80022348780 dgram       0      0 fffff80167d97000        0 fffff8002234d1e0        0 /var/run/logpriv
> fffff80022348870 dgram       0      0 fffff8021e6643b0        0        0        0 /var/run/log
> fffff80022348960 dgram       0      0 fffff80167e56588        0 fffff8002234de10        0 /var/run/logpriv
> fffff800223602d0 dgram       0      0 fffff80167e55000        0 fffff800223482d0        0 /var/run/logpriv
> fffff800223603c0 dgram       0      0 fffff8021e4c3760        0        0        0 /var/run/log
> fffff80022348a50 dgram       0      0 fffff80167ce7ce8        0 fffff8002234d5a0        0 /var/run/logpriv
> fffff80022348b40 dgram       0      0 fffff801679a6588        0        0        0 /var/run/log
> fffff800223604b0 dgram       0      0 fffff80167d9e588        0 fffff8002234ca50        0 /var/run/logpriv
> fffff800223605a0 dgram       0      0 fffff8021e4e1b10        0        0        0 /var/run/log
> fffff80022348c30 dgram       0      0 fffff80167a5fce8        0 fffff800223481e0        0 /var/run/logpriv
> fffff80022348d20 dgram       0      0 fffff8021e3de760        0        0        0 /var/run/log
> fffff80022360690 dgram       0      0 fffff80167a5f588        0 fffff80022365d20        0 /var/run/logpriv
> fffff80022360780 dgram       0      0 fffff8021e0fb3b0        0        0        0 /var/run/log
> fffff80022360870 dgram       0      0 fffff80167bc93b0        0 fffff80022360000        0 /var/run/logpriv
> fffff80022360960 dgram       0      0 fffff8021e2383b0        0        0        0 /var/run/log
> fffff80022360a50 dgram       0      0 fffff80167ab6000        0 fffff800223484b0        0 /var/run/logpriv
> fffff80022360b40 dgram       0      0 fffff80167a4ab10        0        0        0 /var/run/log
> fffff80022360c30 dgram       0      0 fffff80167ab6b10        0 fffff80225dfa2d0        0 /var/run/logpriv
> fffff80022360d20 dgram       0      0 fffff80167e561d8        0 fffff80022365c30        0 /var/run/logpriv
> fffff80022348e10 dgram       0      0 fffff80167ab8760        0 fffff8002234db40        0 /var/run/logpriv
> fffff80022360e10 dgram       0      0 fffff80167b11ce8        0        0        0 /var/run/log
> fffff80022349000 dgram       0      0 fffff8021e35fce8        0        0        0 /var/run/log
> fffff80022375000 dgram       0      0 fffff8021e400ce8        0        0        0 /var/run/log
> fffff800223750f0 dgram       0      0 fffff80167d97760        0 fffff8002234da50        0 /var/run/logpriv
> fffff800223751e0 dgram       0      0 fffff8021e1b8000        0        0        0 /var/run/log
> fffff800223490f0 dgram       0      0 fffff80167ce61d8        0 fffff8002234d690        0 /var/run/logpriv
> fffff800223491e0 dgram       0      0 fffff8021e1e63b0        0 fffff80022365b40        0 /var/run/log
> fffff800223492d0 dgram       0      0 fffff80167ce6938        0 fffff800223483c0        0 /var/run/logpriv
> fffff800223493c0 dgram       0      0 fffff8021e1e6760        0        0        0 /var/run/log
> fffff800223754b0 dgram       0      0 fffff80167a4b760        0        0        0 /var/run/log
> fffff800223753c0 dgram       0      0 fffff80167e55938        0 fffff800223600f0        0 /var/run/logpriv
> fffff80022349870 dgram       0      0 fffff8021e1b8588        0        0        0 /var/run/log
> fffff80022349690 dgram       0      0        0 fffff80022375690        0        0
> fffff800223494b0 dgram       0      0        0 fffff800223755a0        0 fffff800223495a0
> fffff800223495a0 dgram       0      0        0 fffff800223755a0        0 fffff80022349780
> fffff80022349780 dgram       0      0        0 fffff800223755a0        0 fffff80022349960
> fffff80022349960 dgram       0      0        0 fffff800223755a0        0        0
> fffff800223755a0 dgram       0      0 fffff80011e89b10        0 fffff800223494b0        0 /var/run/logpriv
> fffff80022375690 dgram       0      0 fffff80022471ce8        0 fffff80022349690        0 /var/run/log
> 
> ------------------------------------------------------------------------
> netstat -aL
> 
> Current listen queue sizes (qlen/incqlen/maxqlen)
> Proto Listen         Local Address         
> tcp4  0/0/50         10.1.0.25.mysql        
> tcp4  0/0/128        10.1.0.30.9000         
> tcp4  0/0/128        10.1.0.36.9000         
> tcp4  0/0/100        10.1.0.28.smtp         
> tcp4  0/0/128        10.1.0.38.9000         
> tcp4  0/0/10         10.1.0.22.ircd         
> tcp4  0/0/128        10.1.0.29.https        
> tcp4  0/0/128        10.1.0.29.http         
> tcp4  0/0/128        10.1.0.24.rndc         
> tcp4  0/0/10         10.1.0.24.domain       
> tcp4  0/0/128        10.1.0.21.ssh          
> tcp4  0/0/5          10.1.0.32.http         
> tcp4  0/0/10         localhost.smtp         
> tcp4  0/0/128        10.1.0.2.ssh           
> tcp6  0/0/5          *.nfsd                 
> tcp4  0/0/5          *.nfsd                 
> tcp4  0/0/128        *.817                  
> tcp6  0/0/128        *.817                  
> tcp4  0/0/128        10.1.0.2.sunrpc        
> tcp4  0/0/128        localhost.sunrpc       
> tcp6  0/0/128        localhost.sunrpc       
> unix  0/0/16         /tmp/tmux-1001/default
> unix  0/0/16         /tmp/tmux-1001/default
> unix  0/0/50         /tmp/mysql.sock
> unix  0/0/100        private/scache
> unix  0/0/100        private/anvil
> unix  0/0/100        private/lmtp
> unix  0/0/100        private/virtual
> unix  0/0/100        private/local
> unix  0/0/100        private/discard
> unix  0/0/100        private/retry
> unix  0/0/100        private/error
> unix  0/0/100        public/showq
> unix  0/0/100        private/relay
> unix  0/0/100        private/smtp
> unix  0/0/100        private/proxywrite
> unix  0/0/100        private/proxymap
> unix  0/0/100        public/flush
> unix  0/0/100        private/verify
> unix  0/0/100        private/trace
> unix  1/0/100        private/defer
> unix  0/0/100        private/bounce
> unix  0/0/100        private/rewrite
> unix  0/0/100        private/tlsmgr
> unix  0/0/100        public/qmgr
> unix  0/0/100        public/cleanup
> unix  0/0/100        public/pickup
> unix  0/0/128        /var/run/rpcbind.sock
> unix  0/0/4          /var/run/devd.pipe
> 
> ------------------------------------------------------------------------
> fstat
> 
> fstat: procstat_getprocs()
> 
> ------------------------------------------------------------------------
> dmesg
> 
> Copyright (c) 1992-2014 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> 	The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 22:34:59 UTC 2014
>     root at snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64
> FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610
> CPU: AMD E-350 Processor (1599.99-MHz K8-class CPU)
>   Origin = "AuthenticAMD"  Id = 0x500f10  Family = 0x14  Model = 0x1  Stepping = 0
>   Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
>   Features2=0x802209<SSE3,MON,SSSE3,CX16,POPCNT>
>   AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
>   AMD Features2=0x35ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,IBS,SKINIT,WDT>
>   TSC: P-state invariant, performance statistics
> real memory  = 8589934592 (8192 MB)
> avail memory = 7844163584 (7480 MB)
> Event timer "LAPIC" quality 400
> ACPI APIC Table: <ALASKA A M I>
> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
> FreeBSD/SMP: 1 package(s) x 2 core(s)
>  cpu0 (BSP): APIC ID:  0
>  cpu1 (AP): APIC ID:  1
> ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has zero address or length: 0x0000000000000000/0x1 (20130823/tbfadt-630)
> ioapic0: Changing APIC ID to 0
> ioapic0 <Version 2.1> irqs 0-23 on motherboard
> random: <Software, Yarrow> initialized
> kbd1 at kbdmux0
> cryptosoft0: <software crypto> on motherboard
> aesni0: No AESNI support.
> acpi0: <ALASKA A M I> on motherboard
> acpi0: Power Button (fixed)
> cpu0: <ACPI CPU> on acpi0
> cpu1: <ACPI CPU> on acpi0
> attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
> Timecounter "i8254" frequency 1193182 Hz quality 0
> Event timer "i8254" frequency 1193182 Hz quality 100
> atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
> Event timer "RTC" frequency 32768 Hz quality 0
> hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
> Timecounter "HPET" frequency 14318180 Hz quality 950
> Event timer "HPET" frequency 14318180 Hz quality 550
> Event timer "HPET1" frequency 14318180 Hz quality 450
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> vgapci0: <VGA-compatible display> port 0xf000-0xf0ff mem 0xc0000000-0xcfffffff,0xfeb00000-0xfeb3ffff,0xfea00000-0xfeafffff irq 18 at device 1.0 on pci0
> vgapci0: Boot video device
> pcib1: <ACPI PCI-PCI bridge> irq 16 at device 4.0 on pci0
> pci1: <ACPI PCI bus> on pcib1
> ahci0: <ATI IXP700 AHCI SATA controller> port 0xf140-0xf147,0xf130-0xf133,0xf120-0xf127,0xf110-0xf113,0xf100-0xf10f mem 0xfeb4b000-0xfeb4b3ff irq 19 at device 17.0 on pci0
> ahci0: AHCI v1.20 with 6 6Gbps ports, Port Multiplier supported
> ahcich0: <AHCI channel> at channel 0 on ahci0
> ahcich1: <AHCI channel> at channel 1 on ahci0
> ahcich2: <AHCI channel> at channel 2 on ahci0
> ahcich3: <AHCI channel> at channel 3 on ahci0
> ahcich4: <AHCI channel> at channel 4 on ahci0
> ahcich5: <AHCI channel> at channel 5 on ahci0
> ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb4a000-0xfeb4afff irq 18 at device 18.0 on pci0
> usbus0 on ohci0
> ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb49000-0xfeb490ff irq 17 at device 18.2 on pci0
> usbus1: EHCI version 1.0
> usbus1 on ehci0
> ohci1: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb48000-0xfeb48fff irq 18 at device 19.0 on pci0
> usbus2 on ohci1
> ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb47000-0xfeb470ff irq 17 at device 19.2 on pci0
> usbus3: EHCI version 1.0
> usbus3 on ehci1
> pci0: <serial bus, SMBus> at device 20.0 (no driver attached)
> hdac0: <ATI SB600 HDA Controller> mem 0xfeb40000-0xfeb43fff irq 16 at device 20.2 on pci0
> isab0: <PCI-ISA bridge> at device 20.3 on pci0
> isa0: <ISA bus> on isab0
> pcib2: <ACPI PCI-PCI bridge> at device 20.4 on pci0
> pci2: <ACPI PCI bus> on pcib2
> ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb46000-0xfeb46fff irq 18 at device 20.5 on pci0
> usbus4 on ohci2
> pcib3: <ACPI PCI-PCI bridge> at device 21.0 on pci0
> pci3: <ACPI PCI bus> on pcib3
> pcib4: <ACPI PCI-PCI bridge> at device 21.1 on pci0
> pci4: <ACPI PCI bus> on pcib4
> re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xe000-0xe0ff mem 0xd0004000-0xd0004fff,0xd0000000-0xd0003fff irq 17 at device 0.0 on pci4
> re0: Using 1 MSI-X message
> re0: Chip rev. 0x2c000000
> re0: MAC rev. 0x00200000
> miibus0: <MII bus> on re0
> rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
> rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
> re0: Ethernet address: f4:6d:04:73:bb:47
> ohci3: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb45000-0xfeb45fff irq 18 at device 22.0 on pci0
> usbus5 on ohci3
> ehci2: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb44000-0xfeb440ff irq 17 at device 22.2 on pci0
> usbus6: EHCI version 1.0
> usbus6 on ehci2
> acpi_button0: <Power Button> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> orm0: <ISA Option ROM> at iomem 0xce800-0xcf7ff on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> ppc0: cannot reserve I/O port range
> acpi_throttle0: <ACPI CPU Throttling> on cpu0
> acpi_throttle1: <ACPI CPU Throttling> on cpu1
> acpi_throttle1: failed to attach P_CNT
> device_attach: acpi_throttle1 attach returned 6
> ZFS filesystem version: 5
> ZFS storage pool version: features support (5000)
> Timecounters tick every 1.000 msec
> hdacc0: <VIA VT1708S_0 HDA CODEC> at cad 0 on hdac0
> hdaa0: <VIA VT1708S_0 Audio Function Group> at nid 1 on hdacc0
> pcm0: <VIA VT1708S_0 (Analog 2.0+HP/2.0)> at nid 28,29 and 26,30,27 on hdaa0
> random: unblocking device.
> usbus0: 12Mbps Full Speed USB v1.0
> usbus1: 480Mbps High Speed USB v2.0
> usbus2: 12Mbps Full Speed USB v1.0
> usbus3: 480Mbps High Speed USB v2.0
> usbus4: 12Mbps Full Speed USB v1.0
> usbus5: 12Mbps Full Speed USB v1.0
> usbus6: 480Mbps High Speed USB v2.0
> ugen0.1: <ATI> at usbus0
> uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
> ugen3.1: <ATI> at usbus3
> uhub1: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
> ugen2.1: <ATI> at usbus2
> uhub2: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
> ugen1.1: <ATI> at usbus1
> uhub3: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
> ugen6.1: <ATI> at usbus6
> uhub4: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus6
> ugen5.1: <ATI> at usbus5
> uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
> ugen4.1: <ATI> at usbus4
> uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
> uhub6: 2 ports with 2 removable, self powered
> uhub5: 4 ports with 4 removable, self powered
> uhub0: 5 ports with 5 removable, self powered
> uhub2: 5 ports with 5 removable, self powered
> ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
> ada0: <ST2000DL003-9VT166 CC3C> ATA-8 SATA 3.x device
> ada0: Serial Number 5YD5P7P6
> ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
> ada0: Command Queueing enabled
> ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
> ada0: quirks=0x1<4K>
> ada0: Previously was known as ad4
> ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
> ada1: <WDC WD40EFRX-68WT0N0 82.00A82> ATA-9 SATA 3.x device
> ada1: Serial Number WD-WCC4ERTHAY7D
> ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
> ada1: Command Queueing enabled
> ada1: 3815447MB (7814037168 512 byte sectors: 16H 63S/T 16383C)
> ada1: quirks=0x1<4K>
> ada1: Previously was known as ad6
> Netvsc initializing... SMP: AP CPU #1 Launched!
> Timecounter "TSC" frequency 1599994179 Hz quality 800
> Enter passphrase for ada0p4: uhub4: 4 ports with 4 removable, self powered
> uhub3: 5 ports with 5 removable, self powered
> uhub1: 5 ports with 5 removable, self powered
> GEOM_ELI: Device ada0p4.eli created.
> GEOM_ELI: Encryption: AES-XTS 256
> GEOM_ELI:     Crypto: software
> Trying to mount root from zfs:zroot/ROOT/default []...
> sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 11
> sysctl: Tunable values are set in /boot/loader.conf
> Setting hostuuid: 09fd7040-b901-11dc-bb8f-f46d0473bb47.
> Setting hostid: 0x732ed0b5.
> Entropy harvesting: interrupts ethernet point_to_point swi.
> Starting file system checks:
> Mounting local file systems:.
> Mounting ZFS filesystems: (47/53)\^H\^H\^H\^H\^H\^H\^H(53/53)
> Writing entropy file:.
> Setting hostname: jails-1.
> tun0
> Created clone interfaces: tun.
> Starting Network: lo0 re0 tun0.
> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
> 	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
> 	inet6 ::1 prefixlen 128 
> 	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 
> 	inet 127.0.0.1 netmask 0xff000000 
> 	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
> re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
> 	options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
> 	ether f4:6d:04:73:bb:47
> 	inet 10.1.0.2 netmask 0xffff0400 broadcast 10.1.251.255 
> 	inet6 fe80::f66d:4ff:fe73:bb47%re0 prefixlen 64 scopeid 0x1 
> 	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> 	media: Ethernet autoselect (none)
> 	status: no carrier
> tun0: flags=8010<POINTOPOINT,MULTICAST> metric 0 mtu 1500
> 	options=80000<LINKSTATE>
> 	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> Starting devd.
> Starting Network: tun0.
> tun0: flags=8010<POINTOPOINT,MULTICAST> metric 0 mtu 1500
> 	options=80000<LINKSTATE>
> 	nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
> Starting pflog.
> Enabling pfNo ALTQ support in kernel
> ALTQ related functions disabled
> Nov 15 04:22:35 pflogd[822]: [priv]: msg PRIV_OPEN_LOG received
> No ALTQ support in kernel
> ALTQ related functions disabled
> .
> add net default: gateway 10.1.0.1
> add net fe80::: gateway ::1
> add net ff02::: gateway ::1
> add net ::ffff:0.0.0.0: gateway ::1
> add net ::0.0.0.0: gateway ::1
> ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
> 32-bit compatibility ldconfig path: /usr/lib32
> Creating and/or trimming log files.
> Starting syslogd.
> Starting rpcbind.
> Nov 15 04:22:36 jails-1 rpcbind: cannot bind 127.0.0.1 on udp: Address already in use
> Nov 15 04:22:36 jails-1 rpcbind: cannot bind 127.0.0.1 on tcp: Address already in use
> NFS access cache time=60
> savecore: reboot after panic: solaris assert: sa.sa_magic == 0x2F505A (0x2f505a00 == 0x2f505a), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c, line: 625
> Nov 15 04:22:36 jails-1 savecore: reboot after panic: solaris assert: sa.sa_magic == 0x2F505A (0x2f505a00 == 0x2f505a), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c, line: 625
> re0: link state changed to UP
> savecore: writing core to /var/crash/vmcore.4
> Writing crash summary to /var/crash/core.txt.4.
> Clearing /tmp (X related).
> Starting nfsuserd.
> Starting mountd.
> Starting nfsd.
> Updating motd:.
> Mounting late file systems:.
> Starting ntpd.
> Starting powerd.
> Configuring syscons: keymap blanktime.
> Performing sanity check on sshd configuration.
> Starting sshd.
> Starting sendmail_submit.
> Starting sendmail_msp_queue.
> Starting cron.
> Starting jails:Nov 15 04:25:18 jails-1 ntpd_initres[1138]: host name not found: 0.freebsd.pool.ntp.org
> Nov 15 04:25:18 jails-1 ntpd_initres[1138]: host name not found: 1.freebsd.pool.ntp.org
> Nov 15 04:25:18 jails-1 ntpd_initres[1138]: host name not found: 2.freebsd.pool.ntp.org
> Nov 15 04:25:22 jails-1 ntpd_initres[1138]: host name not found: 0.freebsd.pool.ntp.org
> Nov 15 04:25:22 jails-1 ntpd_initres[1138]: host name not found: 1.freebsd.pool.ntp.org
> Nov 15 04:25:22 jails-1 ntpd_initres[1138]: host name not found: 2.freebsd.pool.ntp.org
> Nov 15 04:25:36 dhcp dhcpd: unable to create icmp socket: Operation not permitted
> Sun Nov 15 04:25:47 PST 2015
> .
> sysctl: oid 'vfs.zfs.write_limit_override' is a read only tunable at line 11
> sysctl: Tunable values are set in /boot/loader.conf
> Starting default mousedmoused: unable to open /dev/psm0: No such file or directory
> .
> Starting background file system checks in 60 seconds.
> 
> Sun Nov 15 04:25:47 PST 2015
> Nov 15 04:37:52 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-w4IOeNIR8U: open: permission denied
> Nov 15 04:39:22 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-V1IlYdfcg5: open: permission denied
> Nov 15 04:51:35 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-KUpFuhWD61: open: permission denied
> Nov 15 04:54:21 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-KOamnZbgS4: open: permission denied
> Nov 15 05:04:42 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-VO4gYz8Gaw: open: permission denied
> Nov 15 05:07:30 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-FNDSGmPucR: open: permission denied
> Nov 15 05:19:28 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-iF5D0MhRr3: open: permission denied
> Nov 15 05:21:10 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-GhQOfYg7iR: open: permission denied
> Nov 15 05:31:03 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-FcAazpUyRH: open: permission denied
> Nov 15 05:32:49 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-EQNwMf7pn8: open: permission denied
> Nov 15 05:45:33 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-fP7y4TH2Sa: open: permission denied
> Nov 15 05:46:41 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-qxTS58zbI1: open: permission denied
> Nov 15 05:57:11 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-0t3r4hM3YF: open: permission denied
> Nov 15 05:59:33 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-lqjtdjRypG: open: permission denied
> Nov 15 06:11:29 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-iWqM60xPug: open: permission denied
> Nov 15 06:12:06 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-r6EcKpXcin: open: permission denied
> Nov 15 06:25:28 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-DVB1BDrMnW: open: permission denied
> Nov 15 06:26:48 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-Y6PRszDQYR: open: permission denied
> Nov 15 06:30:58 jails-1 sudo: in openpam_check_error_code(): pam_sm_authenticate(): unexpected return value 27
> Nov 15 06:30:58 jails-1 sudo:     doug : 1 incorrect password attempt ; TTY=pts/1 ; PWD=/etc/periodic/weekly ; USER=root ; COMMAND=/bin/csh
> Nov 15 06:38:48 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-tBpCfZrUAj: open: permission denied
> Nov 15 06:39:08 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-xGfrq1NfGI: open: permission denied
> Nov 15 06:52:14 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-BELDqPDGIw: open: permission denied
> Nov 15 06:53:43 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-UuD98rgvtq: open: permission denied
> Nov 15 07:04:28 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-rJnLah3gzF: open: permission denied
> Nov 15 07:06:23 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-QsRbrXNGq0: open: permission denied
> Nov 15 07:17:33 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-nnyDoAiRAU: open: permission denied
> Nov 15 07:20:26 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-WLZrfr2Z8i: open: permission denied
> Nov 15 07:31:14 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-oTT2QxgtmO: open: permission denied
> Nov 15 07:31:43 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-BQNxg7RI9q: open: permission denied
> Nov 15 07:44:01 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-X7W7CMQJxn: open: permission denied
> Nov 15 07:44:15 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-5jfKQfLwMT: open: permission denied
> Nov 15 07:55:17 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-UyVnPnzLR3: open: permission denied
> Nov 15 07:58:13 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-Zk9NeatEaN: open: permission denied
> Nov 15 08:08:18 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-VpSFvVScdh: open: permission denied
> Nov 15 08:10:51 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-tHrPk5dcrQ: open: permission denied
> Nov 15 08:23:04 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-WNaEWi9IuX: open: permission denied
> Nov 15 08:23:31 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-gisVurBe1x: open: permission denied
> Nov 15 08:34:48 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-fnsEEIErvL: open: permission denied
> Nov 15 08:35:48 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-YOLlPU3gr2: open: permission denied
> Nov 15 08:46:46 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-jOrv1okEFk: open: permission denied
> Nov 15 08:48:26 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-WgHjDE8jz3: open: permission denied
> Nov 15 08:59:53 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-llqfoV0XEE: open: permission denied
> Nov 15 09:02:31 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-Vx1yRwaipr: open: permission denied
> Nov 15 09:14:19 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-okdvaOIEZ9: open: permission denied
> Nov 15 09:17:29 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-0DqTRQAMM2: open: permission denied
> Nov 15 09:28:09 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-XbFs42itKr: open: permission denied
> Nov 15 09:31:00 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-8VUxwn8W3D: open: permission denied
> Nov 15 09:42:30 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-F9Vsa5QWc6: open: permission denied
> Nov 15 09:44:46 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-vBtRCHIFNb: open: permission denied
> Nov 15 09:56:13 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-82z9YtagQ9: open: permission denied
> Nov 15 09:57:32 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-IBThadYpts: open: permission denied
> Nov 15 10:09:31 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-9jOLxSRKle: open: permission denied
> Nov 15 10:10:25 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-arN0N1YvWL: open: permission denied
> Nov 15 10:22:11 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-MY1MXxNzFX: open: permission denied
> Nov 15 10:23:36 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-U6eBWdggi5: open: permission denied
> Nov 15 10:35:43 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-pbl66l8LKi: open: permission denied
> Nov 15 10:36:47 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-MQKbFgyavO: open: permission denied
> Nov 15 10:48:22 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-9mSzjFJZGp: open: permission denied
> Nov 15 10:49:47 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-nXvwkTiPqg: open: permission denied
> Nov 15 11:00:30 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-E5jwy0AOdg: open: permission denied
> Nov 15 11:03:15 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-LclUnz9Nhr: open: permission denied
> Nov 15 11:15:20 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-pMhERBW9h3: open: permission denied
> Nov 15 11:17:40 dns named[3944]: dumping master file: /usr/local/etc/namedb/master/tmp-TpvjkPFlKa: open: permission denied
> panic: solaris assert: sa.sa_magic == 0x2F505A (0x2f505a00 == 0x2f505a), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c, line: 625
> cpuid = 1
> KDB: stack backtrace:
> #0 0xffffffff808e7dd0 at kdb_backtrace+0x60
> #1 0xffffffff808af8b5 at panic+0x155
> #2 0xffffffff81a2c23f at assfail3+0x2f
> #3 0xffffffff8189e34e at zfs_space_delta_cb+0xce
> #4 0xffffffff81824562 at dmu_objset_userquota_get_ids+0x202
> #5 0xffffffff818290f7 at dnode_setdirty+0x37
> #6 0xffffffff8182942e at dnode_allocate+0x15e
> #7 0xffffffff8182203a at dmu_object_alloc+0x15a
> #8 0xffffffff81874e1b at zfs_mknode+0x15b
> #9 0xffffffff818a143f at zfs_freebsd_create+0x4df
> #10 0xffffffff80d97d32 at VOP_CREATE_APV+0x92
> #11 0xffffffff80957ea9 at vn_open_cred+0x2c9
> #12 0xffffffff809515b1 at kern_openat+0x261
> #13 0xffffffff80c8ef87 at amd64_syscall+0x357
> #14 0xffffffff80c7567b at Xfast_syscall+0xfb
> Uptime: 6h58m44s
> Dumping 4711 out of 7764 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%
> 
> ------------------------------------------------------------------------
> kernel config
> 
> options	CONFIG_AUTOGENERATED
> ident	GENERIC
> machine	amd64
> cpu	HAMMER
> makeoptions	WITH_CTF=1
> makeoptions	DEBUG=-g
> options	XENHVM
> options	USB_DEBUG
> options	ATH_ENABLE_11N
> options	AH_AR5416_INTERRUPT_MITIGATION
> options	AH_SUPPORT_AR5416
> options	IEEE80211_SUPPORT_MESH
> options	IEEE80211_AMPDU_AGE
> options	IEEE80211_DEBUG
> options	SC_PIXEL_MODE
> options	VESA
> options	AHD_REG_PRETTY_PRINT
> options	AHC_REG_PRETTY_PRINT
> options	ATA_STATIC_ID
> options	SMP
> options	KDB_TRACE
> options	KDB
> options	INCLUDE_CONFIG_FILE
> options	DDB_CTF
> options	KDTRACE_HOOKS
> options	KDTRACE_FRAME
> options	MAC
> options	PROCDESC
> options	CAPABILITIES
> options	CAPABILITY_MODE
> options	AUDIT
> options	HWPMC_HOOKS
> options	KBD_INSTALL_CDEV
> options	PRINTF_BUFR_SIZE=128
> options	_KPOSIX_PRIORITY_SCHEDULING
> options	SYSVSEM
> options	SYSVMSG
> options	SYSVSHM
> options	STACK
> options	KTRACE
> options	SCSI_DELAY=5000
> options	COMPAT_FREEBSD7
> options	COMPAT_FREEBSD6
> options	COMPAT_FREEBSD5
> options	COMPAT_FREEBSD4
> options	COMPAT_FREEBSD32
> options	GEOM_LABEL
> options	GEOM_RAID
> options	GEOM_PART_GPT
> options	PSEUDOFS
> options	PROCFS
> options	CD9660
> options	MSDOSFS
> options	NFS_ROOT
> options	NFSLOCKD
> options	NFSD
> options	NFSCL
> options	MD_ROOT
> options	QUOTA
> options	UFS_GJOURNAL
> options	UFS_DIRHASH
> options	UFS_ACL
> options	SOFTUPDATES
> options	FFS
> options	SCTP
> options	TCP_OFFLOAD
> options	INET6
> options	INET
> options	PREEMPTION
> options	SCHED_ULE
> options	NEW_PCIB
> options	GEOM_PART_MBR
> options	GEOM_PART_EBR_COMPAT
> options	GEOM_PART_EBR
> options	GEOM_PART_BSD
> device	isa
> device	mem
> device	io
> device	uart_ns8250
> device	cpufreq
> device	acpi
> device	pci
> device	fdc
> device	ahci
> device	ata
> device	mvs
> device	siis
> device	ahc
> device	ahd
> device	esp
> device	hptiop
> device	isp
> device	mpt
> device	mps
> device	sym
> device	trm
> device	adv
> device	adw
> device	aic
> device	bt
> device	isci
> device	scbus
> device	ch
> device	da
> device	sa
> device	cd
> device	pass
> device	ses
> device	amr
> device	arcmsr
> device	ciss
> device	dpt
> device	hptmv
> device	hptnr
> device	hptrr
> device	hpt27xx
> device	iir
> device	ips
> device	mly
> device	twa
> device	tws
> device	aac
> device	aacp
> device	aacraid
> device	ida
> device	mfi
> device	mlx
> device	twe
> device	atkbdc
> device	atkbd
> device	psm
> device	kbdmux
> device	vga
> device	splash
> device	sc
> device	agp
> device	cbb
> device	pccard
> device	cardbus
> device	uart
> device	ppc
> device	ppbus
> device	lpt
> device	ppi
> device	puc
> device	bxe
> device	de
> device	em
> device	igb
> device	ixgbe
> device	le
> device	ti
> device	txp
> device	vx
> device	miibus
> device	ae
> device	age
> device	alc
> device	ale
> device	bce
> device	bfe
> device	bge
> device	cas
> device	dc
> device	et
> device	fxp
> device	gem
> device	hme
> device	jme
> device	lge
> device	msk
> device	nfe
> device	nge
> device	pcn
> device	re
> device	rl
> device	sf
> device	sge
> device	sis
> device	sk
> device	ste
> device	stge
> device	tl
> device	tx
> device	vge
> device	vr
> device	wb
> device	xl
> device	cs
> device	ed
> device	ex
> device	ep
> device	fe
> device	sn
> device	xe
> device	wlan
> device	wlan_wep
> device	wlan_ccmp
> device	wlan_tkip
> device	wlan_amrr
> device	an
> device	ath
> device	ath_pci
> device	ath_hal
> device	ath_rate_sample
> device	ipw
> device	iwi
> device	iwn
> device	malo
> device	mwl
> device	ral
> device	wi
> device	wpi
> device	loop
> device	random
> device	padlock_rng
> device	rdrand_rng
> device	ether
> device	vlan
> device	tun
> device	md
> device	gif
> device	faith
> device	firmware
> device	bpf
> device	uhci
> device	ohci
> device	ehci
> device	xhci
> device	usb
> device	ukbd
> device	umass
> device	sound
> device	snd_cmi
> device	snd_csa
> device	snd_emu10kx
> device	snd_es137x
> device	snd_hda
> device	snd_ich
> device	snd_via8233
> device	mmc
> device	mmcsd
> device	sdhci
> device	virtio
> device	virtio_pci
> device	vtnet
> device	virtio_blk
> device	virtio_scsi
> device	virtio_balloon
> device	hyperv
> device	xenpci
> device	vmx
> 
> ------------------------------------------------------------------------
> ddb capture buffer
> 
> ddb: ddb_capture: kvm_nlist
> 
> 
> 
> -- 
> Polytropon
> Magdeburg, Germany
> Happy FreeBSD user since 4.0
> Andra moi ennepe, Mousa, ...
> _______________________________________________
> freebsd-questions at freebsd.org mailing list
> https://lists.freebsd.org/mailman/listinfo/freebsd-questions
> To unsubscribe, send any mail to "freebsd-questions-unsubscribe at freebsd.org"


More information about the freebsd-questions mailing list