panic: make_dev_credv: bad si_name (error=17, si_name=pass2)
Johannes Totz
johannes at jo-t.de
Sun Nov 20 15:40:08 UTC 2011
Hi!
(Sent twice, first one bounced...)
Just got a panic on 9-stable, running inside VirtualBox, trying to build
a release-set. Don't know yet if reproducable, just happened a few
minutes ago.
The whole core.txt stuff follows below (beware of line-breaks):
zfstest dumped core - see /var/crash/vmcore.1
Sat Nov 19 10:51:49 UTC 2011
FreeBSD zfstest 9.0-PRERELEASE FreeBSD 9.0-PRERELEASE #0 r227727: Sat
Nov 19 07:52:17 UTC 2011 root at zfstest:/usr/obj/usr/src/sys/GENERIC i386
panic: make_dev_credv: bad si_name (error=17, si_name=pass2)
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "i386-marcel-freebsd"...
Unread portion of the kernel message buffer:
(ada1:ahcich0:0:0:0): lost device
panic: make_dev_credv: bad si_name (error=17, si_name=pass2)
cpuid = 0
KDB: stack backtrace:
#0 0xc0a4aff7 at kdb_backtrace+0x47
#1 0xc0a185c7 at panic+0x117
#2 0xc09d05de at make_dev_credv+0x9e
#3 0xc09d080a at make_dev+0x4a
#4 0xc04b79e0 at passregister+0x230
#5 0xc048ece3 at cam_periph_alloc+0x4e3
#6 0xc04b7525 at passasync+0x85
#7 0xc0490442 at xpt_async_bcast+0x32
#8 0xc0492715 at xpt_async+0x105
#9 0xc04991f3 at probedone+0xc33
#10 0xc04958a1 at camisr_runqueue+0x2e1
#11 0xc04959ff at camisr+0x13f
#12 0xc09ed69b at intr_event_execute_handlers+0x13b
#13 0xc09eee5a at ithread_loop+0x7a
#14 0xc09ea8a7 at fork_exit+0x97
#15 0xc0d32734 at fork_trampoline+0x8
Uptime: 7m57s
(ada1:ahcich0:0:0:0): Synchronize cache failed
Physical memory: 495 MB
Dumping 409 MB: 394 378 362 346 330 314 298 282 266 250 234 218 202 186
170 154 138 122 106 90 74 58 42 26 10
Reading symbols from /boot/kernel/zfs.ko...Reading symbols from
/boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from
/boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
#0 doadump (textdump=1) at pcpu.h:244
244 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) #0 doadump (textdump=1) at pcpu.h:244
#1 0xc0a1836a in kern_reboot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:442
#2 0xc0a18601 in panic (fmt=Variable "fmt" is not available.
) at /usr/src/sys/kern/kern_shutdown.c:607
#3 0xc09d05de in make_dev_credv (flags=0, dres=0xc2ea8700,
devsw=Variable "devsw" is not available.
)
at /usr/src/sys/kern/kern_conf.c:759
#4 0xc09d080a in make_dev (devsw=0xc0f52340, unit=2, uid=0, gid=5,
mode=384,
fmt=0xc0d77b8c "%s%d") at /usr/src/sys/kern/kern_conf.c:816
#5 0xc04b79e0 in passregister (periph=0xd8658600, arg=0xc33fc000)
at /usr/src/sys/cam/scsi/scsi_pass.c:335
#6 0xc048ece3 in cam_periph_alloc (periph_ctor=0xc04b77b0 <passregister>,
periph_oninvalidate=0xc04b75e0 <passoninvalidate>,
periph_dtor=0xc04b7ad0 <passcleanup>,
periph_start=0xc04b75a0 <passstart>, name=0xc0d9bcef "pass",
type=CAM_PERIPH_BIO, path=0xc7f58bd0, ac_callback=0xc04b74a0
<passasync>,
code=AC_FOUND_DEVICE, arg=0xc33fc000) at
/usr/src/sys/cam/cam_periph.c:243
#7 0xc04b7525 in passasync (callback_arg=0x0, code=128, path=0xc3a737e0,
arg=0xc33fc000) at /usr/src/sys/cam/scsi/scsi_pass.c:236
#8 0xc0490442 in xpt_async_bcast (async_head=0x0, async_code=128,
path=0xc3a737e0, async_arg=0xc33fc000) at
/usr/src/sys/cam/cam_xpt.c:4037
#9 0xc0492715 in xpt_async (async_code=dwarf2_read_address: Corrupted
DWARF expression.
) at /usr/src/sys/cam/cam_xpt.c:4016
#10 0xc04991f3 in probedone (periph=0xd8658280, done_ccb=0xc33fc000)
at /usr/src/sys/cam/ata/ata_xpt.c:1075
#11 0xc04958a1 in camisr_runqueue (V_queue=Variable "V_queue" is not
available.
)
at /usr/src/sys/cam/cam_xpt.c:4960
#12 0xc04959ff in camisr (dummy=0x0) at /usr/src/sys/cam/cam_xpt.c:4863
#13 0xc09ed69b in intr_event_execute_handlers (p=0xc3172588, ie=0xc327c080)
at /usr/src/sys/kern/kern_intr.c:1257
#14 0xc09eee5a in ithread_loop (arg=0xc3171bb0)
at /usr/src/sys/kern/kern_intr.c:1270
#15 0xc09ea8a7 in fork_exit (callout=0xc09eede0 <ithread_loop>,
arg=0xc3171bb0, frame=0xc2ea8d28) at /usr/src/sys/kern/kern_fork.c:995
#16 0xc0d32734 in fork_trampoline () at
/usr/src/sys/i386/i386/exception.s:275
(kgdb)
------------------------------------------------------------------------
ps -axl
UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
0 0 0 0 -8 0 0 0 - DLs ?? 0:00.05
[kernel]
0 1 0 0 20 0 8032 1955216 wait DLs ?? 0:00.02 [init]
0 2 0 0 -16 0 0 0 waitin DL ?? 0:00.00
[sctp_itera
0 3 0 0 -16 0 0 0 ccb_sc DL ?? 0:00.00
[xpt_thrd]
0 4 0 0 -16 0 0 0 psleep DL ?? 0:00.00
[pagedaemon
0 5 0 0 -16 0 0 0 psleep DL ?? 0:00.00
[vmdaemon]
0 6 0 0 155 0 0 0 pgzero DL ?? 0:00.00
[pagezero]
0 7 0 0 -16 0 0 0 psleep DL ?? 0:00.00
[bufdaemon]
0 8 0 0 -16 0 0 0 vlruwt DL ?? 0:00.00 [vnlru]
0 9 0 0 16 0 0 0 zio->i DL ?? 0:00.00
[syncer]
0 10 0 0 -16 0 0 0 audit_ DL ?? 0:00.00 [audit]
0 11 0 0 155 0 0 0 - RL ?? 0:03.80 [idle]
0 12 0 0 -84 0 0 0 - WL ?? 0:00.09 [intr]
0 13 0 0 -8 0 0 0 - DL ?? 0:00.15 [geom]
0 14 0 0 -16 0 0 0 - DL ?? 0:00.03
[yarrow]
0 15 0 0 -68 0 0 0 - DL ?? 0:00.01 [usb]
0 16 0 0 -16 0 0 0 sdflus DL ?? 0:00.00
[softdepflu
0 34 0 0 -8 0 0 0 zio->i DL ?? 0:00.00
[zfskern]
0 499 1 0 52 0 9540 1958928 select Ds ?? 0:00.00
[dhclient]
65 554 1 0 52 0 9540 1951504 select Ds ?? 0:00.00
[dhclient]
0 569 1 0 52 0 12128 1962640 select Ds ?? 0:00.00 [devd]
0 709 1 0 20 0 9616 1950576 select Ds ?? 0:00.01
[syslogd]
0 955 1 0 20 0 11324 1963568 select Ds ?? 0:00.01
[sendmail]
25 959 1 0 52 0 11324 1954288 pause Ds ?? 0:00.01
[sendmail]
0 965 1 0 20 0 9644 1964496 nanslp Ds ?? 0:00.00 [cron]
0 1023 1 0 52 0 9616 1957072 ttyin Ds+ ?? 0:00.01
[getty]
0 1024 1 0 24 0 10124 1960784 wait Ds ?? 0:00.01
[login]
0 1025 1 0 52 0 9616 1952432 ttyin Ds+ ?? 0:00.01
[getty]
0 1026 1 0 52 0 9616 1966960 ttyin Ds+ ?? 0:00.01
[getty]
0 1027 1 0 52 0 9616 1958000 ttyin Ds+ ?? 0:00.00
[getty]
0 1028 1 0 52 0 9616 1956144 ttyin Ds+ ?? 0:00.01
[getty]
0 1029 1 0 52 0 9616 1739440 ttyin Ds+ ?? 0:00.01
[getty]
0 1030 1 0 52 0 9616 1738512 ttyin Ds+ ?? 0:00.00
[getty]
0 1031 1024 0 20 0 10940 1979024 pause D ?? 0:00.02 [csh]
0 1555 1031 0 42 0 8032 1978096 wait D+ ?? 0:00.00 [make]
0 1558 1555 0 52 0 8032 1972528 wait D+ ?? 0:00.00 [make]
0 1560 1558 0 52 0 8032 1971600 wait D+ ?? 0:00.00 [make]
0 1564 1560 0 52 0 8032 1979952 wait D+ ?? 0:00.00 [make]
0 1691 1564 0 52 0 9924 1737584 wait D+ ?? 0:00.00 [sh]
0 1692 1691 0 52 0 8032 1975312 wait D+ ?? 0:00.00 [make]
0 1700 1692 0 52 0 8032 1973456 wait D+ ?? 0:00.00 [make]
0 1715 1700 0 36 0 9924 1747792 wait D+ ?? 0:00.00 [sh]
0 21858 1715 0 52 0 8032 1740368 wait D+ ?? 0:00.00 [make]
0 21860 21858 0 52 0 9924 3241200 zio->i D+ ?? 0:00.00 [sh]
------------------------------------------------------------------------
vmstat -s
359992 cpu context switches
233650 device interrupts
56121 software interrupts
1863866 traps
1702573 system calls
17 kernel threads created
14863 fork() calls
7306 vfork() calls
0 rfork() calls
0 swap pager pageins
0 swap pager pages paged in
0 swap pager pageouts
0 swap pager pages paged out
834 vnode pager pageins
2373 vnode pager pages paged in
0 vnode pager pageouts
0 vnode pager pages paged out
0 page daemon wakeups
0 pages examined by the page daemon
233 pages reactivated
340712 copy-on-write faults
244 copy-on-write optimized faults
1032155 zero fill pages zeroed
63531 zero fill pages prezeroed
3 intransit blocking page faults
1789980 total VM faults taken
0 pages affected by kernel thread creation
14155206 pages affected by fork()
6606983 pages affected by vfork()
0 pages affected by rfork()
0 pages cached
1842752 pages freed
0 pages freed by daemon
0 pages freed by exiting processes
3425 pages active
1746 pages inactive
0 pages in VM cache
97451 pages wired down
21727 pages free
4096 bytes per page
2191000 total name lookups
cache hits (91% pos + 3% neg) system 0% per-directory
deletions 0%, falsehits 0%, toolong 0%
------------------------------------------------------------------------
vmstat -m
Type InUse MemUse HighUse Requests Size(s)
LED 2 1K - 2 16,64
feeder 7 1K - 7 16
acpiintr 1 1K - 1 32
isadev 9 1K - 9 64
acpica 2073 119K - 29726 16,32,64,128,256,512,1024,4096
cdev 8 1K - 8 128
acpitask 1 1K - 1 1024
sigio 1 1K - 1 32
filedesc 44 11K - 22187 256
kenv 110 9K - 121 16,32,64,128,4096
kqueue 0 0K - 26 128,1024
CAM dev queue 4 1K - 4 128
proc-args 24 2K - 22341 16,32,64,128,256
hhook 2 1K - 2 128
ithread 52 5K - 52 16,64,128
CAM queue 18 1K - 66 16,128
KTRACE 100 13K - 100 128
acpisem 16 2K - 16 64,128
linker 168 1642K - 199 16,32,256,1024,4096
lockf 17 1K - 29 32,64
loginclass 2 1K - 5 64
ip6ndp 4 1K - 4 64,128
temp 13 157K - 45052
16,32,64,128,256,512,1024,2048,4096
devbuf 1285 3079K - 1301
16,32,64,128,256,512,1024,2048,4096
module 497 32K - 497 64,128
mtx_pool 2 8K - 2 4096
osd 3 1K - 4 16,32
CAM SIM 4 1K - 4 128
subproc 110 193K - 22253 256,4096
proc 2 4K - 2 2048
session 16 1K - 20 64
pgrp 18 2K - 25 64
cred 38 4K - 86114 64,128
uidinfo 4 1K - 7 64,512
plimit 20 5K - 1930 256
scsi_cd 0 0K - 6 16
CAM periph 9 2K - 25 16,32,64,128
CAM XPT 59 43K - 134 16,32,64,1024,2048
sysctltmp 0 0K - 346 16,32,64,128,4096
sysctloid 2259 68K - 2296 16,32,64
sysctl 0 0K - 7804 16,32,64
tidhash 1 4K - 1 4096
umtx 470 45K - 470 64,128
p1003.1b 1 1K - 1 16
SWAP 2 277K - 2 64
bus-sc 34 51K - 1363
16,64,128,256,512,1024,2048,4096
bus 991 42K - 3022 16,32,64,128,256,1024
devstat 6 13K - 6 16,4096
eventhandler 84 5K - 84 32,64,128
kobj 358 716K - 418 2048
Per-cpu 1 1K - 1 16
ata_pci 1 1K - 1 32
rman 90 6K - 244 32,64
sbuf 0 0K - 666
16,32,64,128,256,512,1024,2048,4096
stack 0 0K - 2 128
taskqueue 57 3K - 87 16,32,64,512
Unitno 14 1K - 3164 16,64
iov 0 0K - 644 64,128,256
select 7 1K - 7 64
ioctlops 0 0K - 18328 16,32,64,128,256,512,1024
msg 4 25K - 4 1024,4096
sem 4 101K - 4 1024,4096
shm 1 12K - 1
tty 19 10K - 21 512,1024
mbuf_tag 0 0K - 18 32
shmfd 1 4K - 1 4096
pcb 15 79K - 36 16,64,512,1024,2048,4096
soname 3 1K - 159 16,32,128
biobuf 182 364K - 186 2048
vfscache 1 256K - 1
cl_savebuf 0 0K - 11 32,64
vfs_hash 1 128K - 1
acpidev 27 1K - 27 32
vnodes 2 1K - 2 128
vnodemarker 0 0K - 246 512
mount 86 3K - 208 16,32,64,128,256
BPF 8 9K - 8 64,128,256,4096
ether_multi 15 1K - 22 16,32,64
ifaddr 35 8K - 36 16,32,64,128,256,512,2048
ifnet 4 4K - 4 64,1024
USBdev 4 2K - 4 32,128,1024
clone 6 24K - 6 4096
arpcom 1 1K - 1 16
lltable 10 3K - 10 128,256
USB 7 2K - 7 16,32,64,1024
routetbl 31 4K - 87 16,32,64,128,256
igmp 3 1K - 3 128
in_multi 2 1K - 3 128
sctp_iter 0 0K - 3 256
sctp_ifn 2 1K - 2 128
sctp_ifa 4 1K - 4 128
sctp_vrf 1 1K - 1 64
sctp_a_it 0 0K - 3 16
hostcache 1 16K - 1
syncache 1 72K - 1
entropy 1024 64K - 1024 64
in6_multi 12 2K - 12 16,256
pci_link 8 1K - 8 16,128
mld 3 1K - 3 128
rpc 2 1K - 2 128
audit_evclass 179 3K - 218 16
savedino 0 0K - 23 256
freework 1 1K - 11 32,128
newdirblk 0 0K - 4 32
dirrem 0 0K - 22 64
mkdir 0 0K - 8 64
diradd 0 0K - 32 64
freefile 0 0K - 13 32
freeblks 0 0K - 10 128
freefrag 0 0K - 2 64
newblk 1 16K - 24 128
bmsafemap 1 4K - 11 128,4096
inodedep 1 128K - 50 256
pagedep 1 16K - 11 128
ufs_dirhash 39 8K - 42 16,32,64,128,512
ufs_mount 9 19K - 9 256,2048,4096
vm_pgdata 2 33K - 2 64
DEVFS1 82 21K - 88 256
atkbddev 2 1K - 2 32
DEVFS3 95 12K - 105 128
DEVFS 18 1K - 19 16,64
DEVFSP 1 1K - 1 32
apmdev 1 1K - 1 64
pfs_nodes 21 3K - 21 128
nexusdev 3 1K - 3 16
GEOM 74 18K - 462 16,32,64,128,512,1024,2048
kbdmux 6 18K - 6 16,256,1024,2048
solaris 81901 312538K - 1780499
16,32,64,128,256,512,1024,2048,4096
kstat_data 4 1K - 4 32
------------------------------------------------------------------------
vmstat -z
ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP
UMA Kegs: 128, 0, 182, 28, 182, 0, 0
UMA Zones: 152, 0, 182, 10, 182, 0, 0
UMA Slabs: 284, 0, 15396, 2594, 39478, 0, 0
UMA RCntSlabs: 544, 0, 195, 1, 195, 0, 0
UMA Hash: 128, 0, 82, 8, 82, 0, 0
16 Bucket: 76, 0, 22, 28, 62, 0, 0
32 Bucket: 140, 0, 14, 42, 55, 0, 0
64 Bucket: 268, 0, 12, 16, 92, 30, 0
128 Bucket: 524, 0, 73, 74, 2338, 657, 0
VM OBJECT: 136, 0, 8745, 2333, 315488, 0, 0
MAP: 140, 0, 7, 21, 7, 0, 0
KMAP ENTRY: 72, 31482, 2056, 170, 91029, 0, 0
MAP ENTRY: 72, 0, 344, 133, 519624, 0, 0
fakepg: 72, 0, 0, 0, 0, 0, 0
mt_zone: 2060, 0, 306, 125, 306, 0, 0
16: 16, 0, 13191, 816, 177976, 0, 0
32: 32, 0, 15070, 32051, 508817, 0, 0
64: 64, 0, 15556, 3737, 541209, 0, 0
128: 128, 0, 8457, 3993, 169411, 0, 0
256: 256, 0, 757, 1148, 124184, 0, 0
512: 512, 0, 24866, 806, 426184, 0, 0
1024: 1024, 0, 734, 154, 9730, 0, 0
2048: 2048, 0, 5160, 408, 13894, 0, 0
4096: 4096, 0, 2075, 384, 53606, 0, 0
Files: 56, 0, 48, 86, 124721, 0, 0
TURNSTILE: 72, 0, 236, 34, 236, 0, 0
umtx pi: 52, 0, 0, 0, 0, 0, 0
MAC labels: 20, 0, 0, 0, 0, 0, 0
PROC: 708, 0, 43, 22, 22186, 0, 0
THREAD: 728, 0, 233, 2, 369, 0, 0
SLEEPQUEUE: 44, 0, 236, 59, 236, 0, 0
VMSPACE: 232, 0, 27, 41, 22171, 0, 0
cpuset: 40, 0, 2, 182, 2, 0, 0
audit_record: 824, 0, 0, 0, 0, 0, 0
mbuf_packet: 256, 0, 256, 141, 280, 0, 0
mbuf: 256, 0, 1, 140, 88, 0, 0
mbuf_cluster: 2048, 16832, 384, 6, 384, 0, 0
mbuf_jumbo_page: 4096, 8416, 0, 0, 0, 0, 0
mbuf_jumbo_9k: 9216, 12624, 0, 0, 0, 0, 0
mbuf_jumbo_16k: 16384, 8416, 0, 0, 0, 0, 0
mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0
g_bio: 140, 0, 16, 208, 72396, 0, 0
ttyinq: 152, 0, 120, 36, 255, 0, 0
ttyoutq: 256, 0, 64, 11, 136, 0, 0
ata_request: 208, 0, 1, 37, 12429, 0, 0
ata_composite: 180, 0, 0, 0, 0, 0, 0
VNODE: 272, 0, 10955, 973, 35105, 0, 0
VNODEPOLL: 60, 0, 0, 0, 0, 0, 0
NAMEI: 1024, 0, 1, 11, 405356, 0, 0
S VFS Cache: 72, 0, 8577, 6687, 79664, 0, 0
L VFS Cache: 292, 0, 1, 129, 462, 0, 0
NCLNODE: 372, 0, 0, 0, 0, 0, 0
DIRHASH: 1024, 0, 52, 4, 54, 0, 0
pipe: 400, 0, 1, 19, 785, 0, 0
Mountpoints: 648, 0, 8, 10, 8, 0, 0
ksiginfo: 80, 0, 56, 88, 72, 0, 0
itimer: 220, 0, 0, 0, 0, 0, 0
KNOTE: 72, 0, 0, 106, 26, 0, 0
socket: 416, 16839, 11, 16, 143, 0, 0
unpcb: 172, 16836, 6, 40, 30, 0, 0
ipq: 32, 565, 0, 0, 0, 0, 0
udp_inpcb: 252, 16845, 2, 28, 100, 0, 0
udpcb: 8, 16849, 2, 201, 100, 0, 0
tcp_inpcb: 252, 16845, 1, 29, 3, 0, 0
tcpcb: 688, 16835, 1, 9, 3, 0, 0
tcptw: 52, 3384, 0, 0, 0, 0, 0
syncache: 120, 15360, 0, 0, 0, 0, 0
hostcache: 76, 15400, 0, 0, 0, 0, 0
tcpreass: 20, 1183, 0, 0, 0, 0, 0
sackhole: 20, 0, 0, 0, 0, 0, 0
sctp_ep: 924, 16832, 0, 0, 0, 0, 0
sctp_asoc: 1500, 40000, 0, 0, 0, 0, 0
sctp_laddr: 24, 80040, 0, 145, 3, 0, 0
sctp_raddr: 496, 80000, 0, 0, 0, 0, 0
sctp_chunk: 96, 400000, 0, 0, 0, 0, 0
sctp_readq: 76, 400000, 0, 0, 0, 0, 0
sctp_stream_msg_out: 72, 400044, 0, 0, 0, 0, 0
sctp_asconf: 24, 400055, 0, 0, 0, 0, 0
sctp_asconf_ack: 24, 400055, 0, 0, 0, 0, 0
ripcb: 252, 16845, 1, 29, 1, 0, 0
rtentry: 108, 0, 13, 59, 14, 0, 0
selfd: 28, 0, 16, 238, 339, 0, 0
SWAPMETA: 276, 62230, 0, 0, 0, 0, 0
FFS inode: 116, 0, 1585, 1352, 3053, 0, 0
FFS1 dinode: 128, 0, 0, 0, 0, 0, 0
FFS2 dinode: 256, 0, 1585, 1355, 3053, 0, 0
taskq_zone: 24, 0, 0, 145, 624, 0, 0
zio_cache: 700, 0, 729, 231, 212935, 0, 0
zio_link_cache: 24, 0, 726, 3624, 112857, 0, 0
zio_buf_512: 512, 0, 0, 0, 0, 0, 0
zio_data_buf_512: 512, 0, 0, 0, 0, 0, 0
zio_buf_1024: 1024, 0, 0, 0, 0, 0, 0
zio_data_buf_1024: 1024, 0, 0, 0, 0, 0, 0
zio_buf_1536: 1536, 0, 0, 0, 0, 0, 0
zio_data_buf_1536: 1536, 0, 0, 0, 0, 0, 0
zio_buf_2048: 2048, 0, 0, 0, 0, 0, 0
zio_data_buf_2048: 2048, 0, 0, 0, 0, 0, 0
zio_buf_2560: 2560, 0, 0, 0, 0, 0, 0
zio_data_buf_2560: 2560, 0, 0, 0, 0, 0, 0
zio_buf_3072: 3072, 0, 0, 0, 0, 0, 0
zio_data_buf_3072: 3072, 0, 0, 0, 0, 0, 0
zio_buf_3584: 3584, 0, 0, 0, 0, 0, 0
zio_data_buf_3584: 3584, 0, 0, 0, 0, 0, 0
zio_buf_4096: 4096, 0, 0, 0, 0, 0, 0
zio_data_buf_4096: 4096, 0, 0, 0, 0, 0, 0
zio_buf_5120: 5120, 0, 0, 0, 0, 0, 0
zio_data_buf_5120: 5120, 0, 0, 0, 0, 0, 0
zio_buf_6144: 6144, 0, 0, 0, 0, 0, 0
zio_data_buf_6144: 6144, 0, 0, 0, 0, 0, 0
zio_buf_7168: 7168, 0, 0, 0, 0, 0, 0
zio_data_buf_7168: 7168, 0, 0, 0, 0, 0, 0
zio_buf_8192: 8192, 0, 0, 0, 0, 0, 0
zio_data_buf_8192: 8192, 0, 0, 0, 0, 0, 0
zio_buf_10240: 10240, 0, 0, 0, 0, 0, 0
zio_data_buf_10240: 10240, 0, 0, 0, 0, 0, 0
zio_buf_12288: 12288, 0, 0, 0, 0, 0, 0
zio_data_buf_12288: 12288, 0, 0, 0, 0, 0, 0
zio_buf_14336: 14336, 0, 0, 0, 0, 0, 0
zio_data_buf_14336: 14336, 0, 0, 0, 0, 0, 0
zio_buf_16384: 16384, 0, 0, 0, 0, 0, 0
zio_data_buf_16384: 16384, 0, 0, 0, 0, 0, 0
zio_buf_20480: 20480, 0, 0, 0, 0, 0, 0
zio_data_buf_20480: 20480, 0, 0, 0, 0, 0, 0
zio_buf_24576: 24576, 0, 0, 0, 0, 0, 0
zio_data_buf_24576: 24576, 0, 0, 0, 0, 0, 0
zio_buf_28672: 28672, 0, 0, 0, 0, 0, 0
zio_data_buf_28672: 28672, 0, 0, 0, 0, 0, 0
zio_buf_32768: 32768, 0, 0, 0, 0, 0, 0
zio_data_buf_32768: 32768, 0, 0, 0, 0, 0, 0
zio_buf_36864: 36864, 0, 0, 0, 0, 0, 0
zio_data_buf_36864: 36864, 0, 0, 0, 0, 0, 0
zio_buf_40960: 40960, 0, 0, 0, 0, 0, 0
zio_data_buf_40960: 40960, 0, 0, 0, 0, 0, 0
zio_buf_45056: 45056, 0, 0, 0, 0, 0, 0
zio_data_buf_45056: 45056, 0, 0, 0, 0, 0, 0
zio_buf_49152: 49152, 0, 0, 0, 0, 0, 0
zio_data_buf_49152: 49152, 0, 0, 0, 0, 0, 0
zio_buf_53248: 53248, 0, 0, 0, 0, 0, 0
zio_data_buf_53248: 53248, 0, 0, 0, 0, 0, 0
zio_buf_57344: 57344, 0, 0, 0, 0, 0, 0
zio_data_buf_57344: 57344, 0, 0, 0, 0, 0, 0
zio_buf_61440: 61440, 0, 0, 0, 0, 0, 0
zio_data_buf_61440: 61440, 0, 0, 0, 0, 0, 0
zio_buf_65536: 65536, 0, 0, 0, 0, 0, 0
zio_data_buf_65536: 65536, 0, 0, 0, 0, 0, 0
zio_buf_69632: 69632, 0, 0, 0, 0, 0, 0
zio_data_buf_69632: 69632, 0, 0, 0, 0, 0, 0
zio_buf_73728: 73728, 0, 0, 0, 0, 0, 0
zio_data_buf_73728: 73728, 0, 0, 0, 0, 0, 0
zio_buf_77824: 77824, 0, 0, 0, 0, 0, 0
zio_data_buf_77824: 77824, 0, 0, 0, 0, 0, 0
zio_buf_81920: 81920, 0, 0, 0, 0, 0, 0
zio_data_buf_81920: 81920, 0, 0, 0, 0, 0, 0
zio_buf_86016: 86016, 0, 0, 0, 0, 0, 0
zio_data_buf_86016: 86016, 0, 0, 0, 0, 0, 0
zio_buf_90112: 90112, 0, 0, 0, 0, 0, 0
zio_data_buf_90112: 90112, 0, 0, 0, 0, 0, 0
zio_buf_94208: 94208, 0, 0, 0, 0, 0, 0
zio_data_buf_94208: 94208, 0, 0, 0, 0, 0, 0
zio_buf_98304: 98304, 0, 0, 0, 0, 0, 0
zio_data_buf_98304: 98304, 0, 0, 0, 0, 0, 0
zio_buf_102400: 102400, 0, 0, 0, 0, 0, 0
zio_data_buf_102400: 102400, 0, 0, 0, 0, 0, 0
zio_buf_106496: 106496, 0, 0, 0, 0, 0, 0
zio_data_buf_106496: 106496, 0, 0, 0, 0, 0, 0
zio_buf_110592: 110592, 0, 0, 0, 0, 0, 0
zio_data_buf_110592: 110592, 0, 0, 0, 0, 0, 0
zio_buf_114688: 114688, 0, 0, 0, 0, 0, 0
zio_data_buf_114688: 114688, 0, 0, 0, 0, 0, 0
zio_buf_118784: 118784, 0, 0, 0, 0, 0, 0
zio_data_buf_118784: 118784, 0, 0, 0, 0, 0, 0
zio_buf_122880: 122880, 0, 0, 0, 0, 0, 0
zio_data_buf_122880: 122880, 0, 0, 0, 0, 0, 0
zio_buf_126976: 126976, 0, 0, 0, 0, 0, 0
zio_data_buf_126976: 126976, 0, 0, 0, 0, 0, 0
zio_buf_131072: 131072, 0, 0, 0, 0, 0, 0
zio_data_buf_131072: 131072, 0, 0, 0, 0, 0, 0
sa_cache: 44, 0, 9339, 993, 32008, 0, 0
dnode_t: 532, 0, 23480, 621, 29356, 0, 0
dmu_buf_impl_t: 136, 0, 35445, 4517, 73412, 0, 0
arc_buf_hdr_t: 148, 0, 21467, 1855, 37667, 0, 0
arc_buf_t: 60, 0, 12644, 3925, 40178, 0, 0
zil_lwb_cache: 168, 0, 16, 30, 46, 0, 0
zfs_znode_cache: 268, 0, 9339, 881, 32008, 0, 0
------------------------------------------------------------------------
vmstat -i
interrupt total rate
irq0: attimer0 204315 2128
irq1: atkbd0 764 7
irq5: ahci0 22384 233
irq10: em0 32 0
irq14: ata0 6129 63
irq15: ata1 25 0
Total 233649 2433
------------------------------------------------------------------------
pstat -T
48/7944 files
0M/2047M swap space
------------------------------------------------------------------------
pstat -s
Device 512-blocks Used Avail Capacity
/dev/ada0s1a 4194048 0 4194048 0%
------------------------------------------------------------------------
iostat
iostat: kvm_read(_tk_nin): invalid address (0x0)
iostat: disabling TTY statistics
ada0 ada1 cd0 cpu
KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id
12.95 60 0.76 13.59 251 3.34 0.00 0 0.00 9 0 24 9 58
------------------------------------------------------------------------
ipcs -a
Message Queues:
T ID KEY MODE OWNER GROUP CREATOR CGROUP
CBYTES QNUM QBYTES
LSPID LRPID STIME RTIME CTIME
Shared Memory:
T ID KEY MODE OWNER GROUP CREATOR CGROUP
NATTCH SEGSZ CPID LPID ATIME DTIME CTIME
Semaphores:
T ID KEY MODE OWNER GROUP CREATOR CGROUP
NSEMS OTIME CTIME
------------------------------------------------------------------------
ipcs -T
msginfo:
msgmax: 16384 (max characters in a message)
msgmni: 40 (# of message queues)
msgmnb: 2048 (max characters in a message queue)
msgtql: 40 (max # of messages in system)
msgssz: 8 (size of a message segment)
msgseg: 2048 (# of message segments in system)
shminfo:
shmmax: 536870912 (max shared memory segment size)
shmmin: 1 (min shared memory segment size)
shmmni: 192 (max number of shared memory identifiers)
shmseg: 128 (max shared memory segments per process)
shmall: 131072 (max amount of shared memory in pages)
seminfo:
semmni: 50 (# of semaphore identifiers)
semmns: 340 (# of semaphores in system)
semmnu: 150 (# of undo structures in system)
semmsl: 340 (max # of semaphores per id)
semopm: 100 (max # of operations per semop call)
semume: 50 (max # of undo entries per process)
semusz: 616 (size in bytes of undo structure)
semvmx: 32767 (semaphore maximum value)
semaem: 16384 (adjust on exit max value)
------------------------------------------------------------------------
nfsstat
Client Info:
Rpc Counts:
Getattr Setattr Lookup Readlink Read Write Create
Remove
0 0 0 0 0 0 0
0
Rename Link Symlink Mkdir Rmdir Readdir RdirPlus
Access
0 0 0 0 0 0 0
0
Mknod Fsstat Fsinfo PathConf Commit
0 0 0 0 0
Rpc Info:
TimedOut Invalid X Replies Retries Requests
0 0 0 0 0
Cache Info:
Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits
Misses
0 0 0 0 0 0 0
0
BioRLHits Misses BioD Hits Misses DirE Hits Misses Accs Hits
Misses
0 0 0 0 0 0 0
0
Server Info:
Getattr Setattr Lookup Readlink Read Write Create
Remove
0 0 0 0 0 0 0
0
Rename Link Symlink Mkdir Rmdir Readdir RdirPlus
Access
0 0 0 0 0 0 0
0
Mknod Fsstat Fsinfo PathConf Commit
0 0 0 0 0
Server Ret-Failed
0
Server Faults
0
Server Cache Stats:
Inprog Idem Non-idem Misses
0 0 0 0
Server Write Gathering:
WriteOps WriteRPC Opsaved
0 0 0
------------------------------------------------------------------------
netstat -s
tcp:
0 packets sent
0 data packets (0 bytes)
0 data packets (0 bytes) retransmitted
0 data packets unnecessarily retransmitted
0 resends initiated by MTU discovery
0 ack-only packets (0 delayed)
0 URG only packets
0 window probe packets
0 window update packets
0 control packets
0 packets received
0 acks (for 0 bytes)
0 duplicate acks
0 acks for unsent data
0 packets (0 bytes) received in-sequence
0 completely duplicate packets (0 bytes)
0 old duplicate packets
0 packets with some dup. data (0 bytes duped)
0 out-of-order packets (0 bytes)
0 packets (0 bytes) of data after window
0 window probes
0 window update packets
0 packets received after close
0 discarded for bad checksums
0 discarded for bad header offset fields
0 discarded because packet too short
0 discarded due to memory problems
0 connection requests
0 connection accepts
0 bad connection attempts
0 listen queue overflows
0 ignored RSTs in the windows
0 connections established (including accepts)
2 connections closed (including 0 drops)
0 connections updated cached RTT on close
0 connections updated cached RTT variance on close
0 connections updated cached ssthresh on close
0 embryonic connections dropped
0 segments updated rtt (of 0 attempts)
0 retransmit timeouts
0 connections dropped by rexmit timeout
0 persist timeouts
0 connections dropped by persist timeout
0 Connections (fin_wait_2) dropped because of timeout
0 keepalive timeouts
0 keepalive probes sent
0 connections dropped by keepalive
0 correct ACK header predictions
0 correct data packet header predictions
0 syncache entries added
0 retransmitted
0 dupsyn
0 dropped
0 completed
0 bucket overflow
0 cache overflow
0 reset
0 stale
0 aborted
0 badack
0 unreach
0 zone failures
0 cookies sent
0 cookies received
0 hostcache entries added
0 bucket overflow
0 SACK recovery episodes
0 segment rexmits in SACK recovery episodes
0 byte rexmits in SACK recovery episodes
0 SACK options (SACK blocks) received
0 SACK options (SACK blocks) sent
0 SACK scoreboard overflow
0 packets with ECN CE bit set
0 packets with ECN ECT(0) bit set
0 packets with ECN ECT(1) bit set
0 successful ECN handshakes
0 times ECN reduced the congestion window
udp:
13 datagrams received
0 with incomplete header
0 with bad data length field
0 with bad checksum
0 with no checksum
0 dropped due to no socket
0 broadcast/multicast datagrams undelivered
0 dropped due to full socket buffers
0 not for hashed pcb
13 delivered
13 datagrams output
0 times multicast source filter matched
ip:
14 total packets received
0 bad header checksums
0 with size smaller than minimum
0 with data size < data length
0 with ip length > max ip packet size
0 with header length < data size
0 with data length < header length
0 with bad options
0 with incorrect version number
0 fragments received
0 fragments dropped (dup or out of space)
0 fragments dropped after timeout
0 packets reassembled ok
13 packets for this host
0 packets for unknown/unsupported protocol
0 packets forwarded (0 packets fast forwarded)
1 packet not forwardable
0 packets received for unknown multicast group
0 redirects sent
13 packets sent from this host
0 packets sent with fabricated ip header
0 output packets dropped due to no bufs, etc.
0 output packets discarded due to no route
0 output datagrams fragmented
0 fragments created
0 datagrams that can't be fragmented
0 tunneling packets that can't find gif
0 datagrams with bad address in header
icmp:
0 calls to icmp_error
0 errors not generated in response to an icmp message
0 messages with bad code fields
0 messages less than the minimum length
0 messages with bad checksum
0 messages with bad length
0 multicast echo requests ignored
0 multicast timestamp requests ignored
0 message responses generated
0 invalid return addresses
0 no return routes
igmp:
0 messages received
0 messages received with too few bytes
0 messages received with wrong TTL
0 messages received with bad checksum
0 V1/V2 membership queries received
0 V3 membership queries received
0 membership queries received with invalid field(s)
0 general queries received
0 group queries received
0 group-source queries received
0 group-source queries dropped
0 membership reports received
0 membership reports received with invalid field(s)
0 membership reports received for groups to which we belong
0 V3 reports received without Router Alert
0 membership reports sent
arp:
2 ARP requests sent
0 ARP replies sent
0 ARP requests received
1 ARP reply received
1 ARP packet received
0 total packets dropped due to no ARP entry
0 ARP entrys timed out
0 Duplicate IPs seen
ip6:
0 total packets received
0 with size smaller than minimum
0 with data size < data length
0 with bad options
0 with incorrect version number
0 fragments received
0 fragments dropped (dup or out of space)
0 fragments dropped after timeout
0 fragments that exceeded limit
0 packets reassembled ok
0 packets for this host
0 packets forwarded
0 packets not forwardable
0 redirects sent
0 packets sent from this host
0 packets sent with fabricated ip header
0 output packets dropped due to no bufs, etc.
0 output packets discarded due to no route
0 output datagrams fragmented
0 fragments created
0 datagrams that can't be fragmented
0 packets that violated scope rules
0 multicast packets which we don't join
Mbuf statistics:
0 one mbuf
0 one ext mbuf
0 two or more ext mbuf
0 packets whose headers are not contiguous
0 tunneling packets that can't find gif
0 packets discarded because of too many headers
0 failures of source address selection
Source addresses selection rule applied:
icmp6:
0 calls to icmp6_error
0 errors not generated in response to an icmp6 message
0 errors not generated because of rate limitation
0 messages with bad code fields
0 messages < minimum length
0 bad checksums
0 messages with bad length
Histogram of error messages to be generated:
0 no route
0 administratively prohibited
0 beyond scope
0 address unreachable
0 port unreachable
0 packet too big
0 time exceed transit
0 time exceed reassembly
0 erroneous header field
0 unrecognized next header
0 unrecognized option
0 redirect
0 unknown
0 message responses generated
0 messages with too many ND options
0 messages with bad ND options
0 bad neighbor solicitation messages
0 bad neighbor advertisement messages
0 bad router solicitation messages
0 bad router advertisement messages
0 bad redirect messages
0 path MTU changes
rip6:
0 messages received
0 checksum calculations on inbound
0 messages with bad checksum
0 messages dropped due to no socket
0 multicast messages dropped due to no socket
0 messages dropped due to full socket buffers
0 delivered
0 datagrams output
------------------------------------------------------------------------
netstat -m
257/281/538 mbufs in use (current/cache/total)
243/147/390/16832 mbuf clusters in use (current/cache/total/max)
256/141 mbuf+clusters out of packet secondary zone in use (current/cache)
0/0/0/8416 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/12624 9k jumbo clusters in use (current/cache/total/max)
0/0/0/8416 16k jumbo clusters in use (current/cache/total/max)
550K/364K/914K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0 requests for sfbufs denied
0 requests for sfbufs delayed
0 requests for I/O initiated by sendfile
0 calls to protocol drain routines
------------------------------------------------------------------------
netstat -id
Name Mtu Network Address Ipkts Ierrs Idrop Opkts
Oerrs Coll Drop
em0 1500 <Link#1> 08:00:27:ad:dc:7f 15 0 0 16
0 0 0
em0 1500 10.0.2.0 10.0.2.15 13 - - 13
- - -
usbus 0 <Link#2> 0 0 0 0 0
0 0
lo0 16384 <Link#3> 0 0 0 0 0
0 0
lo0 16384 localhost ::1 0 - - 0 -
- -
lo0 16384 fe80::1%lo0 fe80::1 0 - - 0 -
- -
lo0 16384 your-net localhost 0 - - 0 -
- -
------------------------------------------------------------------------
netstat -anr
Routing tables
Internet:
Destination Gateway Flags Refs Use Netif Expire
default 10.0.2.2 UGS 0 13 em0
10.0.2.0/24 link#1 U 0 0 em0
10.0.2.15 link#1 UHS 0 0 lo0
127.0.0.1 link#3 UH 0 0 lo0
Internet6:
Destination Gateway Flags
Netif Expire
::/96 ::1 UGRS lo0
::1 ::1 UH lo0
::ffff:0.0.0.0/96 ::1 UGRS lo0
fe80::/10 ::1 UGRS lo0
fe80::%lo0/64 link#3 U lo0
fe80::1%lo0 link#3 UHS lo0
ff01::%lo0/32 ::1 U lo0
ff02::/16 ::1 UGRS lo0
ff02::%lo0/32 ::1 U lo0
------------------------------------------------------------------------
netstat -anA
Active Internet connections (including servers)
Tcpcb Proto Recv-Q Send-Q Local Address Foreign Address (state)
c3bb0ac0 tcp4 0 0 127.0.0.1.25 *.* LISTEN
c3a811f8 udp4 0 0 *.514 *.*
c3a81000 udp6 0 0 *.514 *.*
Active UNIX domain sockets
Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr
c3b38e1c stream 0 0 c3a7ecc0 0 0 0
/var/run/devd.pipe
c3b382b0 dgram 0 0 0 c3b38000 0 c3b38158
c3b38204 dgram 0 0 0 c3b380ac 0 0
c3b38158 dgram 0 0 0 c3b38000 0 0
c3b38000 dgram 0 0 c3ba6550 0 c3b382b0 0
/var/run/logpriv
c3b380ac dgram 0 0 c3ba6660 0 c3b38204 0
/var/run/log
------------------------------------------------------------------------
netstat -aL
Current listen queue sizes (qlen/incqlen/maxqlen)
Proto Listen Local Address
tcp4 0/0/10 localhost.smtp
unix 0/0/4 /var/run/devd.pipe
------------------------------------------------------------------------
fstat
USER CMD PID FD MOUNT INUM MODE SZ|DV R/W
root sh 21860 root / 2 drwxr-xr-x 512 r
root sh 21860 wd /usr/src 8686 ?-----S--- 3274606368 r
root sh 21860 text / 496962 -r-xr-xr-x 119900 r
root sh 21860 ctty /dev 42 crw------- ttyv1 rw
root sh 21860 0 /dev 42 crw------- ttyv1 rw
root sh 21860 1 /dev 42 crw------- ttyv1 rw
root sh 21860 2 /dev 42 crw------- ttyv1 rw
root make 21858 root / 2 drwxr-xr-x 512 r
root make 21858 wd /usr/obj 3436 ?-----S--- 0 r
root make 21858 text / 496969 -r-xr-xr-x 383448 r
root make 21858 ctty /dev 42 crw------- ttyv1 rw
root make 21858 0 /dev 42 crw------- ttyv1 rw
root make 21858 1 /dev 42 crw------- ttyv1 rw
root make 21858 2 /dev 42 crw------- ttyv1 rw
root sh 1715 root / 2 drwxr-xr-x 512 r
root sh 1715 wd /usr/src 40 ?--S------ 3278985312 r
root sh 1715 text / 496962 -r-xr-xr-x 119900 r
root sh 1715 ctty /dev 42 crw------- ttyv1 rw
root sh 1715 0 /dev 42 crw------- ttyv1 rw
root sh 1715 1 /dev 42 crw------- ttyv1 rw
root sh 1715 2 /dev 42 crw------- ttyv1 rw
root make 1700 root / 2 drwxr-xr-x 512 r
root make 1700 wd /usr/obj 6 ?-----S--- 3274606368 r
root make 1700 text / 496969 -r-xr-xr-x 383448 r
root make 1700 ctty /dev 42 crw------- ttyv1 rw
root make 1700 0 /dev 42 crw------- ttyv1 rw
root make 1700 1 /dev 42 crw------- ttyv1 rw
root make 1700 2 /dev 42 crw------- ttyv1 rw
root make 1692 root / 2 drwxr-xr-x 512 r
root make 1692 wd /usr/obj 6 ?-----S--- 3274606368 r
root make 1692 text / 496969 -r-xr-xr-x 383448 r
root make 1692 ctty /dev 42 crw------- ttyv1 rw
root make 1692 0 /dev 42 crw------- ttyv1 rw
root make 1692 1 /dev 42 crw------- ttyv1 rw
root make 1692 2 /dev 42 crw------- ttyv1 rw
root sh 1691 root / 2 drwxr-xr-x 512 r
root sh 1691 wd /usr/src 3 ?--S--S--- 3282391840 r
root sh 1691 text / 353311 -r-xr-xr-x 119900 r
root sh 1691 ctty /dev 42 crw------- ttyv1 rw
root sh 1691 0 /dev 42 crw------- ttyv1 rw
root sh 1691 1 /dev 42 crw------- ttyv1 rw
root sh 1691 2 /dev 42 crw------- ttyv1 rw
root make 1564 root / 2 drwxr-xr-x 512 r
root make 1564 wd /usr/obj 6 ?-----S--- 3274606368 r
root make 1564 text / 427792 -r-xr-xr-x 383448 r
root make 1564 ctty /dev 42 crw------- ttyv1 rw
root make 1564 0 /dev 42 crw------- ttyv1 rw
root make 1564 1 /dev 42 crw------- ttyv1 rw
root make 1564 2 /dev 42 crw------- ttyv1 rw
root make 1560 root / 2 drwxr-xr-x 512 r
root make 1560 wd /usr/obj 6 ?-----S--- 3274606368 r
root make 1560 text / 427792 -r-xr-xr-x 383448 r
root make 1560 ctty /dev 42 crw------- ttyv1 rw
root make 1560 0 /dev 42 crw------- ttyv1 rw
root make 1560 1 /dev 42 crw------- ttyv1 rw
root make 1560 2 /dev 42 crw------- ttyv1 rw
root make 1558 root / 2 drwxr-xr-x 512 r
root make 1558 wd /usr/obj 54033 ?-----S--- 0 r
root make 1558 text / 427792 -r-xr-xr-x 383448 r
root make 1558 ctty /dev 42 crw------- ttyv1 rw
root make 1558 0 /dev 42 crw------- ttyv1 rw
root make 1558 1 /dev 42 crw------- ttyv1 rw
root make 1558 2 /dev 42 crw------- ttyv1 rw
root make 1555 root / 2 drwxr-xr-x 512 r
root make 1555 wd /usr/obj 54033 ?-----S--- 0 r
root make 1555 text / 427792 -r-xr-xr-x 383448 r
root make 1555 ctty /dev 42 crw------- ttyv1 rw
root make 1555 0 /dev 42 crw------- ttyv1 rw
root make 1555 1 /dev 42 crw------- ttyv1 rw
root make 1555 2 /dev 42 crw------- ttyv1 rw
root csh 1031 root / 2 drwxr-xr-x 512 r
root csh 1031 wd /usr/src 10335 ?-----S--- 3274606368 r
root csh 1031 text / 353313 -r-xr-xr-x 328084 r
root csh 1031 ctty /dev 42 crw------- ttyv1 rw
root csh 1031 15 /dev 42 crw------- ttyv1 rw
root csh 1031 16 /dev 42 crw------- ttyv1 rw
root csh 1031 17 /dev 42 crw------- ttyv1 rw
root csh 1031 18 /dev 42 crw------- ttyv1 rw
root csh 1031 19 /dev 42 crw------- ttyv1 rw
root getty 1030 root / 2 drwxr-xr-x 512 r
root getty 1030 wd / 2 drwxr-xr-x 512 r
root getty 1030 text / 428113 -r-xr-xr-x 22368 r
root getty 1030 ctty /dev 48 crw------- ttyv7 rw
root getty 1030 0 /dev 48 crw------- ttyv7 rw
root getty 1030 1 /dev 48 crw------- ttyv7 rw
root getty 1030 2 /dev 48 crw------- ttyv7 rw
root getty 1029 root / 2 drwxr-xr-x 512 r
root getty 1029 wd / 2 drwxr-xr-x 512 r
root getty 1029 text / 428113 -r-xr-xr-x 22368 r
root getty 1029 ctty /dev 47 crw------- ttyv6 rw
root getty 1029 0 /dev 47 crw------- ttyv6 rw
root getty 1029 1 /dev 47 crw------- ttyv6 rw
root getty 1029 2 /dev 47 crw------- ttyv6 rw
root getty 1028 root / 2 drwxr-xr-x 512 r
root getty 1028 wd / 2 drwxr-xr-x 512 r
root getty 1028 text / 428113 -r-xr-xr-x 22368 r
root getty 1028 ctty /dev 46 crw------- ttyv5 rw
root getty 1028 0 /dev 46 crw------- ttyv5 rw
root getty 1028 1 /dev 46 crw------- ttyv5 rw
root getty 1028 2 /dev 46 crw------- ttyv5 rw
root getty 1027 root / 2 drwxr-xr-x 512 r
root getty 1027 wd / 2 drwxr-xr-x 512 r
root getty 1027 text / 428113 -r-xr-xr-x 22368 r
root getty 1027 ctty /dev 45 crw------- ttyv4 rw
root getty 1027 0 /dev 45 crw------- ttyv4 rw
root getty 1027 1 /dev 45 crw------- ttyv4 rw
root getty 1027 2 /dev 45 crw------- ttyv4 rw
root getty 1026 root / 2 drwxr-xr-x 512 r
root getty 1026 wd / 2 drwxr-xr-x 512 r
root getty 1026 text / 428113 -r-xr-xr-x 22368 r
root getty 1026 ctty /dev 44 crw------- ttyv3 rw
root getty 1026 0 /dev 44 crw------- ttyv3 rw
root getty 1026 1 /dev 44 crw------- ttyv3 rw
root getty 1026 2 /dev 44 crw------- ttyv3 rw
root getty 1025 root / 2 drwxr-xr-x 512 r
root getty 1025 wd / 2 drwxr-xr-x 512 r
root getty 1025 text / 428113 -r-xr-xr-x 22368 r
root getty 1025 ctty /dev 43 crw------- ttyv2 rw
root getty 1025 0 /dev 43 crw------- ttyv2 rw
root getty 1025 1 /dev 43 crw------- ttyv2 rw
root getty 1025 2 /dev 43 crw------- ttyv2 rw
root login 1024 root / 2 drwxr-xr-x 512 r
root login 1024 wd / 471040 drwxr-xr-x 512 r
root login 1024 text / 427782 -r-sr-xr-x 21576 r
root login 1024 ctty /dev 42 crw------- ttyv1 rw
root login 1024 0 /dev 42 crw------- ttyv1 rw
root login 1024 1 /dev 42 crw------- ttyv1 rw
root login 1024 2 /dev 42 crw------- ttyv1 rw
root login 1024 3* local dgram c3b382b0 <-> c3b38000
root getty 1023 root / 2 drwxr-xr-x 512 r
root getty 1023 wd / 2 drwxr-xr-x 512 r
root getty 1023 text / 428113 -r-xr-xr-x 22368 r
root getty 1023 ctty /dev 41 crw------- ttyv0 rw
root getty 1023 0 /dev 41 crw------- ttyv0 rw
root getty 1023 1 /dev 41 crw------- ttyv0 rw
root getty 1023 2 /dev 41 crw------- ttyv0 rw
root cron 965 root / 2 drwxr-xr-x 512 r
root cron 965 wd /var 447488 drwxr-x--- 512 r
root cron 965 text / 427919 -r-xr-xr-x 34512 r
root cron 965 0 /dev 33 crw-rw-rw- null rw
root cron 965 1 /dev 33 crw-rw-rw- null rw
root cron 965 2 /dev 33 crw-rw-rw- null rw
root cron 965 3 /var 588827 -rw------- 3 w
smmsp sendmail 959 root / 2 drwxr-xr-x 512 r
smmsp sendmail 959 wd /var 894982 drwxrwx--- 512 r
smmsp sendmail 959 text / 426949 -r-xr-sr-x 699120 r
smmsp sendmail 959 0 /dev 33 crw-rw-rw- null r
smmsp sendmail 959 1 /dev 33 crw-rw-rw- null w
smmsp sendmail 959 2 /dev 33 crw-rw-rw- null w
smmsp sendmail 959 3* local dgram c3b38204 <-> c3b380ac
smmsp sendmail 959 4 /var 894984 -rw------- 49 w
root sendmail 955 root / 2 drwxr-xr-x 512 r
root sendmail 955 wd /var 894979 drwxr-xr-x 512 r
root sendmail 955 text / 426949 -r-xr-sr-x 699120 r
root sendmail 955 0 /dev 33 crw-rw-rw- null r
root sendmail 955 1 /dev 33 crw-rw-rw- null w
root sendmail 955 2 /dev 33 crw-rw-rw- null w
root sendmail 955 3* internet stream tcp c3bb0ac0
root sendmail 955 4* local dgram c3b38158 <-> c3b38000
root sendmail 955 5 /var 588826 -rw------- 78 w
root syslogd 709 root / 2 drwxr-xr-x 512 r
root syslogd 709 wd / 2 drwxr-xr-x 512 r
root syslogd 709 text / 427931 -r-xr-xr-x 36204 r
root syslogd 709 0 /dev 33 crw-rw-rw- null rw
root syslogd 709 1 /dev 33 crw-rw-rw- null rw
root syslogd 709 2 /dev 33 crw-rw-rw- null rw
root syslogd 709 3 /var 588821 -rw------- 3 w
root syslogd 709 4* local dgram c3b380ac
root syslogd 709 5* local dgram c3b38000
root syslogd 709 6* internet6 dgram udp c3a81000
root syslogd 709 7* internet dgram udp c3a811f8
root syslogd 709 8 /dev 13 crw------- klog r
root syslogd 709 10 - - bad -
root syslogd 709 11 /var 683024 -rw-r--r-- 73851 w
root syslogd 709 12 /var 683019 -rw------- 62 w
root syslogd 709 13 /var 683012 -rw------- 4128 w
root syslogd 709 14 /var 683033 -rw-r----- 3485 w
root syslogd 709 15 /var 683015 -rw-r--r-- 62 w
root syslogd 709 16 /var 683020 -rw------- 62 w
root syslogd 709 17 /var 683013 -rw------- 47046 w
root syslogd 709 18 /var 683014 -rw------- 62 w
root syslogd 709 19 /var 683018 -rw-r----- 62 w
root devd 569 root / 2 drwxr-xr-x 512 r
root devd 569 wd / 2 drwxr-xr-x 512 r
root devd 569 text / 282720 -r-xr-xr-x 382500 r
root devd 569 0 /dev 33 crw-rw-rw- null rw
root devd 569 1 /dev 33 crw-rw-rw- null rw
root devd 569 2 /dev 33 crw-rw-rw- null rw
root devd 569 3 /dev 6 crw------- devctl r
root devd 569 4* local stream c3b38e1c
root devd 569 5 /var 588812 -rw------- 3 w
_dhcp dhclient 554 root /var 117760 dr-xr-xr-x 512 r
_dhcp dhclient 554 wd /var 117760 dr-xr-xr-x 512 r
_dhcp dhclient 554 jail /var 117760 dr-xr-xr-x 512 r
_dhcp dhclient 554 text / 282721 -r-xr-xr-x 78796 r
_dhcp dhclient 554 0 /dev 33 crw-rw-rw- null rw
_dhcp dhclient 554 1 /dev 33 crw-rw-rw- null rw
_dhcp dhclient 554 2 /dev 33 crw-rw-rw- null rw
_dhcp dhclient 554 4* route raw 0 c3a7f680
_dhcp dhclient 554 5* pipe c344b0bc <-> c344b000 0 rw
_dhcp dhclient 554 6 /var 1012746 ---------- 838 w
_dhcp dhclient 554 7 /dev 16 crw------- bpf rw
_dhcp dhclient 554 8* internet raw ip c3b42000
root dhclient 499 root / 2 drwxr-xr-x 512 r
root dhclient 499 wd / 2 drwxr-xr-x 512 r
root dhclient 499 text / 282721 -r-xr-xr-x 78796 r
root dhclient 499 0 /dev 33 crw-rw-rw- null rw
root dhclient 499 1 /dev 33 crw-rw-rw- null rw
root dhclient 499 2 /dev 33 crw-rw-rw- null rw
root dhclient 499 4* pipe c344b000 <-> c344b0bc 0 rw
root zfskern 34 root / 2 drwxr-xr-x 512 r
root zfskern 34 wd / 2 drwxr-xr-x 512 r
root init 1 root / 2 drwxr-xr-x 512 r
root init 1 wd / 2 drwxr-xr-x 512 r
root init 1 text / 282662 -r-xr-xr-x 712236 r
root kernel 0 root / 2 drwxr-xr-x 512 r
root kernel 0 wd / 2 drwxr-xr-x 512 r
------------------------------------------------------------------------
dmesg
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.0-PRERELEASE #0 r227727: Sat Nov 19 07:52:17 UTC 2011
root at zfstest:/usr/obj/usr/src/sys/GENERIC i386
CPU: Intel(R) Core(TM)2 Duo CPU T9300 @ 2.50GHz (2396.50-MHz
686-class CPU)
Origin = "GenuineIntel" Id = 0x10676 Family = 6 Model = 17
Stepping = 6
Features=0x783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2>
Features2=0x209<SSE3,MON,SSSE3>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
real memory = 536805376 (511 MB)
avail memory = 505782272 (482 MB)
pnpbios: Bad PnP BIOS data checksum
kbd1 at kbdmux0
acpi0: <VBOX VBOXXSDT> on motherboard
acpi0: Power Button (fixed)
acpi0: Sleep Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci_link2: BIOS IRQ 9 for 0.7.INTA does not match previous BIOS IRQ 10
pci0: <ACPI PCI bus> on pcib0
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
vgapci0: <VGA-compatible display> mem 0xe0000000-0xe0ffffff irq 11 at
device 2.0 on pci0
em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port
0xd010-0xd017 mem 0xf0000000-0xf001ffff irq 10 at device 3.0 on pci0
em0: Ethernet address: 08:00:27:ad:dc:7f
pci0: <base peripheral> at device 4.0 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xf0804000-0xf0804fff irq 11
at device 6.0 on pci0
usbus0: <OHCI (generic) USB controller> on ohci0
pci0: <bridge> at device 7.0 (no driver attached)
ahci0: <Intel ICH8M AHCI SATA controller> port
0xd040-0xd047,0xd050-0xd057,0xd060-0xd06f mem 0xf0806000-0xf0807fff irq
5 at device 13.0 on pci0
ahci0: AHCI v1.10 with 1 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
battery0: <ACPI Control Method Battery> on acpi0
acpi_acad0: <AC Adapter> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
pmtimer0 on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
Event timer "RTC" frequency 32768 Hz quality 0
ppc0: parallel port not found.
Timecounters tick every 10.000 msec
usbus0: 12Mbps Full Speed USB v1.0
ugen0.1: <Apple> at usbus0
uhub0: <Apple OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ada0 at ata0 bus 0 scbus0 target 0 lun 0
ada0: <VBOX HARDDISK 1.0> ATA-6 device
ada0: 33.300MB/s transfers (UDMA2, PIO 65536bytes)
ada0: 20480MB (41943040 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad0
ada1 at ahcich0 bus 0 scbus2 target 0 lun 0
ada1: <VBOX HARDDISK 1.0> ATA-6 SATA 2.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 20480MB (41943040 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad4
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0: <VBOX CD-ROM 1.0> Removable CD-ROM SCSI-0 device
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
Timecounter "TSC" frequency 2396495148 Hz quality 800
Root mount waiting for: usbus0
uhub0: 8 ports with 8 removable, self powered
Trying to mount root from ufs:/dev/ad0s1a [rw]...
Setting hostuuid: f36c009e-da3a-4d14-9e92-206d812d3316.
Setting hostid: 0x67533753.
ZFS NOTICE: Prefetch is disabled by default on i386 -- to enable,
add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable
behavior.
Consider tuning vm.kmem_size and vm.kmem_size_max
in /boot/loader.conf.
ZFS filesystem version 5
ZFS storage pool version 28
Entropy harvesting: interrupts ethernet point_to_point kickstart.
Starting file system checks:
/dev/ad0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1a: clean, 1692667 free (3747 frags, 211115 blocks, 0.2%
fragmentation)
/dev/ad0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1e: clean, 3044989 free (21 frags, 380621 blocks, 0.0%
fragmentation)
/dev/ad0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad0s1d: clean, 3891432 free (440 frags, 486374 blocks, 0.0%
fragmentation)
Mounting local file systems:.
Setting hostname: zfstest.
Starting Network: lo0 em0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=3<RXCSUM,TXCSUM>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=9b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM>
ether 08:00:27:ad:dc:7f
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
Starting devd.
Starting Network: usbus0.
DHCPREQUEST on em0 to 255.255.255.255 port 67
DHCPACK from 10.0.2.2
bound to 10.0.2.15 -- renewal in 43200 seconds.
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
add net fe80::: gateway ::1
add net ff02::: gateway ::1
Generating host.conf.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout
Creating and/or trimming log files.
Starting syslogd.
No core dumps found.
Clearing /tmp (X related).
Updating motd:.
Configuring syscons: keymap blanktime.
Starting cron.
Starting background file system checks in 60 seconds.
Sat Nov 19 10:39:48 UTC 2011
Nov 19 10:39:52 zfstest login: ROOT LOGIN (root) ON ttyv1
ahcich0: Timeout on slot 20 port 0
ahcich0: is 00000000 cs 00000000 ss 00200000 rs 00300000 tfd 50 serr
00000000 cmd 1000d517
(ada1:ahcich0:0:0:0): lost device
panic: make_dev_credv: bad si_name (error=17, si_name=pass2)
cpuid = 0
KDB: stack backtrace:
#0 0xc0a4aff7 at kdb_backtrace+0x47
#1 0xc0a185c7 at panic+0x117
#2 0xc09d05de at make_dev_credv+0x9e
#3 0xc09d080a at make_dev+0x4a
#4 0xc04b79e0 at passregister+0x230
#5 0xc048ece3 at cam_periph_alloc+0x4e3
#6 0xc04b7525 at passasync+0x85
#7 0xc0490442 at xpt_async_bcast+0x32
#8 0xc0492715 at xpt_async+0x105
#9 0xc04991f3 at probedone+0xc33
#10 0xc04958a1 at camisr_runqueue+0x2e1
#11 0xc04959ff at camisr+0x13f
#12 0xc09ed69b at intr_event_execute_handlers+0x13b
#13 0xc09eee5a at ithread_loop+0x7a
#14 0xc09ea8a7 at fork_exit+0x97
#15 0xc0d32734 at fork_trampoline+0x8
Uptime: 7m57s
(ada1:ahcich0:0:0:0): Synchronize cache failed
Physical memory: 495 MB
Dumping 409 MB: 394 378 362 346 330 314 298 282 266 250 234 218 202 186
170 154 138 122 106 90 74 58 42 26 10
------------------------------------------------------------------------
kernel config
options CONFIG_AUTOGENERATED
ident GENERIC
machine i386
cpu I686_CPU
cpu I586_CPU
cpu I486_CPU
makeoptions DEBUG=-g
options USB_DEBUG
options AH_SUPPORT_AR5416
options IEEE80211_SUPPORT_MESH
options IEEE80211_AMPDU_AGE
options IEEE80211_DEBUG
options SC_PIXEL_MODE
options AHD_REG_PRETTY_PRINT
options AHC_REG_PRETTY_PRINT
options ATA_STATIC_ID
options ATA_CAM
options SMP
options KDB_TRACE
options KDB
options INCLUDE_CONFIG_FILE
options MAC
options AUDIT
options HWPMC_HOOKS
options KBD_INSTALL_CDEV
options PRINTF_BUFR_SIZE=128
options _KPOSIX_PRIORITY_SCHEDULING
options SYSVSEM
options SYSVMSG
options SYSVSHM
options STACK
options KTRACE
options SCSI_DELAY=5000
options COMPAT_FREEBSD7
options COMPAT_FREEBSD6
options COMPAT_FREEBSD5
options COMPAT_FREEBSD4
options GEOM_LABEL
options GEOM_PART_GPT
options PSEUDOFS
options PROCFS
options CD9660
options MSDOSFS
options NFS_ROOT
options NFSLOCKD
options NFSD
options NFSCL
options MD_ROOT
options UFS_GJOURNAL
options UFS_DIRHASH
options UFS_ACL
options SOFTUPDATES
options FFS
options SCTP
options INET6
options INET
options PREEMPTION
options SCHED_ULE
options NEW_PCIB
options NATIVE
options GEOM_PART_MBR
options GEOM_PART_EBR_COMPAT
options GEOM_PART_EBR
options GEOM_PART_BSD
options ISAPNP
device isa
device npx
device mem
device io
device uart_ns8250
device atpic
device apic
device cpufreq
device acpi
device eisa
device pci
device fdc
device ahci
device ata
device mvs
device siis
device ahb
device ahc
device ahd
device esp
device hptiop
device isp
device mpt
device sym
device trm
device adv
device adw
device aha
device aic
device bt
device ncv
device nsp
device stg
device scbus
device ch
device da
device sa
device cd
device pass
device ses
device amr
device arcmsr
device asr
device ciss
device dpt
device hptmv
device hptrr
device iir
device ips
device mly
device twa
device tws
device aac
device aacp
device ida
device mfi
device mlx
device pst
device twe
device atkbdc
device atkbd
device psm
device kbdmux
device vga
device splash
device sc
device agp
device pmtimer
device cbb
device pccard
device cardbus
device uart
device ppc
device ppbus
device lpt
device plip
device ppi
device puc
device bxe
device de
device em
device igb
device ixgb
device le
device ti
device txp
device vx
device miibus
device ae
device age
device alc
device ale
device bce
device bfe
device bge
device dc
device et
device fxp
device jme
device lge
device msk
device nfe
device nge
device pcn
device re
device rl
device sf
device sge
device sis
device sk
device ste
device stge
device tl
device tx
device vge
device vr
device vte
device wb
device xl
device cs
device ed
device ex
device ep
device fe
device ie
device sn
device xe
device wlan
device wlan_wep
device wlan_ccmp
device wlan_tkip
device wlan_amrr
device an
device ath
device ath_pci
device ath_hal
device ath_rate_sample
device ipw
device iwi
device iwn
device malo
device mwl
device ral
device wi
device wpi
device loop
device random
device ether
device vlan
device tun
device pty
device md
device gif
device faith
device firmware
device bpf
device uhci
device ohci
device ehci
device xhci
device usb
device uhid
device ukbd
device ulpt
device umass
device ums
device urio
device u3g
device uark
device ubsa
device uftdi
device uipaq
device uplcom
device uslcom
device uvisor
device uvscom
device aue
device axe
device cdce
device cue
device kue
device rue
device udav
device rum
device run
device uath
device upgt
device ural
device urtw
device zyd
device firewire
device fwe
device fwip
device dcons
device dcons_crom
device sound
device snd_es137x
device snd_hda
device snd_ich
device snd_uaudio
device snd_via8233
------------------------------------------------------------------------
ddb capture buffer
ddb: ddb_capture: kvm_nlist
More information about the freebsd-stable
mailing list