zfs dead lock

Kuang-che Wu kuangche at gmail.com
Thu Aug 15 18:36:09 UTC 2013


I suspect I encountered zfs deadlock yesterday.(According to
https://wiki.freebsd.org/AvgZfsDeadlockDebug)
Following is the report.

I have two zpool -- one is named zroot and the other is zdata. They are
both raidz2 on same set of 6 disks.
While zroot works well, any processes hang if they touch zdata.
And those processes hang forever (at least more than half hours).

Before zdata hang, there are about 10 processes busy read/write to zdata.
Their read/write patterns are linear read/write lots of large files.
(download hundred MB files and calculate checksum)
Average zpool write speed about 10MB/s.

In output of procstat, I found 8 processes have zio_wait + zio_done in
stacks and this is very
likely a ZFS deadlock according to the wiki page.


System: FreeBSD kcwu.csie.org 10.0-CURRENT FreeBSD 10.0-CURRENT #5 b37d7ce:
Tue Jul 30 21:25:46 CST 2013 root at kcwu.csie.org:/usr/obj/usr/src/sys/DESKTOP
amd64



procstat log and boot dmesg are attached.

Please let me know if you need more information.

Thanks
-------------- next part --------------
  PID    TID COMM             TDNAME           KSTACK                       
    0 100000 kernel           swapper          mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 swapper+0x278 btext+0x2c 
    0 100016 kernel           firmware taskq   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100018 kernel           kqueue taskq     mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100020 kernel           ffs_trim taskq   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100021 kernel           acpi_task_0      mi_switch+0xde sleepq_wait+0x3a msleep_spin_sbt+0x19a taskqueue_thread_loop+0xfd fork_exit+0x9a fork_trampoline+0xe 
    0 100022 kernel           acpi_task_1      mi_switch+0xde sleepq_wait+0x3a msleep_spin_sbt+0x19a taskqueue_thread_loop+0xfd fork_exit+0x9a fork_trampoline+0xe 
    0 100023 kernel           acpi_task_2      mi_switch+0xde sleepq_wait+0x3a msleep_spin_sbt+0x19a taskqueue_thread_loop+0xfd fork_exit+0x9a fork_trampoline+0xe 
    0 100026 kernel           thread taskq     mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100070 kernel           mca taskq        mi_switch+0xde sleepq_wait+0x3a msleep_spin_sbt+0x19a taskqueue_thread_loop+0xfd fork_exit+0x9a fork_trampoline+0xe 
    0 100071 kernel           system_taskq_0   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100072 kernel           system_taskq_1   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100073 kernel           system_taskq_2   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100074 kernel           system_taskq_3   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100233 kernel           zio_null_issue   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100234 kernel           zio_null_intr    mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100235 kernel           zio_read_issue_0 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100236 kernel           zio_read_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100237 kernel           zio_read_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100238 kernel           zio_read_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100239 kernel           zio_read_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100240 kernel           zio_read_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100241 kernel           zio_read_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100242 kernel           zio_read_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100243 kernel           zio_read_intr_0  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100244 kernel           zio_read_intr_1  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100245 kernel           zio_read_intr_2  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100246 kernel           zio_read_intr_3  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100247 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100248 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100249 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100250 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100251 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100252 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100253 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100254 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100255 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100256 kernel           zio_write_intr_0 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100257 kernel           zio_write_intr_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100258 kernel           zio_write_intr_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100259 kernel           zio_write_intr_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100260 kernel           zio_write_intr_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100261 kernel           zio_write_intr_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100262 kernel           zio_write_intr_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100263 kernel           zio_write_intr_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100264 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100265 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100266 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100267 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100268 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100269 kernel           zio_free_issue_0 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100270 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100271 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100272 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100273 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100274 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100275 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100276 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100277 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100278 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100279 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100280 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100281 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100282 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100283 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100284 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100285 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100286 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100287 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100288 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100289 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100290 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100291 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100292 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100293 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100294 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100295 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100296 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100297 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100298 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100299 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100300 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100301 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100302 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100303 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100304 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100305 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100306 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100307 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100308 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100309 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100310 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100311 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100312 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100313 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100314 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100315 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100316 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100317 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100318 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100319 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100320 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100321 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100322 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100323 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100324 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100325 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100326 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100327 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100328 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100329 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100330 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100331 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100332 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100333 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100334 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100335 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100336 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100337 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100338 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100339 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100340 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100341 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100342 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100343 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100344 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100345 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100346 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100347 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100348 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100349 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100350 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100351 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100352 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100353 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100354 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100355 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100356 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100357 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100358 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100359 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100360 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100361 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100362 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100363 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100364 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100365 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100366 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100367 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100368 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100369 kernel           zio_free_intr    mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100370 kernel           zio_claim_issue  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100371 kernel           zio_claim_intr   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100372 kernel           zio_ioctl_issue  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100373 kernel           zio_ioctl_intr   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100375 kernel           zfs_vn_rele_task mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100378 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100531 kernel           zio_null_issue   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100532 kernel           zio_null_intr    mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100533 kernel           zio_read_issue_0 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100534 kernel           zio_read_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100535 kernel           zio_read_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100536 kernel           zio_read_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100537 kernel           zio_read_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100538 kernel           zio_read_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100539 kernel           zio_read_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100540 kernel           zio_read_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100541 kernel           zio_read_intr_0  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100542 kernel           zio_read_intr_1  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100543 kernel           zio_read_intr_2  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100544 kernel           zio_read_intr_3  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100545 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100546 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100547 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100548 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100549 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100550 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100551 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100552 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100553 kernel           zio_write_issue_ mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100554 kernel           zio_write_intr_0 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100555 kernel           zio_write_intr_1 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100556 kernel           zio_write_intr_2 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100557 kernel           zio_write_intr_3 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100558 kernel           zio_write_intr_4 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100559 kernel           zio_write_intr_5 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100560 kernel           zio_write_intr_6 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100561 kernel           zio_write_intr_7 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zio_free+0x113 dsl_dataset_block_kill+0xe2 dbuf_write_done+0x65 arc_write_done+0x269 zio_done+0x6fd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 zio_done+0x9bd zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 
    0 100562 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100563 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100564 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100565 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100566 kernel           zio_write_intr_h mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100567 kernel           zio_free_issue_0 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100568 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100569 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100570 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100571 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100572 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100573 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100574 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100575 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100576 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100577 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100578 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100579 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100580 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100581 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100582 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100583 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100584 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100585 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100586 kernel           zio_free_issue_1 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100587 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100588 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100589 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100590 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100591 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100592 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100593 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100594 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100595 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100596 kernel           zio_free_issue_2 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100597 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100598 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100599 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100600 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100601 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100602 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100603 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100604 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100605 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100606 kernel           zio_free_issue_3 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100607 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100608 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100609 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100610 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100611 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100612 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100613 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100614 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100615 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100616 kernel           zio_free_issue_4 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100617 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100618 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100619 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100620 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100621 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100622 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100623 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100624 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100625 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100626 kernel           zio_free_issue_5 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100627 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100628 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100629 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100630 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100631 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100632 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100633 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100634 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100635 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100636 kernel           zio_free_issue_6 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100637 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100638 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100639 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100640 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100641 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100642 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100643 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100644 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100645 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100646 kernel           zio_free_issue_7 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100647 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100648 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100649 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100650 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100651 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100652 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100653 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 taskqueue_run_locked+0xe6 taskqueue_thread_loop+0xa8 fork_exit+0x9a fork_trampoline+0xe 
    0 100654 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100655 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100656 kernel           zio_free_issue_8 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100657 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100658 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100659 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100660 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100661 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100662 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100663 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100664 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100665 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100666 kernel           zio_free_issue_9 mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100667 kernel           zio_free_intr    mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100668 kernel           zio_claim_issue  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100669 kernel           zio_claim_intr   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100670 kernel           zio_ioctl_issue  mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100671 kernel           zio_ioctl_intr   mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100673 kernel           zfs_vn_rele_task mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100677 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100678 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100679 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100680 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100681 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100682 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100683 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100684 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100686 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100687 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100688 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100689 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100690 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100691 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100692 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100693 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100694 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100695 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 100696 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    0 101233 kernel           zil_clean        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a taskqueue_thread_loop+0xd5 fork_exit+0x9a fork_trampoline+0xe 
    1 100002 init             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
    2 100075 zfskern          arc_reclaim_thre mi_switch+0xde sleepq_timedwait+0x3a _cv_timedwait_sbt+0x197 arc_reclaim_thread+0x302 fork_exit+0x9a fork_trampoline+0xe 
    2 100076 zfskern          l2arc_feed_threa mi_switch+0xde sleepq_timedwait+0x3a _cv_timedwait_sbt+0x197 l2arc_feed_thread+0xb19 fork_exit+0x9a fork_trampoline+0xe 
    2 100374 zfskern          trim zroot       mi_switch+0xde sleepq_timedwait+0x3a _cv_timedwait_sbt+0x197 trim_thread+0x9b fork_exit+0x9a fork_trampoline+0xe 
    2 100376 zfskern          txg_thread_enter mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_quiesce_thread+0x30b fork_exit+0x9a fork_trampoline+0xe 
    2 100377 zfskern          txg_thread_enter mi_switch+0xde sleepq_timedwait+0x3a _cv_timedwait_sbt+0x197 txg_sync_thread+0x1dd fork_exit+0x9a fork_trampoline+0xe 
    2 100672 zfskern          trim zdata       mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b trim_thread+0xdc fork_exit+0x9a fork_trampoline+0xe 
    2 100674 zfskern          txg_thread_enter mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_quiesce_thread+0x24b fork_exit+0x9a fork_trampoline+0xe 
    2 100675 zfskern          txg_thread_enter mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b dsl_pool_sync+0xe5 spa_sync+0x52e txg_sync_thread+0x375 fork_exit+0x9a fork_trampoline+0xe 
    2 101331 zfskern          solthread 0xffff mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0xff spa_vdev_state_enter+0x4d spa_async_thread+0x1e6 fork_exit+0x9a fork_trampoline+0xe 
    3 100077 pf purge         -                mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 pf_purge_thread+0x88 fork_exit+0x9a fork_trampoline+0xe 
    4 100079 sctp_iterator    -                mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a sctp_iterator_thread+0x69 fork_exit+0x9a fork_trampoline+0xe 
    5 100081 xpt_thrd         -                mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a xpt_scanner_thread+0x9c fork_exit+0x9a fork_trampoline+0xe 
    6 100082 enc_daemon0      -                mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a enc_daemon+0x129 fork_exit+0x9a fork_trampoline+0xe 
    7 100083 pagedaemon       -                mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 vm_pageout+0x277 fork_exit+0x9a fork_trampoline+0xe 
    8 100084 vmdaemon         -                mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a vm_daemon+0x95 fork_exit+0x9a fork_trampoline+0xe 
    9 100085 pagezero         -                mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 vm_pagezero+0x98 fork_exit+0x9a fork_trampoline+0xe 
   10 100001 audit            -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 audit_worker+0x83 fork_exit+0x9a fork_trampoline+0xe 
   11 100003 idle             idle: cpu0       <running>                    
   11 100004 idle             idle: cpu1       <running>                    
   11 100005 idle             idle: cpu2       mi_switch+0xde sched_idletd+0x3bd fork_exit+0x9a fork_trampoline+0xe 
   11 100006 idle             idle: cpu3       <running>                    
   12 100007 intr             swi3: vm                                      
   12 100008 intr             swi4: clock      mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100009 intr             swi4: clock                                   
   12 100010 intr             swi4: clock                                   
   12 100011 intr             swi4: clock                                   
   12 100012 intr             swi1: netisr 0   mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100019 intr             swi2: cambio     mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100024 intr             swi6: task queue mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100025 intr             swi6: Giant task mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100027 intr             swi5: fast taskq mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100028 intr             irq264: ahci0    mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100029 intr             irq16: uhci0+    mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100034 intr             irq21: uhci1     mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100039 intr             irq18: re1 uhci2 mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100048 intr             irq265: hdac0    mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100049 intr             irq266: re0      mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100050 intr             irq23: uhci3 ehc                              
   12 100055 intr             irq19: uhci4                                  
   12 100068 intr             irq267: ahci1    mi_switch+0xde ithread_loop+0x193 fork_exit+0x9a fork_trampoline+0xe 
   12 100069 intr             irq1: atkbd0                                  
   12 100078 intr             swi1: pf send                                 
   12 100080 intr             swi1: pfsync                                  
   13 100013 geom             g_event          mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a g_run_events+0x4d fork_exit+0x9a fork_trampoline+0xe 
   13 100014 geom             g_up             mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a g_io_schedule_up+0xbc g_up_procbody+0x6d fork_exit+0x9a fork_trampoline+0xe 
   13 100015 geom             g_down           mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a g_io_schedule_down+0x4c g_down_procbody+0x6d fork_exit+0x9a fork_trampoline+0xe 
   14 100017 yarrow           -                mi_switch+0xde sleepq_timedwait+0x3a msleep_spin_sbt+0x188 random_kthread+0x36e fork_exit+0x9a fork_trampoline+0xe 
   15 100030 usb              usbus0           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100031 usb              usbus0           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100032 usb              usbus0           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100033 usb              usbus0           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100035 usb              usbus1           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100036 usb              usbus1           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100037 usb              usbus1           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100038 usb              usbus1           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100040 usb              usbus2           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100041 usb              usbus2           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100042 usb              usbus2           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100043 usb              usbus2           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100044 usb              usbus3           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100045 usb              usbus3           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100046 usb              usbus3           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100047 usb              usbus3           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100051 usb              usbus4           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100052 usb              usbus4           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100053 usb              usbus4           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100054 usb              usbus4           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100056 usb              usbus5           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100057 usb              usbus5           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100058 usb              usbus5           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100059 usb              usbus5           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100060 usb              usbus6           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100061 usb              usbus6           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100062 usb              usbus6           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100063 usb              usbus6           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100064 usb              usbus7           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100065 usb              usbus7           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100066 usb              usbus7           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   15 100067 usb              usbus7           mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 usb_process+0xe0 fork_exit+0x9a fork_trampoline+0xe 
   16 100086 bufdaemon        -                mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 buf_daemon+0x88 fork_exit+0x9a fork_trampoline+0xe 
   17 100087 syncer           -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zil_commit+0x734 zfs_sync+0xa8 sync_fsync+0x190 VOP_FSYNC_APV+0x98 sched_sync+0x3ca fork_exit+0x9a fork_trampoline+0xe 
   18 100088 vnlru            -                mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 vnlru_proc+0x48 fork_exit+0x9a fork_trampoline+0xe 
   19 100089 softdepflush     -                mi_switch+0xde sleepq_timedwait+0x3a _sleep+0x252 softdep_flush+0x2b4 fork_exit+0x9a fork_trampoline+0xe 
   77 100386 md0              -                mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a md_kthread+0xb5 fork_exit+0x9a fork_trampoline+0xe 
  158 100700 adjkerntz        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigsuspend+0x105 sys_sigsuspend+0x31 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1422 100385 devd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1467 100713 ng_queue         ng_queue0        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a ngthread+0x8c fork_exit+0x9a fork_trampoline+0xe 
 1467 100714 ng_queue         ng_queue1        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a ngthread+0x8c fork_exit+0x9a fork_trampoline+0xe 
 1467 100715 ng_queue         ng_queue2        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a ngthread+0x8c fork_exit+0x9a fork_trampoline+0xe 
 1467 100716 ng_queue         ng_queue3        mi_switch+0xde sleepq_wait+0x3a _sleep+0x26a ngthread+0x8c fork_exit+0x9a fork_trampoline+0xe 
 1761 100707 syslogd          -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1863 101581 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100382 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigtimedwait+0x23c sys_sigwait+0x49 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100718 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100719 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100720 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100721 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100722 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _sleep+0x218 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1866 100723 named            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_kevent+0x32c sys_kevent+0x129 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1867 100442 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1868 100816 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1871 100699 rpcbind          -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1918 100725 mountd           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1920 100380 nfsd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1921 100676 nfsd             nfsd: master     mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 svc_run_internal+0x99c svc_run+0xe9 nfsrvd_nfsd+0x1c9 nfssvc_nfsd+0xe4 sys_nfssvc+0xb7 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1921 100726 nfsd             nfsd: service    mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 svc_run_internal+0x99c svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe 
 1921 100727 nfsd             nfsd: service    mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 svc_run_internal+0x99c svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe 
 1921 100728 nfsd             nfsd: service    mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 svc_run_internal+0x99c svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe 
 1930 100381 apcupsd          -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1930 100729 apcupsd          -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigtimedwait+0x23c sys_sigwait+0x49 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1930 100732 apcupsd          -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1958 101593 tmux             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1963 100702 tor              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _sleep+0x218 kern_kevent+0x32c sys_kevent+0x129 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1963 101765 tor              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 sbwait+0x65 soreceive_generic+0x251 kern_recvit+0x213 sys_recvfrom+0x86 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1963 101766 tor              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 sbwait+0x65 soreceive_generic+0x251 kern_recvit+0x213 sys_recvfrom+0x86 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1963 101767 tor              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 sbwait+0x65 soreceive_generic+0x251 kern_recvit+0x213 sys_recvfrom+0x86 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1963 101768 tor              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 sbwait+0x65 soreceive_generic+0x251 kern_recvit+0x213 sys_recvfrom+0x86 amd64_syscall+0x357 Xfast_syscall+0xfb 
 1986 100703 ntpd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2014 100384 dhcpd            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2030 100730 nmbd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2032 100724 smbd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2034 100383 winbindd         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2037 100705 smbd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2038 100387 winbindd         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2043 100706 smartd           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _sleep+0x218 kern_nanosleep+0x10e sys_nanosleep+0x53 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2060 100731 redis-server     -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _sleep+0x218 kern_kevent+0x32c sys_kevent+0x129 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2060 100736 redis-server     -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2060 100737 redis-server     -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2069 100717 daemon           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigtimedwait+0x23c sys_sigwait+0x49 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2070 100739 quasselcore      -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2070 100745 quasselcore      -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2070 100747 quasselcore      -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2077 100744 postgres         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2079 100746 postgres         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2080 100750 postgres         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2081 100751 postgres         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2082 100752 postgres         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2083 100753 postgres         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2105 100761 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2136 100735 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2148 100733 sendmail         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2151 100762 sendmail         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigsuspend+0x105 sys_sigsuspend+0x31 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2155 100697 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _sleep+0x218 kern_nanosleep+0x10e sys_nanosleep+0x53 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2188 100768 inetd            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2207 100379 getty            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_read+0x2e2 ttydev_read+0x82 devfs_read_f+0xbe dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
 2208 100767 login            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2209 100758 login            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2210 100708 login            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2211 100712 getty            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_read+0x2e2 ttydev_read+0x82 devfs_read_f+0xbe dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
 2212 100773 getty            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_read+0x2e2 ttydev_read+0x82 devfs_read_f+0xbe dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
 2213 100774 getty            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_read+0x2e2 ttydev_read+0x82 devfs_read_f+0xbe dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
 2214 100775 getty            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_read+0x2e2 ttydev_read+0x82 devfs_read_f+0xbe dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
 2397 100772 ssh-agent        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2477 100786 tmux             -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 export_fd_to_sb+0x36e kern_proc_filedesc_out+0x20d sysctl_kern_proc_filedesc+0x66 sysctl_root+0x24f userland_sysctl+0x1d8 sys___sysctl+0x74 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2478 100701 irssi            -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
 2478 100807 irssi            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
 2483 100777 mutt             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_setattr+0x10a5 VOP_SETATTR_APV+0x92 setutimes+0x17a kern_utimesat+0x18c amd64_syscall+0x357 Xfast_syscall+0xfb 
 6879 101642 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf 
10512 100813 zpool            -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b spa_config_generate+0x49 spa_open_common+0x1ca spa_get_stats+0x51 zfs_ioc_pool_stats+0x25 zfsdev_ioctl+0x478 devfs_ioctl_f+0x11f kern_ioctl+0x22e sys_ioctl+0x142 amd64_syscall+0x357 Xfast_syscall+0xfb 
15648 100819 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15651 100461 vim              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
15651 100734 vim              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
15676 100759 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15711 100918 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15752 100760 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15761 100771 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15773 101558 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15788 100823 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
15921 101569 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
22463 101591 ppp              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
22655 101586 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
22668 100818 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 sbwait+0x65 soreceive_generic+0x251 kern_recvit+0x213 sys_recvfrom+0x86 amd64_syscall+0x357 Xfast_syscall+0xfb 
22677 101563 rsync            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
22678 100794 ssh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
22679 101575 rsync            -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
22757 100997 screen           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
22759 101599 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
22781 101069 irssi            -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
22781 101566 irssi            -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
23877 101634 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
27119 101641 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
27178 101393 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
27179 101585 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
27264 101573 tmux             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
29367 101643 ssh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
30423 100769 ssh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
43306 100919 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
43335 101606 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
43491 101579 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
43500 101568 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
43509 101649 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
46122 100791 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
46123 101567 ssh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
48994 101612 winbindd         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
48995 100787 winbindd         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
50004 100993 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
50175 101561 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
50176 100792 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
50192 101572 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
50193 100421 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 sbwait+0x65 soreceive_generic+0x251 kern_recvit+0x213 sys_recvfrom+0x86 amd64_syscall+0x357 Xfast_syscall+0xfb 
50212 100848 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
52841 100710 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
53842 100443 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
53883 100822 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
53884 101614 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
53885 100857 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
53945 101301 vim              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
53945 101646 vim              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54188 101621 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54189 101559 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54190 101596 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54405 101580 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54406 100922 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54407 100437 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54451 101565 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54452 101071 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54453 101574 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54461 101562 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold_array_by_dnode+0x1cf dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54462 100455 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54463 101631 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54464 101570 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54528 101597 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54529 100808 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54530 101013 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54546 101595 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54547 101587 msdl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_write+0x516 VOP_WRITE_APV+0x10f vn_write+0x252 vn_io_fault+0x15b dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54548 100430 tee              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_write+0x273 ttydev_write+0x143 devfs_write_f+0xc1 dofilewrite+0x8a sys_write+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54568 100815 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54570 101626 make             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54572 101619 sh               -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 dmu_tx_assign+0x38 dmu_free_long_range_impl+0x18a dmu_free_long_range+0x43 zfs_freesp+0x17b zfs_freebsd_setattr+0x508 VOP_SETATTR_APV+0x92 vn_truncate+0x151 kern_openat+0x2a8 amd64_syscall+0x357 Xfast_syscall+0xfb 
54585 101613 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54586 100698 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54587 100420 make             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_cursor_retrieve+0x12c zfs_freebsd_readdir+0x3d9 VOP_READDIR_APV+0x98 kern_getdirentries+0x1ee sys_getdirentries+0x28 amd64_syscall+0x357 Xfast_syscall+0xfb 
54588 101252 make             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54590 100709 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x7d5 vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 vn_open_cred+0xd7 kern_openat+0x1ef amd64_syscall+0x357 Xfast_syscall+0xfb 
54599 101339 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54600 101670 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54601 101671 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54603 101588 perl             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 txg_wait_open+0x85 zfs_freebsd_create+0x22b VOP_CREATE_APV+0x92 vn_open_cred+0x2c9 kern_openat+0x1ef amd64_syscall+0x357 Xfast_syscall+0xfb 
54604 101600 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54605 100436 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54606 100711 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold_array_by_dnode+0x1cf dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54609 101594 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold_array_by_dnode+0x1cf dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54611 100766 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54612 101576 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54614 101592 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54615 100776 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54617 101602 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54624 101555 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54625 101603 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54627 101253 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54628 100809 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54629 101622 make             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_cursor_retrieve+0x12c zfs_freebsd_readdir+0x3d9 VOP_READDIR_APV+0x98 kern_getdirentries+0x1ee sys_getdirentries+0x28 amd64_syscall+0x357 Xfast_syscall+0xfb 
54630 101583 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54638 100451 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54639 101598 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54640 101627 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54642 101396 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54643 100412 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54644 101571 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54645 100810 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54647 101578 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54648 100785 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54650 100456 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54651 100418 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54659 101589 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54660 101650 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54663 100797 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54666 100223 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54668 101604 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54685 101582 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54686 100427 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54687 101590 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54689 100814 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54690 100923 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54691 100806 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54692 101672 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54694 100839 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54695 100817 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54697 101640 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54698 101560 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54705 100802 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54706 101227 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54708 100796 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54709 100803 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54717 101673 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54718 101674 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54719 101675 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54721 101557 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54722 101630 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54723 101676 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54724 100921 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54726 100459 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54727 101677 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54729 101679 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54731 101678 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54732 101680 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54739 101681 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54740 100423 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54741 100440 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
54745 100424 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54746 101684 sshd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf 
54747 101685 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54748 100924 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54757 101688 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54759 101689 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54761 101690 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54762 101618 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54763 101691 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54764 101692 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54774 100778 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54776 101686 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54777 101694 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54778 101682 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54780 101695 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54781 101683 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54787 101687 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54789 101697 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54790 101698 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54791 101699 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54793 101693 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54794 101696 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54796 101701 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54797 101702 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54805 101705 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54809 101709 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54812 101710 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54814 101711 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54815 101712 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54816 101713 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54818 101714 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54827 101704 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54828 101703 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54831 101228 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54833 101707 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54834 101708 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 sys_poll+0x3a3 amd64_syscall+0x357 Xfast_syscall+0xfb 
54837 100790 sshd             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54838 101700 sshd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54840 101715 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54841 101716 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54842 101717 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54849 101706 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54850 101720 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54851 101718 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54853 101722 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54854 101723 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54855 101721 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54856 101719 make             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_cursor_retrieve+0x12c zfs_freebsd_readdir+0x3d9 VOP_READDIR_APV+0x98 kern_getdirentries+0x1ee sys_getdirentries+0x28 amd64_syscall+0x357 Xfast_syscall+0xfb 
54857 100422 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54866 101616 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54867 101620 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54868 101727 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54870 101724 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54871 101726 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54872 101728 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54873 101729 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54874 101730 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54876 100770 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54877 101732 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54878 101731 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54880 101734 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54881 101735 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54882 101736 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54889 101733 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54890 101738 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54891 101737 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54893 101740 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54894 101741 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54895 101739 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54896 101742 make             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_cursor_retrieve+0x12c zfs_freebsd_readdir+0x3d9 VOP_READDIR_APV+0x98 kern_getdirentries+0x1ee sys_getdirentries+0x28 amd64_syscall+0x357 Xfast_syscall+0xfb 
54897 101743 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54905 101747 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54906 101748 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54908 101749 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54909 101750 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54910 101746 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54911 101751 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54912 101725 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54913 101744 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54916 101753 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54917 101754 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54919 101752 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54920 101756 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54929 101758 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
54931 101745 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold_array_by_dnode+0x1cf dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54932 101759 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54934 101760 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54935 101761 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54937 101762 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54938 101763 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54946 101341 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54948 101764 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54949 101333 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54951 101769 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54954 101770 sendmail         -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54955 101771 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54956 101755 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54957 101772 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54965 101776 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54966 101777 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54967 101778 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54969 101773 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
54970 101779 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54971 101757 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54972 101780 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54973 101781 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54975 101340 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54976 101775 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54977 101782 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54979 101783 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
54980 101784 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
54986 101785 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
54987 101786 csh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigsuspend+0x105 sys_sigsuspend+0x31 amd64_syscall+0x357 Xfast_syscall+0xfb 
54995 101789 zpool            -                mi_switch+0xde sleepq_wait+0x3a _sx_xlock_hard+0x47f _sx_xlock+0x5e spa_all_configs+0x6e zfs_ioc_pool_configs+0x19 zfsdev_ioctl+0x478 devfs_ioctl_f+0x11f kern_ioctl+0x22e sys_ioctl+0x142 amd64_syscall+0x357 Xfast_syscall+0xfb 
54997 101774 csh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigsuspend+0x105 sys_sigsuspend+0x31 amd64_syscall+0x357 Xfast_syscall+0xfb 
54999 101788 top              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
55000 101342 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55001 101787 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
55002 101791 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
55004 101793 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55005 101794 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
55006 101792 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
55014 101798 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55015 101799 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55016 101800 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55018 101795 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
55019 101797 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
55020 101801 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
55021 101802 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55022 101803 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
55024 101804 csh              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigsuspend+0x105 sys_sigsuspend+0x31 amd64_syscall+0x357 Xfast_syscall+0xfb 
55029 101806 cron             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 pipe_read+0x2ba dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
55030 101805 sh               -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x49d vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 sys_stat+0x2d amd64_syscall+0x357 Xfast_syscall+0xfb 
55032 101808 smbd             -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dbuf_read+0x40b dmu_buf_hold+0xc3 zap_lockdir+0x49 zap_lookup_norm+0x3d zap_lookup+0x2e zfs_dirent_lock+0x3c6 zfs_dirlook+0x17d zfs_lookup+0x244 zfs_freebsd_lookup+0x6d VOP_CACHEDLOOKUP_APV+0x92 vfs_cache_lookup+0xcf VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 kern_statat_vnhook+0x99 
55033 101809 procstat         -                <running>                    
61905 100849 sh               -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 100830 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 100901 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 100902 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101653 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101654 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101655 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101656 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101657 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101658 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_wait+0x31a __umtx_op_wait_uint_private+0x83 amd64_syscall+0x357 Xfast_syscall+0xfb 
61971 101659 mysqld           -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_sigtimedwait+0x23c sys_sigwait+0x49 amd64_syscall+0x357 Xfast_syscall+0xfb 
79833 100208 vim              -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
79833 100827 vim              -                mi_switch+0xde thread_suspend_switch+0x170 cursig+0x60f ast+0x43f Xfast_syscall+0x160 
80271 100738 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
80381 101638 sudo             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 seltdwait+0x97 kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
80382 100824 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 kern_wait6+0x5ad sys_wait4+0x76 amd64_syscall+0x357 Xfast_syscall+0xfb 
97384 101564 bash             -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _cv_wait_sig+0x174 tty_wait+0x1c ttydisc_read+0x2e2 ttydev_read+0x82 devfs_read_f+0xbe dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
97433 100795 lighttpd         -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _sleep+0x218 kern_kevent+0x32c sys_kevent+0x129 amd64_syscall+0x357 Xfast_syscall+0xfb 
97434 100438 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
97434 101309 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_sem_wait+0x381 __umtx_op_sem_wait+0x73 amd64_syscall+0x357 Xfast_syscall+0xfb 
97434 101310 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 zio_wait+0x5b zil_commit+0x734 zfs_freebsd_fsync+0x95 VOP_FSYNC_APV+0x98 sys_fsync+0x1e9 amd64_syscall+0x357 Xfast_syscall+0xfb 
97434 101311 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_sem_wait+0x381 __umtx_op_sem_wait+0x73 amd64_syscall+0x357 Xfast_syscall+0xfb 
97434 101312 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_sem_wait+0x381 __umtx_op_sem_wait+0x73 amd64_syscall+0x357 Xfast_syscall+0xfb 
97434 101313 python2.7        -                mi_switch+0xde sleepq_wait+0x3a sleeplk+0x11c __lockmgr_args+0x7d5 vop_stdlock+0x3c VOP_LOCK1_APV+0x9d _vn_lock+0x43 vget+0x7a cache_lookup+0x5e2 vfs_cache_lookup+0xa1 VOP_LOOKUP_APV+0x92 lookup+0x58b namei+0x474 vn_open_cred+0xd7 kern_openat+0x1ef amd64_syscall+0x357 Xfast_syscall+0xfb 
97722 101334 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 dmu_buf_hold_array_by_dnode+0x34b dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
97722 101335 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_sem_wait+0x381 __umtx_op_sem_wait+0x73 amd64_syscall+0x357 Xfast_syscall+0xfb 
97722 101336 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_sem_wait+0x381 __umtx_op_sem_wait+0x73 amd64_syscall+0x357 Xfast_syscall+0xfb 
97722 101337 python2.7        -                mi_switch+0xde sleepq_wait+0x3a _cv_wait+0x175 spa_config_enter+0x9b zio_vdev_io_start+0x174 zio_execute+0x136 arc_read+0x882 dbuf_read+0x651 dmu_buf_hold_array_by_dnode+0x1cf dmu_read_uio+0x66 zfs_freebsd_read+0x38d VOP_READ_APV+0x92 vn_read+0x166 vn_io_fault+0x15b dofileread+0x7b sys_read+0x9e amd64_syscall+0x357 Xfast_syscall+0xfb 
97722 101338 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_wait_sig+0xf _sleep+0x260 umtxq_sleep+0x129 do_sem_wait+0x381 __umtx_op_sem_wait+0x73 amd64_syscall+0x357 Xfast_syscall+0xfb 
97722 101605 python2.7        -                mi_switch+0xde sleepq_catch_signals+0xb2 sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x197 seltdwait+0xab kern_select+0x90b sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 
-------------- next part --------------
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-CURRENT #5 b37d7ce: Tue Jul 30 21:25:46 CST 2013
    root at kcwu.csie.org:/usr/obj/usr/src/sys/DESKTOP amd64
FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610
CPU: Intel(R) Core(TM) i3 CPU         540  @ 3.07GHz (3066.70-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x20652  Family = 0x6  Model = 0x25  Stepping = 2
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x98e3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,POPCNT>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 15802961920 (15070 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <GBT    GBTUACPI>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  5
ioapic0: Changing APIC ID to 2
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: <GBT GBTUACPI> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, d76e0000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Event timer "HPET3" frequency 14318180 Hz quality 440
Event timer "HPET4" frequency 14318180 Hz quality 440
atrtc0: <AT realtime clock> port 0x70-0x73 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <PCI bus> on pcib1
ahci0: <Marvell 88SE912x AHCI SATA controller> port 0xcf00-0xcf07,0xce00-0xce03,0xcd00-0xcd07,0xcc00-0xcc03,0xcb00-0xcb0f mem 0xfbeff000-0xfbeff7ff irq 16 at device 0.0 on pci1
ahci0: AHCI v1.00 with 2 6Gbps ports, Port Multiplier supported with FBS
ahci0: quirks=0x140<EDGEIS,NOBSYRES>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
atapci0: <Marvell 88SE912x UDMA133 controller> port 0xca00-0xca07,0xc900-0xc903,0xc800-0xc807,0xc700-0xc703,0xc600-0xc60f mem 0xfbefe000-0xfbefe00f irq 17 at device 0.1 on pci1
vgapci0: <VGA-compatible display> port 0xff00-0xff07 mem 0xfb400000-0xfb7fffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0
agp0: <Intel Ironlake (D) SVGA controller> on vgapci0
agp0: aperture size is 256M, detected 65532k stolen memory
pci0: <simple comms> at device 22.0 (no driver attached)
uhci0: <UHCI (generic) USB controller> port 0xfe00-0xfe1f irq 16 at device 26.0 on pci0
uhci0: LegSup = 0x2f00
usbus0 on uhci0
uhci1: <UHCI (generic) USB controller> port 0xfd00-0xfd1f irq 21 at device 26.1 on pci0
uhci1: LegSup = 0x2f00
usbus1 on uhci1
uhci2: <UHCI (generic) USB controller> port 0xfc00-0xfc1f irq 18 at device 26.2 on pci0
uhci2: LegSup = 0x2f00
usbus2 on uhci2
ehci0: <Intel PCH USB 2.0 controller USB-B> mem 0xfbffe000-0xfbffe3ff irq 18 at device 26.7 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci0
hdac0: <Intel 5 Series/3400 Series HDA Controller> mem 0xfbff4000-0xfbff7fff irq 22 at device 27.0 on pci0
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci3: <ACPI PCI bus> on pcib3
atapci1: <JMicron JMB368 UDMA133 controller> port 0xbf00-0xbf07,0xbe00-0xbe03,0xbd00-0xbd07,0xbc00-0xbc03,0xbb00-0xbb0f irq 16 at device 0.0 on pci3
ata2: <ATA channel> at channel 0 on atapci1
pcib4: <ACPI PCI-PCI bridge> irq 17 at device 28.5 on pci0
pci4: <ACPI PCI bus> on pcib4
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F PCIe Gigabit Ethernet> port 0xee00-0xeeff mem 0xfbbff000-0xfbbfffff,0xfbbf8000-0xfbbfbfff irq 17 at device 0.0 on pci4
re0: Using 1 MSI-X message
re0: Chip rev. 0x2c000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Ethernet address: 1c:6f:65:49:34:be
uhci3: <UHCI (generic) USB controller> port 0xfb00-0xfb1f irq 23 at device 29.0 on pci0
uhci3: LegSup = 0x2f00
usbus4 on uhci3
uhci4: <UHCI (generic) USB controller> port 0xfa00-0xfa1f irq 19 at device 29.1 on pci0
uhci4: LegSup = 0x2f00
usbus5 on uhci4
uhci5: <UHCI (generic) USB controller> port 0xf900-0xf91f irq 18 at device 29.2 on pci0
uhci5: LegSup = 0x2f00
usbus6 on uhci5
ehci1: <Intel PCH USB 2.0 controller USB-A> mem 0xfbffd000-0xfbffd3ff irq 23 at device 29.7 on pci0
usbus7: EHCI version 1.0
usbus7 on ehci1
pcib5: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci5: <ACPI PCI bus> on pcib5
re1: <D-Link DGE-528(T) Gigabit Ethernet Adapter> port 0xde00-0xdeff mem 0xfbdff000-0xfbdff0ff irq 18 at device 2.0 on pci5
re1: Chip rev. 0x10000000
re1: MAC rev. 0x00000000
miibus1: <MII bus> on re1
rgephy1: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus1
rgephy1:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re1: Ethernet address: b8:a3:86:6b:b8:1d
pci5: <serial bus, FireWire> at device 7.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci1: <Intel 5 Series/3400 Series AHCI SATA controller> port 0xf800-0xf807,0xf700-0xf703,0xf600-0xf607,0xf500-0xf503,0xf400-0xf41f mem 0xfbffc000-0xfbffc7ff irq 19 at device 31.2 on pci0
ahci1: AHCI v1.30 with 6 3Gbps ports, Port Multiplier supported
ahcich2: <AHCI channel> at channel 0 on ahci1
ahcich3: <AHCI channel> at channel 1 on ahci1
ahcich4: <AHCI channel> at channel 2 on ahci1
ahcich5: <AHCI channel> at channel 3 on ahci1
ahcich6: <AHCI channel> at channel 4 on ahci1
ahcich7: <AHCI channel> at channel 5 on ahci1
ahciem0: <AHCI enclosure management bridge> on ahci1
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
orm0: <ISA Option ROM> at iomem 0xd2000-0xd4fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to deny, logging disabled
hdacc0: <Realtek ALC889 HDA CODEC> at cad 2 on hdac0
hdaa0: <Realtek ALC889 Audio Function Group> at nid 1 on hdacc0
pcm0: <Realtek ALC889 (Rear Analog 7.1/2.0)> at nid 20,22,21,23 and 24,26 on hdaa0
pcm1: <Realtek ALC889 (Front Analog)> at nid 27 and 25 on hdaa0
pcm2: <Realtek ALC889 (Rear Digital)> at nid 30 and 31 on hdaa0
pcm3: <Realtek ALC889 (Onboard Digital)> at nid 17 on hdaa0
hdacc1: <Intel Ibex Peak HDA CODEC> at cad 3 on hdac0
hdaa1: <Intel Ibex Peak Audio Function Group> at nid 1 on hdacc1
pcm4: <Intel Ibex Peak (HDMI/DP 8ch)> at nid 5 on hdaa1
pcm5: <Intel Ibex Peak (HDMI/DP 8ch)> at nid 6 on hdaa1
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 480Mbps High Speed USB v2.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 12Mbps Full Speed USB v1.0
usbus6: 12Mbps Full Speed USB v1.0
usbus7: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen2.1: <Intel> at usbus2
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen1.1: <Intel> at usbus1
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen4.1: <Intel> at usbus4
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen3.1: <Intel> at usbus3
uhub4: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
ugen6.1: <Intel> at usbus6
uhub5: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen5.1: <Intel> at usbus5
uhub6: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
ugen7.1: <Intel> at usbus7
uhub7: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus7
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada0: quirks=0x1<4K>
ada0: Previously was known as ad4
ada1 at ahcich2 bus 0 scbus3 target 0 lun 0
ada1: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad10
ada2 at ahcich3 bus 0 scbus4 target 0 lun 0
ada2: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada2: quirks=0x1<4K>
ada2: Previously was known as ad12
ada3 at ahcich4 bus 0 scbus5 target 0 lun 0
ada3: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada3: quirks=0x1<4K>
ada3: Previously was known as ad14
ada4 at ahcich5 bus 0 scbus6 target 0 lun 0
ada4: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada4: quirks=0x1<4K>
ada4: Previously was known as ad16
ada5 at ahcich6 bus 0 scbus7 target 0 lun 0
ada5: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada5: quirks=0x1<4K>
ada5: Previously was known as ad18
ses0 at ahciem0 bus 0 scbus9 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
cd0 at ata2 bus 0 scbus2 target 0 lun 0
cd0: <DVDRW IDE1008 0054> Removable CD-ROM SCSI-0 device 
cd0: 66.700MB/s transfers (UDMA4, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
Timecounter "TSC-low" frequency 1533349680 Hz quality 1000
uhub5: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub6: 2 ports with 2 removable, self powered
uhub0: 2 ports with 2 removable, self powered
Root mount waiting for: usbus7 usbus3
uhub4: 6 ports with 6 removable, self powered
uhub7: 6 ports with 6 removable, self powered
ugen3.2: <vendor 0x0424> at usbus3
uhub8: <vendor 0x0424 product 0x2512, class 9/0, rev 2.00/a.a0, addr 2> on usbus3
Root mount waiting for: usbus3
uhub8: 2 ports with 1 removable, bus powered
ugen3.3: <SEJIN> at usbus3
ukbd0: <USB Keyboard> on usbus3
kbd2 at ukbd0
Root mount waiting for: usbus3
Trying to mount root from zfs:zroot []...
ugen1.2: <American Power Conversion> at usbus1
WARNING: attempt to domain_add(netgraph) after domainfinalize()


More information about the freebsd-fs mailing list