FreeBSD-main-amd64-test - Build #20451 - Failure

From: <>
Date: Mon, 24 Jan 2022 01:58:36 UTC
FreeBSD-main-amd64-test - Build #20451 (f72926eab00ccd956298e44831b519daa704a868) - Failure

Build information:
Full change log:
Full build log:

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

f72926eab00ccd956298e44831b519daa704a868 by rmacklem:
mountd: Delay starting mountd until after mountlate

The end of the build log:

[...truncated 4.57 MB...]
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cc059f30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x18920744cf48, rbp = 0x18920744cf60 ---

Tracing command zfskern pid 19661 tid 100529 td 0xfffffe00cbe7c1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00979c6dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00979c6de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979c6e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00979c6ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00979c6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979c6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979c6f30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x189208369f48, rbp = 0x189208369f60 ---

Tracing command zfskern pid 19661 tid 100530 td 0xfffffe00cbe95ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe0084f9ddc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0084f9dde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084f9de20
_sleep() at _sleep+0x2e7/frame 0xfffffe0084f9dec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0084f9def0
fork_exit() at fork_exit+0x80/frame 0xfffffe0084f9df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084f9df30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x189208ec5f48, rbp = 0x189208ec5f60 ---

Tracing command zfskern pid 19661 tid 100531 td 0xfffffe00c2ffd900
sched_switch() at sched_switch+0x559/frame 0xfffffe0084facdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0084facde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084face20
_sleep() at _sleep+0x2e7/frame 0xfffffe0084facec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0084facef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0084facf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084facf30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x18920a811f48, rbp = 0x18920a811f60 ---

Tracing command zfskern pid 19661 tid 100532 td 0xfffffe00cbe86ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00979d0dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00979d0de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979d0e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00979d0ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00979d0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979d0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979d0f30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x18920c764f48, rbp = 0x18920c764f60 ---

Tracing command zfskern pid 19661 tid 100533 td 0xfffffe00cbe9e000
sched_switch() at sched_switch+0x559/frame 0xfffffe0084fbbdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0084fbbde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0084fbbe20
_sleep() at _sleep+0x2e7/frame 0xfffffe0084fbbec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0084fbbef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0084fbbf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0084fbbf30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x1891fad0cf48, rbp = 0x1891fad0cf60 ---

Tracing command zfskern pid 19661 tid 100534 td 0xfffffe00cbea0ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cc004dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00cc004de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cc004e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00cc004ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00cc004ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cc004f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cc004f30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x1891fc313f48, rbp = 0x1891fc313f60 ---

Tracing command zfskern pid 19661 tid 100535 td 0xfffffe00cbea03a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cc022c20
mi_switch() at mi_switch+0x157/frame 0xfffffe00cc022c40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cc022c80
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cc022cc0
_cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe00cc022d40
l2arc_feed_thread() at l2arc_feed_thread+0x274/frame 0xfffffe00cc022ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cc022f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cc022f30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x1891fd23ef48, rbp = 0x1891fd23ef60 ---

Tracing command zfskern pid 19661 tid 100536 td 0xfffffe00c2ffc3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cb1d9dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00cb1d9de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cb1d9e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00cb1d9ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00cb1d9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cb1d9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cb1d9f30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x18920e089f48, rbp = 0x18920e089f60 ---

Tracing command zfskern pid 19661 tid 100537 td 0xfffffe00cbea7720
sched_switch() at sched_switch+0x559/frame 0xfffffe00979dfcc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00979dfce0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979dfd20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00979dfd70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00979dfd80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00979dfde0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe00979dfe00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe00979dfef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979dff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979dff30
--- trap 0xc, rip = 0x1891f54a72da, rsp = 0x189210028f48, rbp = 0x189210028f60 ---

Tracing command aiod17 pid 60665 tid 100664 td 0xfffffe00cbea7000
sched_switch() at sched_switch+0x559/frame 0xfffffe00cc2e3d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00cc2e3d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cc2e3dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00cc2e3e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00cc2e3ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00cc2e3ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00cc2e3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00cc2e3f30
--- trap 0xc, rip = 0x195c35eb2da, rsp = 0x195c0d0c478, rbp = 0x195c0d0c490 ---

Tracing command soaiod1 pid 60687 tid 100985 td 0xfffffe00cbec13a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00979e9d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00979e9d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979e9dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00979e9e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00979e9eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00979e9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979e9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979e9f30
--- trap 0xc, rip = 0x5e8a294c2da, rsp = 0x5e89fc4c2d8, rbp = 0x5e89fc4c2f0 ---

Tracing command soaiod2 pid 60688 tid 100984 td 0xfffffe0097bea740
sched_switch() at sched_switch+0x559/frame 0xfffffe00979b2d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00979b2d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979b2dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00979b2e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00979b2eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00979b2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979b2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979b2f30
--- trap 0xc, rip = 0x32484681e2da, rsp = 0x32484447fe08, rbp = 0x32484447fe20 ---

Tracing command soaiod3 pid 60689 tid 100983 td 0xfffffe00cbe7d740
sched_switch() at sched_switch+0x559/frame 0xfffffe00979e4d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00979e4d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979e4dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00979e4e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00979e4eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00979e4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979e4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979e4f30
--- trap 0xc, rip = 0x126c309cf2da, rsp = 0x126c2d205bb8, rbp = 0x126c2d205bd0 ---

Tracing command soaiod4 pid 60690 tid 100982 td 0xfffffe0097bea020
sched_switch() at sched_switch+0x559/frame 0xfffffe00979cbd70
mi_switch() at mi_switch+0x157/frame 0xfffffe00979cbd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00979cbdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00979cbe10
_sleep() at _sleep+0x2ce/frame 0xfffffe00979cbeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00979cbef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00979cbf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00979cbf30
--- trap 0xc, rip = 0x1cef14c942da, rsp = 0x1cef11f03e58, rbp = 0x1cef11f03e70 ---

Tracing command g_mp_kt pid 3397 tid 100102 td 0xfffffe0097bdb720
sched_switch() at sched_switch+0x559/frame 0xfffffe00c2de2da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00c2de2dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00c2de2e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00c2de2ea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00c2de2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00c2de2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00c2de2f30
--- trap 0xc, rip = 0xdfd1b902da, rsp = 0xdfd0678eb8, rbp = 0xdfd0678ed0 ---

Tracing command sh pid 14257 tid 101938 td 0xfffffe00cd4e8ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00cc117b80
mi_switch() at mi_switch+0x157/frame 0xfffffe00cc117ba0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00cc117be0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00cc117c30
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00cc117c40
_sleep() at _sleep+0x2dd/frame 0xfffffe00cc117ce0
pipe_read() at pipe_read+0x4b6/frame 0xfffffe00cc117d40
dofileread() at dofileread+0x81/frame 0xfffffe00cc117d90
sys_read() at sys_read+0xc0/frame 0xfffffe00cc117e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00cc117f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00cc117f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x216d8744f6ba, rsp = 0x216d85a05788, rbp = 0x216d85a05910 ---

Tracing command sh pid 14292 tid 102120 td 0xfffffe00d324f720
sched_switch() at sched_switch+0x559/frame 0xfffffe00d36f7a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00d36f7a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00d36f7a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00d36f7ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00d36f7ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00d36f7b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00d36f7c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00d36f7e00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00d36f7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00d36f7f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x216d8744f89a, rsp = 0x216d85a05018, rbp = 0x216d85a050d0 ---

Tracing command ifconfig pid 14293 tid 102125 td 0xfffffe00d3265c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00d36ed910
mi_switch() at mi_switch+0x157/frame 0xfffffe00d36ed930
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00d36ed970
_sx_xlock_hard() at _sx_xlock_hard+0x41b/frame 0xfffffe00d36eda10
_sx_xlock() at _sx_xlock+0xb6/frame 0xfffffe00d36eda50
vnet_register_sysinit() at vnet_register_sysinit+0x34/frame 0xfffffe00d36eda80
linker_load_module() at linker_load_module+0xb9b/frame 0xfffffe00d36edd80
kern_kldload() at kern_kldload+0x16f/frame 0xfffffe00d36eddd0
sys_kldload() at sys_kldload+0x5b/frame 0xfffffe00d36ede00
amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00d36edf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00d36edf30
--- syscall (304, FreeBSD ELF64, sys_kldload), rip = 0xeef95e7479a, rsp = 0xeef91feef08, rbp = 0xeef91fef390 ---
db:0:kdb.enter.panic> dump

Dump failed. Partition too small (about 1412MB were needed this time).
Cannot dump: unknown error (error=7).
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20451' --destroy
+ sh -ex freebsd-ci/scripts/test/
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./
x ./
x ./
x ./
x ./auto-shutdown
x ./
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/
+ ./freebsd-ci/artifact/
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'f72926eab00ccd956298e44831b519daa704a868', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../f72926eab00ccd956298e44831b519daa704a868/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address