FreeBSD-main-amd64-test - Build #20004 - Still Failing

From: <>
Date: Sun, 05 Dec 2021 22:10:18 UTC
FreeBSD-main-amd64-test - Build #20004 (eb93b99d698674e3b1cc7139fda98e2b175b8c5b) - Still Failing

Build information:
Full change log:
Full build log:

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

No changes

The end of the build log:

[...truncated 4.29 MB...]
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dc6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dc6f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 813 tid 100132 td 0xfffffe00a7142740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dc1dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dc1de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dc1e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5dc1ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5dc1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dc1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dc1f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 813 tid 100133 td 0xfffffe00a7142020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dbcdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dbcde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dbce20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5dbcec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5dbcef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dbcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dbcf30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 813 tid 100134 td 0xfffffe00a7141900
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5db7c20
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5db7c40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5db7c80
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5db7cc0
_cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe00a5db7d40
l2arc_feed_thread() at l2arc_feed_thread+0x274/frame 0xfffffe00a5db7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5db7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5db7f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 813 tid 100135 td 0xfffffe00a71411e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5db2dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5db2de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5db2e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5db2ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5db2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5db2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5db2f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command zfskern pid 813 tid 100136 td 0xfffffe00a7152000
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9becc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9bece0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9bed20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe009d9bed70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe009d9bed80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe009d9bede0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe009d9bee00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe009d9beef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9bef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9bef30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command ng_queue pid 40428 tid 100853 td 0xfffffe00a71ad720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7fa8d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7fa8da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7fa8de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7fa8e80
ngthread() at ngthread+0x88/frame 0xfffffe00a7fa8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7fa8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7fa8f30
--- trap 0xc, rip = 0x25ca3364709a, rsp = 0x7fffff8e9f88, rbp = 0x7fffff8ea080 ---

Tracing command ng_queue pid 40428 tid 101824 td 0xfffffe00a7c07000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a73b2d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a73b2da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a73b2de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a73b2e80
ngthread() at ngthread+0x88/frame 0xfffffe00a73b2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a73b2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a73b2f30
--- trap 0xc, rip = 0x3bda2060d09a, rsp = 0xb059f48, rbp = 0xb059f60 ---

Tracing command aiod10 pid 89778 tid 100859 td 0xfffffe00a7193e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7f99d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7f99d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7f99dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7f99e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7f99ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a7f99ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7f99f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f99f30
--- trap 0xc, rip = 0x300205cdc09a, rsp = 0x7fffff76d298, rbp = 0x7fffff76d2b0 ---

Tracing command aiod12 pid 89780 tid 100821 td 0xfffffe00a7b9f900
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9f0d60
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9f0d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9f0dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d9f0e00
_sleep() at _sleep+0x2ce/frame 0xfffffe009d9f0ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe009d9f0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9f0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9f0f30
--- trap 0xc, rip = 0x386e5926209a, rsp = 0x7fffff320bb8, rbp = 0x7fffff320bd0 ---

Tracing command aiod13 pid 89781 tid 100922 td 0xfffffe00a7be2720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7eaed60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7eaed80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7eaedc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7eaee00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7eaeea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a7eaeef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7eaef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7eaef30
--- trap 0xc, rip = 0x30eecfc5309a, rsp = 0x7fffffe76728, rbp = 0x7fffffe76740 ---

Tracing command aiod32 pid 89800 tid 100849 td 0xfffffe00a7c3b000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7fadd60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7fadd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7faddc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7fade00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7fadea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a7fadef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7fadf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7fadf30
--- trap 0xc, rip = 0x1b13650c09a, rsp = 0x7fffffa39798, rbp = 0x7fffffa397b0 ---

Tracing command soaiod1 pid 89807 tid 100883 td 0xfffffe00a7ba8720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7f53d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7f53d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7f53dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7f53e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7f53eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a7f53ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7f53f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f53f30
--- trap 0xc, rip = 0x2d8c9df009a, rsp = 0x7fffffd7e738, rbp = 0x7fffffd7e750 ---

Tracing command soaiod2 pid 89808 tid 100868 td 0xfffffe00a71a0ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7eead70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7eead90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7eeadd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7eeae10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7eeaeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a7eeaef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7eeaf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7eeaf30
--- trap 0xc, rip = 0xd2b8a0e909a, rsp = 0x7fffff5d6248, rbp = 0x7fffff5d6260 ---

Tracing command soaiod3 pid 89809 tid 100877 td 0xfffffe00a7b9f1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7f62d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7f62d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7f62dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7f62e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7f62eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a7f62ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7f62f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f62f30
--- trap 0xc, rip = 0x756fabc709a, rsp = 0x7fffffb0bfb8, rbp = 0x7fffffb0bfd0 ---

Tracing command soaiod4 pid 89810 tid 100815 td 0xfffffe00a7ba0740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a72d1d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a72d1d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a72d1dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a72d1e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a72d1eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a72d1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a72d1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a72d1f30
--- trap 0xc, rip = 0x7c87ae5409a, rsp = 0x7fffff898848, rbp = 0x7fffff898860 ---

Tracing command g_mp_kt pid 32514 tid 100924 td 0xfffffe00a7bdb740
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9ffda0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9ffdc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9ffe00
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9ffea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe009d9ffef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9fff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9fff30
--- trap 0xc, rip = 0x2aca2892c09a, rsp = 0x7fffff5f21b8, rbp = 0x7fffff5f22b0 ---

Tracing command sh pid 71551 tid 100143 td 0xfffffe00a7148c80
sched_switch() at sched_switch+0x559/frame 0xfffffe009d99bb80
mi_switch() at mi_switch+0x157/frame 0xfffffe009d99bba0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d99bbe0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe009d99bc30
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe009d99bc40
_sleep() at _sleep+0x2dd/frame 0xfffffe009d99bce0
pipe_read() at pipe_read+0x4b6/frame 0xfffffe009d99bd40
dofileread() at dofileread+0x81/frame 0xfffffe009d99bd90
sys_read() at sys_read+0xc0/frame 0xfffffe009d99be00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe009d99bf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe009d99bf30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1b497670d45a, rsp = 0x7fffff352e18, rbp = 0x7fffff352fa0 ---

Tracing command inetd pid 71653 tid 101784 td 0xfffffe00a7c22c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bf1ab0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bf1ad0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bf1b10
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063bf1b60
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063bf1b70
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe0063bf1bd0
kern_select() at kern_select+0xa95/frame 0xfffffe0063bf1dc0
sys_select() at sys_select+0x56/frame 0xfffffe0063bf1e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063bf1f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063bf1f30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x1bae42acb4da, rsp = 0x7fffff900eb8, rbp = 0x7fffff901d50 ---
db:0:kdb.enter.panic> dump

Dump failed. Partition too small (about 2877MB were needed this time).
Cannot dump: unknown error (error=7).
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-20004' --destroy
+ sh -ex freebsd-ci/scripts/test/
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./
x ./
x ./
x ./auto-shutdown
x ./
x ./
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/
+ ./freebsd-ci/artifact/
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'eb93b99d698674e3b1cc7139fda98e2b175b8c5b', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../eb93b99d698674e3b1cc7139fda98e2b175b8c5b/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address