FreeBSD-main-amd64-test - Build #19836 - Failure

From: <>
Date: Wed, 17 Nov 2021 21:11:11 UTC
FreeBSD-main-amd64-test - Build #19836 (8a693ccf86f90469910c5b2425ddb8a75e298487) - Failure

Build information:
Full change log:
Full build log:

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

8a693ccf86f90469910c5b2425ddb8a75e298487 by markj:
Export symbols from opensolaris.ko and dtrace.ko

The end of the build log:

[...truncated 4.27 MB...]
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9a1ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9a1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9a1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9a1f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x723aa88, rbp = 0x723aaa0 ---

Tracing command zfskern pid 14087 tid 100278 td 0xfffffe00a6a031e0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bfadc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bfade0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bfae20
_sleep() at _sleep+0x2e7/frame 0xfffffe0063bfaec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0063bfaef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bfaf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bfaf30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x743ba88, rbp = 0x743baa0 ---

Tracing command zfskern pid 14087 tid 100279 td 0xfffffe009dbf0740
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bebdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bebde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bebe20
_sleep() at _sleep+0x2e7/frame 0xfffffe0063bebec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0063bebef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bebf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bebf30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x7fffda444a88, rbp = 0x7fffda444aa0 ---

Tracing command zfskern pid 14087 tid 100280 td 0xfffffe00a6a0b740
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9bfdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9bfde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9bfe20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9bfec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9bfef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9bff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9bff30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x2413a88, rbp = 0x2413aa0 ---

Tracing command zfskern pid 14087 tid 100281 td 0xfffffe00a6a01560
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9c9dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9c9de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9c9e20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9c9ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d9c9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9c9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9c9f30
--- trap 0x16, rip = 0x199d0b0d4d9a, rsp = 0x5029a88, rbp = 0x5029aa0 ---

Tracing command zfskern pid 14087 tid 100282 td 0xfffffe00a6a04740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5ddedc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5ddede0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5ddee20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5ddeec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5ddeef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5ddef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5ddef30
--- trap 0x16, rip = 0x199d0b0d4d9a, rsp = 0x1009a88, rbp = 0x1009aa0 ---

Tracing command zfskern pid 14087 tid 100283 td 0xfffffe00a6a0a900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063be6dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063be6de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063be6e20
_sleep() at _sleep+0x2e7/frame 0xfffffe0063be6ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0063be6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063be6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063be6f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x5a2ea88, rbp = 0x5a2eaa0 ---

Tracing command zfskern pid 14087 tid 100284 td 0xfffffe009dbe7020
sched_switch() at sched_switch+0x559/frame 0xfffffe009d97edc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d97ede0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d97ee20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d97eec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d97eef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d97ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d97ef30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x7fffd8665a88, rbp = 0x7fffd8665aa0 ---

Tracing command zfskern pid 14087 tid 100285 td 0xfffffe00a6a04020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c09dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c09de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c09e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c09ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a6c09ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c09f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c09f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x6a36a88, rbp = 0x6a36aa0 ---

Tracing command zfskern pid 14087 tid 100286 td 0xfffffe00a6a07000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5deddc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dedde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dede20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5dedec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a5dedef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dedf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dedf30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x4e28a88, rbp = 0x4e28aa0 ---

Tracing command zfskern pid 14087 tid 100287 td 0xfffffe009dbeeac0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bf5dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bf5de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bf5e20
_sleep() at _sleep+0x2e7/frame 0xfffffe0063bf5ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0063bf5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bf5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bf5f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x6031a88, rbp = 0x6031aa0 ---

Tracing command zfskern pid 14087 tid 100288 td 0xfffffe009dbe53a0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d96adc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d96ade0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d96ae20
_sleep() at _sleep+0x2e7/frame 0xfffffe009d96aec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe009d96aef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d96af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d96af30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x4624a88, rbp = 0x4624aa0 ---

Tracing command zfskern pid 14087 tid 100289 td 0xfffffe009dbe7740
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9d8c20
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9d8c40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9d8c80
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d9d8cc0
_cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe009d9d8d40
l2arc_feed_thread() at l2arc_feed_thread+0x274/frame 0xfffffe009d9d8ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9d8f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9d8f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x6232a88, rbp = 0x6232aa0 ---

Tracing command zfskern pid 14087 tid 100290 td 0xfffffe00a6a02ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c18dc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c18de0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c18e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c18ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a6c18ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c18f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c18f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x1e10a88, rbp = 0x1e10aa0 ---

Tracing command zfskern pid 14087 tid 100291 td 0xfffffe009dbef900
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9b5cc0
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9b5ce0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9b5d20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe009d9b5d70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe009d9b5d80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe009d9b5de0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe009d9b5e00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe009d9b5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9b5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9b5f30
--- trap 0xc, rip = 0x199d0b0d4d9a, rsp = 0x7039a88, rbp = 0x7039aa0 ---

Tracing command aiod1 pid 14094 tid 100089 td 0xfffffe00775b03a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b57d60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b57d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b57dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b57e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b57ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063b57ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b57f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b57f30
--- trap 0xc, rip = 0x80550315d9a, rsp = 0x7fffff836548, rbp = 0x7fffff836560 ---

Tracing command aiod2 pid 14095 tid 100114 td 0xfffffe009db7be40
sched_switch() at sched_switch+0x559/frame 0xfffffe00773d1d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00773d1d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773d1dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00773d1e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00773d1ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00773d1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00773d1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00773d1f30
--- trap 0xc, rip = 0x1a0d99800d9a, rsp = 0x7fffffcf4d38, rbp = 0x7fffffcf4d50 ---

Tracing command md0 pid 79756 tid 100818 td 0xfffffe00a6ba7000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c77da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c77dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c77e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c77ea0
md_kthread() at md_kthread+0xd5/frame 0xfffffe00a6c77ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c77f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c77f30
--- trap 0xc, rip = 0x31e8e006bd9a, rsp = 0x7fffff9e9628, rbp = 0x7fffff9e9720 ---

Tracing command aiod26 pid 2041 tid 100866 td 0xfffffe00a7b703a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7f26d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7f26d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7f26dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7f26e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7f26ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a7f26ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7f26f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7f26f30
--- trap 0xc, rip = 0x8cdb443b37a, rsp = 0x7fffff506358, rbp = 0x7fffff506800 ---

Tracing command aiod30 pid 2045 tid 100845 td 0xfffffe00a7b6ee40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7ebdd60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7ebdd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7ebddc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7ebde00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7ebdea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a7ebdef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7ebdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7ebdf30
--- trap 0xc, rip = 0x24f6750add9a, rsp = 0x7fffff310cb8, rbp = 0x7fffff310cd0 ---
db:0:kdb.enter.panic> dump
Dumping 478 out of 4058 MB:..4%..11%..21%..31%..41%..51%..61%..71%..81%..91%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19836' --destroy
+ sh -ex freebsd-ci/scripts/test/
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./
x ./
x ./
x ./auto-shutdown
x ./
x ./
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/
+ ./freebsd-ci/artifact/
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '8a693ccf86f90469910c5b2425ddb8a75e298487', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../8a693ccf86f90469910c5b2425ddb8a75e298487/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address