FreeBSD-main-amd64-test - Build #19861 - Failure

From: <>
Date: Sat, 20 Nov 2021 09:49:51 UTC
FreeBSD-main-amd64-test - Build #19861 (ce74223a366b59bb7ea8febef9e4db1fc700136a) - Failure

Build information:
Full change log:
Full build log:

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

ce74223a366b59bb7ea8febef9e4db1fc700136a by gbe:
mixer: make .Dt tags uppercase

The end of the build log:

[...truncated 4.19 MB...]
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9ddde0
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9dde80
ngthread() at ngthread+0x88/frame 0xfffffe009d9ddef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9ddf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9ddf30
--- trap 0xc, rip = 0x3a1ec2b9bd9a, rsp = 0x7fffff17a248, rbp = 0x7fffff17a340 ---

Tracing command ng_queue pid 8822 tid 102119 td 0xfffffe00a7196000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7308d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7308da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7308de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7308e80
ngthread() at ngthread+0x88/frame 0xfffffe00a7308ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7308f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7308f30
--- trap 0xc, rip = 0x253299635d9a, rsp = 0x7fffda92ca88, rbp = 0x7fffda92caa0 ---

Tracing command auditd pid 673 tid 100113 td 0xfffffe009db4bac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00773ebb50
mi_switch() at mi_switch+0x157/frame 0xfffffe00773ebb70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773ebbb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00773ebc00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00773ebc10
_sleep() at _sleep+0x2dd/frame 0xfffffe00773ebcb0
audit_read() at audit_read+0x9c/frame 0xfffffe00773ebce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00773ebd40
dofileread() at dofileread+0x81/frame 0xfffffe00773ebd90
sys_read() at sys_read+0xc0/frame 0xfffffe00773ebe00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00773ebf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00773ebf30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x2e1b4dce215a, rsp = 0x7fffff779698, rbp = 0x7fffff7796e0 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe00775aac80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b52a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b52a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b52a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b52ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b52ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b52b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b52c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b52e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b52f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b52f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b32cf3b033a, rsp = 0x7fffffbd9b88, rbp = 0x7fffffbd9c40 ---

Tracing command sh pid 738 tid 100112 td 0xfffffe009db4c1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00773f0a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00773f0a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773f0a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00773f0ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00773f0ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00773f0b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00773f0c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00773f0e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00773f0f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00773f0f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x10baeea0033a, rsp = 0x7fffff27eb48, rbp = 0x7fffff27ec00 ---

Tracing command sh pid 745 tid 100091 td 0xfffffe00775aa560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b4da10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b4da30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b4da70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b4dac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b4dad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b4db70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b4dc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b4de00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b4df30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b4df30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1bf3e447e33a, rsp = 0x7fffff6db498, rbp = 0x7fffff6db550 ---

Tracing command kyua pid 746 tid 100098 td 0xfffffe0009988900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a40a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a40a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a40a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a40ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063a40ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063a40b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063a40c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063a40e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a40f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a40f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x1f9c5044433a, rsp = 0x7fffffdc9218, rbp = 0x7fffffdc9250 ---

Tracing command aiod31 pid 58254 tid 100562 td 0xfffffe00a718a1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7213d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7213d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7213dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7213e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7213ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a7213ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7213f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7213f30
--- trap 0xc, rip = 0x174da3b97d9a, rsp = 0x7fffff8e4988, rbp = 0x7fffff8e4a80 ---

Tracing command soaiod1 pid 58262 tid 101392 td 0xfffffe00a76a01e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a99bcd70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a99bcd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a99bcdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a99bce10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a99bceb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a99bcef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a99bcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a99bcf30
--- trap 0xc, rip = 0x1e218c90ad9a, rsp = 0x7fffffad6368, rbp = 0x7fffffad6380 ---

Tracing command soaiod2 pid 58263 tid 101391 td 0xfffffe00a7a26720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a728bd70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a728bd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a728bdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a728be10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a728beb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a728bef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a728bf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a728bf30
--- trap 0xc, rip = 0x31f044d75d9a, rsp = 0x7fffff33bb28, rbp = 0x7fffff33bb40 ---

Tracing command soaiod3 pid 58264 tid 101390 td 0xfffffe00a7196e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a72c7d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a72c7d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a72c7dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a72c7e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a72c7eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a72c7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a72c7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a72c7f30
--- trap 0xc, rip = 0x239f50c90d9a, rsp = 0x7fffff3c1598, rbp = 0x7fffff3c15b0 ---

Tracing command soaiod4 pid 58265 tid 101389 td 0xfffffe00a96723a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7286d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7286d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7286dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7286e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7286eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a7286ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7286f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7286f30
--- trap 0xc, rip = 0x33e9f753bd9a, rsp = 0x7fffff612d98, rbp = 0x7fffff612db0 ---

Tracing command g_mp_kt pid 968 tid 101386 td 0xfffffe00a714e740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a99d5da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a99d5dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a99d5e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a99d5ea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00a99d5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a99d5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a99d5f30
--- trap 0xc, rip = 0x198a4373d9a, rsp = 0x7fffff7f8fa8, rbp = 0x7fffff7f90a0 ---

Tracing command md0 pid 21637 tid 100119 td 0xfffffe009dbae3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bcfda0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bcfdc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bcfe00
_sleep() at _sleep+0x2e7/frame 0xfffffe0063bcfea0
md_kthread() at md_kthread+0xd5/frame 0xfffffe0063bcfef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bcff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bcff30
--- trap 0xc, rip = 0x3f8acff89d9a, rsp = 0x7fffff33dc18, rbp = 0x7fffff33dd10 ---

Tracing command kyua pid 56883 tid 102573 td 0xfffffe00a78ac020 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cbe00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cbe10
trap() at trap+0x56/frame 0xfffffe00097cbf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cbf20
--- trap 0x13, rip = 0xffffffff810c993d, rsp = 0xfffffe00acaff750, rbp = 0xfffffe00acaff890 ---
pmap_remove_pages() at pmap_remove_pages+0x51d/frame 0xfffffe00acaff890
exec_new_vmspace() at exec_new_vmspace+0x209/frame 0xfffffe00acaff900
exec_elf64_imgact() at exec_elf64_imgact+0x877/frame 0xfffffe00acaff9f0
kern_execve() at kern_execve+0x70d/frame 0xfffffe00acaffd80
sys_execve() at sys_execve+0x5a/frame 0xfffffe00acaffe00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00acafff30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00acafff30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x1f9c5044141a, rsp = 0x7fffffdc8d88, rbp = 0x7fffffdc8d90 ---

Tracing command KTLS pid 3932 tid 100555 td 0xfffffe00a7198ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a727cd00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a727cd20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a727cd60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a727ce00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a727cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a727cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a727cf30
--- trap 0xc, rip = 0x2d1b999d3d9a, rsp = 0x7fffffd36c48, rbp = 0x7fffffd36c60 ---

Tracing command KTLS pid 3932 tid 102087 td 0xfffffe00a9670000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a99c6d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a99c6d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a99c6d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a99c6e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a99c6ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a99c6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a99c6f30
--- trap 0xc, rip = 0x38fbada67d9a, rsp = 0x202ea8, rbp = 0x202ec0 ---

Tracing command KTLS pid 3932 tid 102088 td 0xfffffe00a7188c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a99e9d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a99e9d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a99e9da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a99e9e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a99e9ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a99e9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a99e9f30
--- trap 0x16, rip = 0x2fa86e5a5d9a, rsp = 0xc07a88, rbp = 0xc07aa0 ---
db:0:kdb.enter.panic> dump
Dumping 504 out of 4058 MB:..4%..13%..23%..32%..42%..51%..61%..73%..83%..93%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19861' --destroy
+ sh -ex freebsd-ci/scripts/test/
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./
x ./
x ./
x ./
x ./auto-shutdown
x ./
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/
+ ./freebsd-ci/artifact/
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'ce74223a366b59bb7ea8febef9e4db1fc700136a', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../ce74223a366b59bb7ea8febef9e4db1fc700136a/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address