FreeBSD-main-amd64-test - Build #19834 - Failure

FreeBSD-main-amd64-test - Build #19834 (2e946f8705581f2e9370e98a657bead36582fb2a) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19834/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19834/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19834/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

2e946f8705581f2e9370e98a657bead36582fb2a by allanjude:
Fix ZFS module build



The end of the build log:

[...truncated 3.92 MB...]
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5db6f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5db6f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Tracing command soaiod1 pid 2203 tid 100134 td 0xfffffe009dbe9900
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dedd70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dedd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5deddd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5dede10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5dedeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a5dedef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dedf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dedf30
--- trap 0xc, rip = 0x26235f90bd9a, rsp = 0x7fffff105008, rbp = 0x7fffff105020 ---

Tracing command soaiod2 pid 2204 tid 100133 td 0xfffffe009dbea020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5df2d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5df2d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5df2dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5df2e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5df2eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a5df2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5df2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5df2f30
--- trap 0xc, rip = 0x22a1544d7d9a, rsp = 0x7fffffbb67a8, rbp = 0x7fffffbb67c0 ---

Tracing command soaiod3 pid 2205 tid 100132 td 0xfffffe009dbea740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5df7d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5df7d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5df7dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5df7e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5df7eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a5df7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5df7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5df7f30
--- trap 0xc, rip = 0xb6564ec4d9a, rsp = 0x7fffff90ef38, rbp = 0x7fffff90ef50 ---

Tracing command soaiod4 pid 2206 tid 100131 td 0xfffffe009dbf3000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5dfcd70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5dfcd90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5dfcdd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a5dfce10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a5dfceb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a5dfcef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5dfcf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5dfcf30
--- trap 0xc, rip = 0x17d8164c8d9a, rsp = 0x7fffff6df498, rbp = 0x7fffff6df4b0 ---

Tracing command devd pid 477 tid 100088 td 0xfffffe00775a9ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b5ca60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b5ca80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b5cac0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b5cb10
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0063b5cb50
_cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x19a/frame 0xfffffe0063b5cbd0
kern_select() at kern_select+0xa6f/frame 0xfffffe0063b5cdc0
sys_select() at sys_select+0x56/frame 0xfffffe0063b5ce00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b5cf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b5cf30
--- syscall (93, FreeBSD ELF64, sys_select), rip = 0x28b2ba, rsp = 0x7fffffa0dcc8, rbp = 0x7fffffa0fe60 ---

Tracing command auditd pid 673 tid 100094 td 0xfffffe00775a7000
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b3eb50
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b3eb70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b3ebb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b3ec00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b3ec10
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b3ecb0
audit_read() at audit_read+0x9c/frame 0xfffffe0063b3ece0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0063b3ed40
dofileread() at dofileread+0x81/frame 0xfffffe0063b3ed90
sys_read() at sys_read+0xc0/frame 0xfffffe0063b3ee00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b3ef30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b3ef30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x1483f2d3b15a, rsp = 0x7fffffaa08b8, rbp = 0x7fffffaa0900 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe00775a8c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b52a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b52a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b52a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b52ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b52ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b52b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b52c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b52e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b52f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b52f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x115358bdd33a, rsp = 0x7fffff561498, rbp = 0x7fffff561550 ---

Tracing command sh pid 738 tid 100091 td 0xfffffe00775a8560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b4da10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b4da30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b4da70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b4dac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b4dad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b4db70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b4dc00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b4de00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b4df30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b4df30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2745a582c33a, rsp = 0x7fffffb40768, rbp = 0x7fffffb40820 ---

Tracing command KTLS pid 47848 tid 100827 td 0xfffffe00a6a321e0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9a1d00
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9a1d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9a1d60
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9a1e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe009d9a1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9a1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9a1f30
--- trap 0xc, rip = 0x93a10a91d9a, rsp = 0x7fffffa14898, rbp = 0x7fffffa148b0 ---

Tracing command KTLS pid 47848 tid 100833 td 0xfffffe00a6a291e0
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9f1d00
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9f1d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9f1d60
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9f1e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe009d9f1ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9f1f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9f1f30
--- trap 0x16, rip = 0x33d038d29d9a, rsp = 0x805a88, rbp = 0x805aa0 ---

Tracing command KTLS pid 47848 tid 100834 td 0xfffffe00a6a2a020
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9e7d40
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9e7d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9e7da0
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9e7e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe009d9e7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9e7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9e7f30
--- trap 0x16, rip = 0x33d038d29d9a, rsp = 0x202a88, rbp = 0x202aa0 ---

Tracing command sh pid 745 tid 100107 td 0xfffffe00775aa900
sched_switch() at sched_switch+0x559/frame 0xfffffe00773f7a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00773f7a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00773f7a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00773f7ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00773f7ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00773f7b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00773f7c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00773f7e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00773f7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00773f7f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x21476cdd933a, rsp = 0x7fffffe0f838, rbp = 0x7fffffe0f8f0 ---

Tracing command kyua pid 746 tid 100100 td 0xfffffe0009988900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063a40a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063a40a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063a40a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063a40ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063a40ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063a40b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063a40c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063a40e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063a40f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063a40f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x39d52fa3833a, rsp = 0x7fffffdb3818, rbp = 0x7fffffdb3850 ---

Tracing command kyua pid 1232 tid 101146 td 0xfffffe00aa936560 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cbe00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cbe10
trap() at trap+0x56/frame 0xfffffe00097cbf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cbf20
--- trap 0x13, rip = 0xffffffff80f85c7b, rsp = 0xfffffe00aaac7730, rbp = 0xfffffe00aaac7730 ---
PHYS_TO_VM_PAGE() at PHYS_TO_VM_PAGE+0x1b/frame 0xfffffe00aaac7730
pmap_remove_pages() at pmap_remove_pages+0x942/frame 0xfffffe00aaac7880
exec_new_vmspace() at exec_new_vmspace+0x209/frame 0xfffffe00aaac78f0
exec_elf64_imgact() at exec_elf64_imgact+0x8a7/frame 0xfffffe00aaac79f0
kern_execve() at kern_execve+0x70d/frame 0xfffffe00aaac7d80
sys_execve() at sys_execve+0x5a/frame 0xfffffe00aaac7e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00aaac7f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00aaac7f30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x39d52fa3541a, rsp = 0x7fffffdb3388, rbp = 0x7fffffdb3390 ---

Tracing command ng_queue pid 52738 tid 100101 td 0xfffffe00099881e0
sched_switch() at sched_switch+0x559/frame 0xfffffe00085ffd80
mi_switch() at mi_switch+0x157/frame 0xfffffe00085ffda0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00085ffde0
_sleep() at _sleep+0x2e7/frame 0xfffffe00085ffe80
ngthread() at ngthread+0x88/frame 0xfffffe00085ffef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00085fff30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00085fff30
--- trap 0xc, rip = 0x1e8455bc3d9a, rsp = 0x7fffffe5c1c8, rbp = 0x7fffffe5c2c0 ---

Tracing command ng_queue pid 52738 tid 100865 td 0xfffffe00a6a2fe40
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9e2d80
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9e2da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9e2de0
_sleep() at _sleep+0x2e7/frame 0xfffffe009d9e2e80
ngthread() at ngthread+0x88/frame 0xfffffe009d9e2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9e2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9e2f30
--- trap 0xc04a80f, rip = 0x7fff67a7902b, rsp = 0x52613a53408, rbp = 0x7fffff3d1f70 ---

Tracing command g_mp_kt pid 44884 tid 100097 td 0xfffffe00775c5e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b9dda0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b9ddc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b9de00
_sleep() at _sleep+0x2e7/frame 0xfffffe0063b9dea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe0063b9def0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b9df30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b9df30
--- trap 0xc, rip = 0xb00c8177d9a, rsp = 0x7fffffcec658, rbp = 0x7fffffcec670 ---
db:0:kdb.enter.panic> dump
Dumping 455 out of 4058 MB:..4%..11%..22%..32%..43%..53%..64%..71%..81%..92%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19834' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-zfs-tests.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
x ./run-kyua.sh
x ./run.sh
x ./disable-dtrace-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins1391330816860710145.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '2e946f8705581f2e9370e98a657bead36582fb2a', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../2e946f8705581f2e9370e98a657bead36582fb2a/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address