FreeBSD-main-amd64-test - Build #19993 - Failure

From: <>
Date: Sat, 04 Dec 2021 17:53:05 UTC
FreeBSD-main-amd64-test - Build #19993 (8ea363c8c648fd6b9c353bd37551ebb9d25cdd83) - Failure

Build information:
Full change log:
Full build log:

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

b7f127b6e5f9febff895da9230c3269dfcd971c2 by cy:
ipfilter: Save a word of stack space

2d74fed5be523370345af10fdccd0b4fc8baa53e by cy:
ipfilter: Compat and simplify DTrace macro definitions

fca9c3871dddb75d62e06386f750363f549cb069 by cy:
ipfilter: Whitespace cleanup

ca8bf28e1ee6ff213338c2a111069f5e639ea03a by cy:
ipfilter: New DT5 DTrace macro

106f42596e4b61c26425735a3999bd51d39dd82c by cy:
ipfilter: Add DTrace SDT probe

06b96a4bd606999538a1ca2f408342bf8540acb4 by cy:
ipfilter: Correct function description

1ca73c39a54750a4a2f584efd7c57f453bf7dbbe by cy:
ipfilter: Correct a comment and add notation

130df64793d7d3c680c0f7177a707867a8a19665 by cy:
ipfilter: Avoid more null if-then-else blocks

31537ea583c0965fe22498d52831ced4b4f4fc5e by tuexen:
tcpdrop: allow TCP connections to be filtered by cc-algo

8ea363c8c648fd6b9c353bd37551ebb9d25cdd83 by tuexen:
tcpdrop: explicitly choose TCP as the transport protocol

The end of the build log:

[...truncated 4.00 MB...]
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7c36e20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7c36ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a7c36ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7c36f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7c36f30
--- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 ---

Tracing command zfskern pid 29198 tid 100277 td 0xfffffe00a79f8000
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7c31c20
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7c31c40
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7c31c80
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7c31cc0
_cv_timedwait_sbt() at _cv_timedwait_sbt+0x19a/frame 0xfffffe00a7c31d40
l2arc_feed_thread() at l2arc_feed_thread+0x274/frame 0xfffffe00a7c31ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7c31f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7c31f30
--- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 ---

Tracing command zfskern pid 29198 tid 100278 td 0xfffffe00a79f1740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7c2cdc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7c2cde0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7c2ce20
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7c2cec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00a7c2cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7c2cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7c2cf30
--- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 ---

Tracing command zfskern pid 29198 tid 100279 td 0xfffffe00a79f1020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7c27cc0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7c27ce0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7c27d20
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a7c27d70
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a7c27d80
_cv_wait_sig() at _cv_wait_sig+0x165/frame 0xfffffe00a7c27de0
zfs_zevent_wait() at zfs_zevent_wait+0x47/frame 0xfffffe00a7c27e00
sysevent_worker() at sysevent_worker+0x49/frame 0xfffffe00a7c27ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7c27f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7c27f30
--- trap 0xa5a5a5a5, rip = 0xa5a5a5a5a5a5a5a5, rsp = 0xa5a5a5a5a5a5a5a5, rbp = 0xa5a5a5a5a5a5a5a5 ---

Tracing command aiod2 pid 29207 tid 100139 td 0xfffffe009dbfc900
sched_switch() at sched_switch+0x559/frame 0xfffffe009d9aad60
mi_switch() at mi_switch+0x157/frame 0xfffffe009d9aad80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe009d9aadc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe009d9aae00
_sleep() at _sleep+0x2ce/frame 0xfffffe009d9aaea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe009d9aaef0
fork_exit() at fork_exit+0x80/frame 0xfffffe009d9aaf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009d9aaf30
--- trap 0xc, rip = 0x171ed803909a, rsp = 0x7fffff332e58, rbp = 0x7fffff332e70 ---

Tracing command auditd pid 679 tid 100103 td 0xfffffe00767d5020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5d99b50
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5d99b70
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5d99bb0
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5d99c00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5d99c10
_sleep() at _sleep+0x2dd/frame 0xfffffe00a5d99cb0
audit_read() at audit_read+0x9c/frame 0xfffffe00a5d99ce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe00a5d99d40
dofileread() at dofileread+0x81/frame 0xfffffe00a5d99d90
sys_read() at sys_read+0xc0/frame 0xfffffe00a5d99e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5d99f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5d99f30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x277a7b1f445a, rsp = 0x7fffff110588, rbp = 0x7fffff1105d0 ---

Tracing command KTLS pid 86716 tid 100121 td 0xfffffe009dbe23a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5df3d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5df3d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5df3d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5df3e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a5df3ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5df3f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5df3f30
--- trap 0xc, rip = 0x12bae1edc09a, rsp = 0x7ffffff08888, rbp = 0x7ffffff08940 ---

Tracing command KTLS pid 86716 tid 101544 td 0xfffffe00a7af3560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7cccd00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7cccd20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7cccd60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7ccce00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a7cccef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7cccf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7cccf30
--- trap 0x16, rip = 0x1e12f282a09a, rsp = 0xa06a88, rbp = 0xa06aa0 ---

Tracing command KTLS pid 86716 tid 101545 td 0xfffffe00a7afde40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7ca4d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7ca4d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7ca4da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7ca4e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a7ca4ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7ca4f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7ca4f30
--- trap 0x16, rip = 0x1e12f282a09a, rsp = 0x604a88, rbp = 0x604aa0 ---

Tracing command sh pid 731 tid 100090 td 0xfffffe00767ae560
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b81a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b81a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b81a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b81ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b81ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b81b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b81c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b81e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b81f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b81f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0xcfbe2c4b63a, rsp = 0x7fffff9af038, rbp = 0x7fffff9af0f0 ---

Tracing command sh pid 744 tid 100089 td 0xfffffe00767aec80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b86a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b86a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b86a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b86ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b86ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b86b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b86c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b86e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b86f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b86f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x37b49f47c63a, rsp = 0x7fffffc938b8, rbp = 0x7fffffc93970 ---

Tracing command sh pid 751 tid 100108 td 0xfffffe00767d1000
sched_switch() at sched_switch+0x559/frame 0xfffffe00765f8a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00765f8a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00765f8a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00765f8ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00765f8ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00765f8b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00765f8c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00765f8e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00765f8f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00765f8f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x31ae3e9ca63a, rsp = 0x7fffff26b7e8, rbp = 0x7fffff26b8a0 ---

Tracing command kyua pid 752 tid 100102 td 0xfffffe00767d5740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5d9ea10
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5d9ea30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5d9ea70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00a5d9eac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00a5d9ead0
_sleep() at _sleep+0x2dd/frame 0xfffffe00a5d9eb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00a5d9ec00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00a5d9ee00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00a5d9ef30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00a5d9ef30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x193faed0063a, rsp = 0x7fffff552b48, rbp = 0x7fffff552b80 ---

Tracing command kyua pid 40342 tid 100150 td 0xfffffe00a6a2ee40 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cde00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cde10
trap() at trap+0x56/frame 0xfffffe00097cdf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cdf20
--- trap 0x13, rip = 0xffffffff810aa9f5, rsp = 0xfffffe009d973750, rbp = 0xfffffe009d973890 ---
pmap_remove_pages() at pmap_remove_pages+0x5d5/frame 0xfffffe009d973890
exec_new_vmspace() at exec_new_vmspace+0x209/frame 0xfffffe009d973900
exec_elf64_imgact() at exec_elf64_imgact+0x877/frame 0xfffffe009d9739f0
kern_execve() at kern_execve+0x70d/frame 0xfffffe009d973d80
sys_execve() at sys_execve+0x5a/frame 0xfffffe009d973e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe009d973f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe009d973f30
--- syscall (59, FreeBSD ELF64, sys_execve), rip = 0x193faecfd71a, rsp = 0x7fffff5526b8, rbp = 0x7fffff5526c0 ---

Tracing command ng_queue pid 91646 tid 100187 td 0xfffffe00a6a8f720
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6c31d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6c31da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6c31de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6c31e80
ngthread() at ngthread+0x88/frame 0xfffffe00a6c31ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6c31f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6c31f30
--- trap 0xc, rip = 0x285e882cd09a, rsp = 0x7fffff154068, rbp = 0x7fffff154160 ---

Tracing command ng_queue pid 91646 tid 101576 td 0xfffffe00a74c1c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7c54d80
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7c54da0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7c54de0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7c54e80
ngthread() at ngthread+0x88/frame 0xfffffe00a7c54ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7c54f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7c54f30
--- trap 0x16, rip = 0x11315072b09a, rsp = 0x7fffdf083a88, rbp = 0x7fffdf083aa0 ---

Tracing command md0 pid 28244 tid 100134 td 0xfffffe009dbe3900
sched_switch() at sched_switch+0x559/frame 0xfffffe00a5db2da0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a5db2dc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a5db2e00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a5db2ea0
md_kthread() at md_kthread+0xd5/frame 0xfffffe00a5db2ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a5db2f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a5db2f30
--- trap 0xc, rip = 0x5dc15c909a, rsp = 0x7fffffe9fd98, rbp = 0x7fffffe9fdb0 ---

Tracing command g_mp_kt pid 83732 tid 100215 td 0xfffffe00a6ab6740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a6cbdda0
mi_switch() at mi_switch+0x157/frame 0xfffffe00a6cbddc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a6cbde00
_sleep() at _sleep+0x2e7/frame 0xfffffe00a6cbdea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe00a6cbdef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a6cbdf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a6cbdf30
--- trap 0xc, rip = 0x7577f1db09a, rsp = 0x7fffff89de08, rbp = 0x7fffff89df00 ---
db:0:kdb.enter.panic> dump
Dumping 489 out of 4060 MB:..4%..14%..23%..33%..43%..53%..63%..72%..82%..92%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19993' --destroy
+ sh -ex freebsd-ci/scripts/test/
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./
x ./auto-shutdown
x ./
x ./
x ./
x ./
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/
+ ./freebsd-ci/artifact/
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '8ea363c8c648fd6b9c353bd37551ebb9d25cdd83', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../8ea363c8c648fd6b9c353bd37551ebb9d25cdd83/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address