FreeBSD-main-amd64-test - Build #28329 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Sun, 19 Apr 2026 00:01:34 UTC
FreeBSD-main-amd64-test - Build #28329 (1c50cb1d75625bea2ba928697ea1cbafa29dd245) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28329/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28329/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28329/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

38f28119183e997231ed4a8c0d5e42f55e0a2efa by bz:
iwlwifi: update Intel's mvm/mld drivers

5927bf24daca1f63e6a7100df68c7343f48258aa by bz:
mt76: update Mediatek's mt76 driver

777767fb72f8fdc7a20023ca89d7a28edf3e26c1 by bz:
rtw89: update Realtek's rtw89 driver

9ed3331fb5822b93313edae42cc529eb25e1a6cc by bz:
iwlwifi: update module Makefile for v7.0 driver version

3780e6f9db01cc4f7d53d67ed1fc992a8f64c53f by bz:
rtw89: update module Makefile for v7.0 driver version

1c50cb1d75625bea2ba928697ea1cbafa29dd245 by bz:
mt76: update module Makefile for v7.0 driver version



The end of the build log:

[...truncated 4.17 MiB...]
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [0.516s]
sys/netinet/output:output_raw_flowid_mpath_success  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 58:9c:fc:10:87:6d
epair1b: Ethernet address: 58:9c:fc:10:96:03
epair1a: link state changed to UP
epair1b: link state changed to UP
lo1: link state changed to UP
lo2: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [0.934s]
sys/netinet/output:output_raw_success  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.216s]
sys/netinet/output:output_tcp_flowid_mpath_success  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 58:9c:fc:10:87:6d
epair1b: Ethernet address: 58:9c:fc:10:96:03
epair1a: link state changed to UP
epair1b: link state changed to UP
lo1: link state changed to UP
lo2: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [3.481s]
sys/netinet/output:output_tcp_setup_success  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [0.350s]
sys/netinet/output:output_udp_flowid_mpath_success  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 58:9c:fc:10:87:6d
epair1b: Ethernet address: 58:9c:fc:10:96:03
epair1a: link state changed to UP
epair1b: link state changed to UP
lo1: link state changed to UP
lo2: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [8.950s]
sys/netinet/output:output_udp_setup_success  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [1.379s]
sys/netinet/raw:input  ->  lo0: link state changed to UP
passed  [0.067s]
sys/netinet/raw:reconnect  ->  lo0: link state changed to UP
passed  [0.059s]
sys/netinet/redirect:valid_redirect  ->  epair0a: Ethernet address: 58:9c:fc:10:b5:ca
epair0b: Ethernet address: 58:9c:fc:10:2b:10
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed  [2.250s]
sys/netinet/so_reuseport_lb_test:basic_ipv4  ->  Limiting tcp reset response from 7550 to 201 packets/sec
Limiting tcp reset response from 7542 to 214 packets/sec
passed  [2.140s]
sys/netinet/so_reuseport_lb_test:basic_ipv6  ->  Limiting tcp reset response from 6804 to 189 packets/sec
Limiting tcp reset response from 6792 to 199 packets/sec
passed  [2.421s]
sys/netinet/so_reuseport_lb_test:bind_without_listen  ->  passed  [0.009s]
sys/netinet/so_reuseport_lb_test:concurrent_add  ->  passed  [2.609s]
sys/netinet/so_reuseport_lb_test:connect_bound  ->  passed  [0.010s]
sys/netinet/so_reuseport_lb_test:connect_not_bound  ->  passed  [0.007s]
sys/netinet/so_reuseport_lb_test:connect_udp  ->  passed  [0.211s]
sys/netinet/so_reuseport_lb_test:connect_udp6  ->  passed  [0.209s]
sys/netinet/so_reuseport_lb_test:double_listen_ipv4  ->  passed  [0.007s]
sys/netinet/so_reuseport_lb_test:double_listen_ipv6  ->  passed  [0.007s]
sys/netinet/socket_afinet:socket_afinet  ->  passed  [0.007s]
sys/netinet/socket_afinet:socket_afinet_bind_connected_port  ->  passed  [0.011s]
sys/netinet/socket_afinet:socket_afinet_bind_ok  ->  passed  [0.008s]
sys/netinet/socket_afinet:socket_afinet_bind_zero  ->  passed  [0.007s]
sys/netinet/socket_afinet:socket_afinet_bindany  ->  passed  [0.008s]
sys/netinet/socket_afinet:socket_afinet_multibind  ->  passed  [0.198s]
sys/netinet/socket_afinet:socket_afinet_poll_no_rdhup  ->  passed  [0.008s]
sys/netinet/socket_afinet:socket_afinet_poll_rdhup  ->  passed  [0.007s]
sys/netinet/socket_afinet:socket_afinet_stream_reconnect  ->  passed  [0.007s]
sys/netinet/tcp_connect_port_test:basic_ipv4  ->  Limiting tcp reset response from 3611 to 196 packets/sec
Limiting tcp reset response from 8918 to 202 packets/sec
Limiting tcp reset response from 8878 to 215 packets/sec
Limiting tcp reset response from 8958 to 203 packets/sec
Limiting tcp reset response from 8949 to 190 packets/sec
Limiting tcp reset response from 8931 to 208 packets/sec
Limiting tcp reset response from 9007 to 188 packets/sec
Limiting tcp reset response from 9145 to 210 packets/sec
passed  [7.236s]
sys/netinet/tcp_connect_port_test:basic_ipv6  ->  Limiting tcp reset response from 7603 to 194 packets/sec
Limiting tcp reset response from 7640 to 201 packets/sec
Limiting tcp reset response from 7730 to 208 packets/sec
Limiting tcp reset response from 7765 to 196 packets/sec
Limiting tcp reset response from 7609 to 209 packets/sec
Limiting tcp reset response from 7524 to 194 packets/sec
Limiting tcp reset response from 7660 to 215 packets/sec
Limiting tcp reset response from 7595 to 185 packets/sec
passed  [8.526s]
TCP HPTS started 2 ((unbounded)) swi interrupt threads
sys/netinet/tcp_hpts_test.py:TestTcpHpts::test_concurrent_operations  ->  passed  [0.568s]
sys/netinet/tcp_hpts_test.py:TestTcpHpts::test_cpu_assignment  ->  passed  [0.574s]
sys/netinet/tcp_hpts_test.py:TestTcpHpts::test_deferred_requests  ->  Kernel page fault with the following non-sleepable locks held:
exclusive rw test-inp (test-inp) r = 0 (0xfffff80195014030) locked @ /usr/src/sys/netinet/tcp_hpts.c:1275
Kernel page fault with 1 sleep inhibitors
stack backtrace:
#0 0xffffffff80c54c1c at witness_debugger+0x6c
#1 0xffffffff80c56529 at witness_warn+0x4c9
#2 0xffffffff8113ccdc at trap_pfault+0x8c
#3 0xffffffff8110c328 at calltrap+0x8
#4 0xffffffff8315f866 at __ktest_deferred_requests+0x996
#5 0xffffffff830e3abd at run_test+0x2ad
#6 0xffffffff80e6deac at nl_receive_message+0x11c
#7 0xffffffff80e6d7f5 at nl_taskqueue_handler+0x3e5
#8 0xffffffff80c468f2 at taskqueue_run_locked+0x1c2
#9 0xffffffff80c477e3 at taskqueue_thread_loop+0xd3
#10 0xffffffff80b899d2 at fork_exit+0x82
#11 0xffffffff8110d34e at fork_trampoline+0xe


Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 01
fault virtual address	= 0xc8
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff8316a3f1
stack pointer	        = 0:0xfffffe008c0e0ab0
frame pointer	        = 0:0xfffffe008c0e0bd0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 0 (netlink_socket (PID)
rdi: fffff800033b1e00 rsi: 0000000000000001 rdx: ffffffff82268848
rcx: 0000000000000001  r8: ffffffff81ad2ae0  r9: 0000000000000001
rax: 0000000000000000 rbx: 0000000000002000 rbp: fffffe008c0e0bd0
r10: 0000000000000000 r11: 0000000000000001 r12: fffff80195014000
r13: 0000000000000000 r14: fffff80195014048 r15: 0000000000001388
trap number		= 12
panic: page fault
cpuid = 1
time = 1776556884
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008c0e07e0
vpanic() at vpanic+0x136/frame 0xfffffe008c0e0910
panic() at panic+0x43/frame 0xfffffe008c0e0970
trap_pfault() at trap_pfault+0x422/frame 0xfffffe008c0e09e0
calltrap() at calltrap+0x8/frame 0xfffffe008c0e09e0
--- trap 0xc, rip = 0xffffffff8316a3f1, rsp = 0xfffffe008c0e0ab0, rbp = 0xfffffe008c0e0bd0 ---
tcp_hptsi() at tcp_hptsi+0x6f1/frame 0xfffffe008c0e0bd0
__ktest_deferred_requests() at __ktest_deferred_requests+0x996/frame 0xfffffe008c0e0c60
run_test() at run_test+0x2ad/frame 0xfffffe008c0e0d00
nl_receive_message() at nl_receive_message+0x11c/frame 0xfffffe008c0e0d40
nl_taskqueue_handler() at nl_taskqueue_handler+0x3e5/frame 0xfffffe008c0e0e40
taskqueue_run_locked() at taskqueue_run_locked+0x1c2/frame 0xfffffe008c0e0ec0
taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame 0xfffffe008c0e0ef0
fork_exit() at fork_exit+0x82/frame 0xfffffe008c0e0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008c0e0f30
--- trap 0xc, rip = 0x2fcc41494d0a, rsp = 0x2fcc4347be88, rbp = 0x2fcc4347bea0 ---
KDB: enter: panic
[ thread pid 0 tid 107431 ]
Stopped at      kdb_enter+0x33: movq    $0,0x15dd302(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid        = 1
dynamic pcpu = 0xfffffe008d3bccc0
curthread    = 0xfffff800531d0780: pid 0 tid 107431 critnest 1 "netlink_socket (PID"
curpcb       = 0xfffff800531d0cd0
fpcurthread  = none
idlethread   = 0xfffff8010240c000: tid 100004 "idle: cpu1"
self         = 0xffffffff82a11000
curpmap      = 0xffffffff81da2d20
tssp         = 0xffffffff82a11384
rsp0         = 0xfffffe008c0e1000
kcr3         = 0x8000000002946002
ucr3         = 0xffffffffffffffff
scr3         = 0xb4e06ded
gs32p        = 0xffffffff82a11404
ldt          = 0xffffffff82a11444
tss          = 0xffffffff82a11434
curvnet      = 0xfffff800030e7ec0
spin locks held:
db:0:kdb.enter.panic>  reset
Uptime: 52m46s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-28329' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-zfs-tests.sh
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./run.sh
x ./disable-notyet-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins3686200618729033354.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '1c50cb1d75625bea2ba928697ea1cbafa29dd245', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../1c50cb1d75625bea2ba928697ea1cbafa29dd245/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address