FreeBSD-main-amd64-test - Build #28507 - Failure
Date: Sun, 17 May 2026 10:24:53 UTC
FreeBSD-main-amd64-test - Build #28507 (b99954433d42d978b257e846dbfe568e9af7b140) - Failure
Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28507/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28507/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28507/console
Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
this is a notification to note that these changes have
not been fully tested by the CI system
Change summaries:
(Those commits are likely but not certainly responsible)
b99954433d42d978b257e846dbfe568e9af7b140 by markj:
linux: Fix some problems with header pollution
The end of the build log:
[...truncated 4.20 MiB...]
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bb2f41 at __mtx_lock_flags+0x91
#2 0xffffffff82eeb6be at ovpn_peer_release_ref+0x20e
#3 0xffffffff82ee7b62 at ovpn_clone_destroy+0x92
#4 0xffffffff80d28d3c at if_clone_destroyif_flags+0x8c
#5 0xffffffff80d29656 at if_clone_detach+0x106
#6 0xffffffff82eed695 at ovpn_prison_remove+0x55
#7 0xffffffff80bb6e02 at osd_call+0xb2
#8 0xffffffff80b93f5c at prison_deref+0x5dc
#9 0xffffffff80b95a67 at sys_jail_remove+0x1a7
#10 0xffffffff811408aa at amd64_syscall+0x45a
#11 0xffffffff8110f75b at fast_syscall_common+0xf8
hardcoded lock order "so_snd"(sleep mutex) -> "so_rcv"(sleep mutex) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bb2f41 at __mtx_lock_flags+0x91
#2 0xffffffff80c9110f at soreserve+0x5f
#3 0xffffffff80e51fa5 at udp6_attach+0x75
#4 0xffffffff80c94348 at soattach+0xf8
#5 0xffffffff80c93bfc at socreate+0x19c
#6 0xffffffff80c9dbfe at kern_socket+0xbe
#7 0xffffffff811405b8 at amd64_syscall+0x168
#8 0xffffffff8110f75b at fast_syscall_common+0xf8
lock order "if_ovpn_lock"(rm) -> "so_rcv"(sleep mutex) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bb2f41 at __mtx_lock_flags+0x91
#2 0xffffffff82eeb693 at ovpn_peer_release_ref+0x1e3
#3 0xffffffff82ee7b62 at ovpn_clone_destroy+0x92
#4 0xffffffff80d28d3c at if_clone_destroyif_flags+0x8c
#5 0xffffffff80d29656 at if_clone_detach+0x106
#6 0xffffffff82eed695 at ovpn_prison_remove+0x55
#7 0xffffffff80bb6e02 at osd_call+0xb2
#8 0xffffffff80b93f5c at prison_deref+0x5dc
#9 0xffffffff80b95a67 at sys_jail_remove+0x1a7
#10 0xffffffff811408aa at amd64_syscall+0x45a
#11 0xffffffff8110f75b at fast_syscall_common+0xf8
lock order "so_rcv"(sleep mutex) -> "tcphash"(sleep mutex) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bb2f41 at __mtx_lock_flags+0x91
#2 0xffffffff80dcbc73 at in_pcbbind+0xb3
#3 0xffffffff80e0c9b4 at tcp_usr_listen+0x114
#4 0xffffffff80c954e1 at solisten+0x41
#5 0xffffffff80c9e0df at kern_listen+0x6f
#6 0xffffffff811408aa at amd64_syscall+0x45a
#7 0xffffffff8110f75b at fast_syscall_common+0xf8
hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bd3969 at _rm_rlock_debug+0x129
#2 0xffffffff80e2fee9 at in6_selectsrc+0x3e9
#3 0xffffffff80e2fa95 at in6_selectsrc_socket+0x75
#4 0xffffffff80e2cdfd at in6_pcbconnect+0x25d
#5 0xffffffff80e0fcd3 at tcp6_connect+0x83
#6 0xffffffff80e0d77a at tcp6_usr_connect+0x2da
#7 0xffffffff80c964a6 at soconnectat+0xc6
#8 0xffffffff80c9e8e1 at kern_connectat+0xe1
#9 0xffffffff80c9e7d3 at sys_connect+0x73
#10 0xffffffff811408aa at amd64_syscall+0x45a
#11 0xffffffff8110f75b at fast_syscall_common+0xf8
lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bd5b0d at __rw_rlock_int+0x7d
#2 0xffffffff80e2230b at in6_lltable_lookup+0x10b
#3 0xffffffff80e40f51 at nd6_lookup+0x81
#4 0xffffffff80e4c81e at find_pfxlist_reachable_router+0x7e
#5 0xffffffff80e4c646 at pfxlist_onlink_check+0x3c6
#6 0xffffffff80e49f96 at nd6_ra_input+0x1806
#7 0xffffffff80e195c0 at icmp6_input+0x5b0
#8 0xffffffff80e340c5 at ip6_input+0xbb5
#9 0xffffffff80d49574 at netisr_dispatch_src+0xb4
#10 0xffffffff80d2afca at ether_demux+0x16a
#11 0xffffffff80d2c54e at ether_nh_input+0x3ce
#12 0xffffffff80d49574 at netisr_dispatch_src+0xb4
#13 0xffffffff80d2b415 at ether_input+0xd5
#14 0xffffffff82ee1b54 at epair_tx_start_deferred+0xd4
#15 0xffffffff80c4726e at taskqueue_run_locked+0x1ce
#16 0xffffffff80c48163 at taskqueue_thread_loop+0xd3
#17 0xffffffff80b89fe2 at fork_exit+0x82
lock order "if_ovpn_lock"(rm) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bb2f41 at __mtx_lock_flags+0x91
#2 0xffffffff80db687d at arpresolve+0x34d
#3 0xffffffff80d2a840 at ether_output+0x300
#4 0xffffffff80dd983d at ip_output+0x183d
#5 0xffffffff82eecd46 at ovpn_encap+0x6b6
#6 0xffffffff82eecee7 at ovpn_encrypt_tx_cb+0x137
#7 0xffffffff80ff26aa at aesni_process+0xea
#8 0xffffffff80f01e6a at crypto_invoke+0x7a
#9 0xffffffff80f00af9 at crypto_dispatch_one+0xe9
#10 0xffffffff82eec558 at ovpn_transmit_to_peer+0x658
#11 0xffffffff82eebc99 at ovpn_send_ping+0x119
#12 0xffffffff80bf8af5 at softclock_call_cc+0x195
#13 0xffffffff80bfa206 at softclock_thread+0xc6
#14 0xffffffff80b89fe2 at fork_exit+0x82
#15 0xffffffff8110fe8e at fork_trampoline+0xe
lock order "lltable"(sleep mutex) -> "lle"(rw) first seen at:
#0 0xffffffff80c54704 at witness_checkorder+0x364
#1 0xffffffff80bd4dc5 at _rw_wlock_cookie+0x65
#2 0xffffffff80e4316c at nd6_add_ifa_lle+0xcc
#3 0xffffffff80e1fb90 at in6_update_ifa+0xdb0
#4 0xffffffff80e1e67f at in6_addifaddr+0x7f
#5 0xffffffff80e1e4c1 at in6_control_ioctl+0x9b1
#6 0xffffffff80e72fce at rtnl_handle_addr+0x62e
#7 0xffffffff80e70555 at rtnl_handle_message+0x195
#8 0xffffffff80e6ed3c at nl_receive_message+0x11c
#9 0xffffffff80e6e685 at nl_taskqueue_handler+0x3f5
#10 0xffffffff80c4726e at taskqueue_run_locked+0x1ce
#11 0xffffffff80c48163 at taskqueue_thread_loop+0xd3
#12 0xffffffff80b89fe2 at fork_exit+0x82
#13 0xffffffff8110fe8e at fork_trampoline+0xe
lock order lle -> in6_multi_list_mtx attempted at:
#0 0xffffffff80c55053 at witness_checkorder+0xcb3
#1 0xffffffff80bb2f41 at __mtx_lock_flags+0x91
#2 0xffffffff80e22751 at in6_lltable_delete_entry+0xc1
#3 0xffffffff80d2ea1a at lltable_delete_addr+0xda
#4 0xffffffff80e73c4b at rtnl_handle_delneigh+0x7b
#5 0xffffffff80e704f2 at rtnl_handle_message+0x132
#6 0xffffffff80e6ed3c at nl_receive_message+0x11c
#7 0xffffffff80e6e685 at nl_taskqueue_handler+0x3f5
#8 0xffffffff80c4726e at taskqueue_run_locked+0x1ce
#9 0xffffffff80c48163 at taskqueue_thread_loop+0xd3
#10 0xffffffff80b89fe2 at fork_exit+0x82
#11 0xffffffff8110fe8e at fork_trampoline+0xe
lock order reversal: (sleepable after non-sleepable)
1st 0xfffff8007833b290 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2461
2nd 0xffffffff822fbc60 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1329
lock order lle -> in6_multi_sx attempted at:
#0 0xffffffff80c55053 at witness_checkorder+0xcb3
#1 0xffffffff80be4c10 at _sx_xlock+0x60
#2 0xffffffff80e28ed7 at in6_leavegroup+0x27
#3 0xffffffff80e2279c at in6_lltable_delete_entry+0x10c
#4 0xffffffff80d2ea1a at lltable_delete_addr+0xda
#5 0xffffffff80e73c4b at rtnl_handle_delneigh+0x7b
#6 0xffffffff80e704f2 at rtnl_handle_message+0x132
#7 0xffffffff80e6ed3c at nl_receive_message+0x11c
#8 0xffffffff80e6e685 at nl_taskqueue_handler+0x3f5
#9 0xffffffff80c4726e at taskqueue_run_locked+0x1ce
#10 0xffffffff80c48163 at taskqueue_thread_loop+0xd3
#11 0xffffffff80b89fe2 at fork_exit+0x82
#12 0xffffffff8110fe8e at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [5.230s]
sys/netinet6/proxy_ndp:pndp_ifdestroy_success -> epair0a: Ethernet address: 4e:0b:e2:fe:65:2d
epair0b: Ethernet address: 4a:63:d1:5b:74:43
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [1.752s]
sys/netinet6/proxy_ndp:pndp_neighbor_advert -> epair0a: Ethernet address: 5a:1a:e8:e9:ac:e0
epair0b: Ethernet address: 4e:4d:60:c1:8f:b4
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [4.229s]
sys/netinet6/redirect:valid_redirect -> epair0a: Ethernet address: 6a:90:94:18:61:d6
epair0b: Ethernet address: ca:7e:07:f8:75:c5
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [3.390s]
sys/netinet6/scapyi386:scapyi386 -> epair0a: Ethernet address: d6:db:eb:c3:33:f5
epair0b: Ethernet address: e2:3b:bb:15:73:93
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [4.448s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop -> broken: Test case body timed out [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[empty] -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ifsame] -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ipandif] -> broken: Test case body timed out [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[iponly1] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[nolocalip] -> broken: Test case body timed out [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLL::test_output6_linklocal -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-no_sav] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-sav] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-no_sav] -> broken: Test case body timed out [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-sav] -> broken: Test case body timed out [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-no_sav] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-sav] -> broken: Test case body timed out [300.007s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-no_sav] -> broken: Test case body timed out [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-sav] -> broken: Test case body timed out [300.006s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-no_sav] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-sav] -> 2026-05-17T10:23:51.560673+00:00 - auditd 1542 - - auditd_wait_for_events: SIGTERM
2026-05-17T10:23:51.563745+00:00 - auditd 1542 - - Auditing disabled
2026-05-17T10:23:51.565084+00:00 - auditd 1542 - - renamed /var/audit/20260517042656.not_terminated to /var/audit/20260517042656.20260517102351
2026-05-17T10:23:51.567376+00:00 - auditd 1542 - - Finished
2026-05-17T10:24:11.578165+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 0 0 done
All buffers synced.
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-28507' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./disable-zfs-tests.sh
x ./auto-shutdown
x ./run.sh
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins3064854802162399281.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'b99954433d42d978b257e846dbfe568e9af7b140', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../b99954433d42d978b257e846dbfe568e9af7b140/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address