FreeBSD-main-amd64-test - Build #28202 - Failure
Date: Wed, 08 Apr 2026 15:23:22 UTC
FreeBSD-main-amd64-test - Build #28202 (cff675e83cdb6c9027e94df9d010439e42e27dee) - Failure
Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28202/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28202/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28202/console
Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
this is a notification to note that these changes have
not been fully tested by the CI system
Change summaries:
(Those commits are likely but not certainly responsible)
cff675e83cdb6c9027e94df9d010439e42e27dee by bnovkov:
netstat: Add -F support for -g
The end of the build log:
[...truncated 4.32 MiB...]
"in6_multi_list_mtx" -> "mld_mtx" -> "if_ovpn_lock" -> "so_rcv" -> "tcphash" -> "in6_ifaddr_lock" -> "lle"
hardcoded lock order "in6_multi_list_mtx"(sleep mutex) -> "mld_mtx"(sleep mutex) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80ba9111 at __mtx_lock_flags+0x91
#2 0xffffffff80e30ed1 at mld_change_state+0x81
#3 0xffffffff80e1d8de at in6_joingroup_locked+0x3ae
#4 0xffffffff80e1d504 at in6_joingroup+0x44
#5 0xffffffff80e14d4a at in6_update_ifa+0x102a
#6 0xffffffff80e1af62 at in6_ifattach+0x132
#7 0xffffffff80e16c2f at in6_if_up+0x7f
#8 0xffffffff80d171f6 at if_up+0xd6
#9 0xffffffff80d184d6 at ifhwioctl+0xdc6
#10 0xffffffff80d1992b at ifioctl+0x45b
#11 0xffffffff80c51b81 at kern_ioctl+0x2a1
#12 0xffffffff80c5187f at sys_ioctl+0x12f
#13 0xffffffff81132729 at amd64_syscall+0x169
#14 0xffffffff8110146b at fast_syscall_common+0xf8
lock order "mld_mtx"(sleep mutex) -> "if_ovpn_lock"(rm) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80bc9a49 at _rm_rlock_debug+0x129
#2 0xffffffff82ee9e37 at ovpn_output+0x57
#3 0xffffffff80e2ceb5 at ip6_output+0x19c5
#4 0xffffffff80e33175 at mld_dispatch_packet+0x325
#5 0xffffffff80e33c90 at mld_fasttimo+0x520
#6 0xffffffff80beeb1b at softclock_call_cc+0x19b
#7 0xffffffff80bf0256 at softclock_thread+0xc6
#8 0xffffffff80b80112 at fork_exit+0x82
#9 0xffffffff81101b9e at fork_trampoline+0xe
lock order "if_ovpn_lock"(rm) -> "so_snd"(sleep mutex) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80ba9111 at __mtx_lock_flags+0x91
#2 0xffffffff82eed67e at ovpn_peer_release_ref+0x20e
#3 0xffffffff82ee9b32 at ovpn_clone_destroy+0x92
#4 0xffffffff80d1e2f9 at if_clone_destroyif_flags+0x69
#5 0xffffffff80d1ebe6 at if_clone_detach+0xe6
#6 0xffffffff82eef665 at ovpn_prison_remove+0x55
#7 0xffffffff80bacf32 at osd_call+0xb2
#8 0xffffffff80b8a14c at prison_deref+0x5dc
#9 0xffffffff80b8bc47 at sys_jail_remove+0x1a7
#10 0xffffffff81132a11 at amd64_syscall+0x451
#11 0xffffffff8110146b at fast_syscall_common+0xf8
hardcoded lock order "so_snd"(sleep mutex) -> "so_rcv"(sleep mutex) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80ba9111 at __mtx_lock_flags+0x91
#2 0xffffffff80c86def at soreserve+0x5f
#3 0xffffffff80e46535 at udp6_attach+0x75
#4 0xffffffff80c8a0c8 at soattach+0xf8
#5 0xffffffff80c8997c at socreate+0x19c
#6 0xffffffff80c9399e at kern_socket+0xbe
#7 0xffffffff81132729 at amd64_syscall+0x169
#8 0xffffffff8110146b at fast_syscall_common+0xf8
lock order "if_ovpn_lock"(rm) -> "so_rcv"(sleep mutex) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80ba9111 at __mtx_lock_flags+0x91
#2 0xffffffff82eed653 at ovpn_peer_release_ref+0x1e3
#3 0xffffffff82ee9b32 at ovpn_clone_destroy+0x92
#4 0xffffffff80d1e2f9 at if_clone_destroyif_flags+0x69
#5 0xffffffff80d1ebe6 at if_clone_detach+0xe6
#6 0xffffffff82eef665 at ovpn_prison_remove+0x55
#7 0xffffffff80bacf32 at osd_call+0xb2
#8 0xffffffff80b8a14c at prison_deref+0x5dc
#9 0xffffffff80b8bc47 at sys_jail_remove+0x1a7
#10 0xffffffff81132a11 at amd64_syscall+0x451
#11 0xffffffff8110146b at fast_syscall_common+0xf8
lock order "so_rcv"(sleep mutex) -> "tcphash"(sleep mutex) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80ba9111 at __mtx_lock_flags+0x91
#2 0xffffffff80e02881 at tcp6_usr_listen+0x1c1
#3 0xffffffff80c8b261 at solisten+0x41
#4 0xffffffff80c93e9f at kern_listen+0x6f
#5 0xffffffff81132a11 at amd64_syscall+0x451
#6 0xffffffff8110146b at fast_syscall_common+0xf8
hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80bc9a49 at _rm_rlock_debug+0x129
#2 0xffffffff80e24ba7 at in6_selectsrc+0x3f7
#3 0xffffffff80e2474d at in6_selectsrc_socket+0x6d
#4 0xffffffff80e21ae0 at in6_pcbconnect+0x220
#5 0xffffffff80e0494a at tcp6_connect+0xba
#6 0xffffffff80e022c5 at tcp6_usr_connect+0x2f5
#7 0xffffffff80c8c240 at soconnectat+0xc0
#8 0xffffffff80c946b1 at kern_connectat+0xe1
#9 0xffffffff80c945a1 at sys_connect+0x81
#10 0xffffffff81132a11 at amd64_syscall+0x451
#11 0xffffffff8110146b at fast_syscall_common+0xf8
lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at:
#0 0xffffffff80c4a2c4 at witness_checkorder+0x364
#1 0xffffffff80bcbc0d at __rw_rlock_int+0x7d
#2 0xffffffff80e172bb at in6_lltable_lookup+0x10b
#3 0xffffffff80e35da1 at nd6_lookup+0x81
#4 0xffffffff80e4138e at find_pfxlist_reachable_router+0x7e
#5 0xffffffff80e411b6 at pfxlist_onlink_check+0x3c6
#6 0xffffffff80e3e6f0 at nd6_ra_input+0x1100
#7 0xffffffff80e0e430 at icmp6_input+0x5b0
#8 0xffffffff80e28d65 at ip6_input+0xbb5
#9 0xffffffff80d3e7b4 at netisr_dispatch_src+0xb4
#10 0xffffffff80d2055a at ether_demux+0x16a
#11 0xffffffff80d21ace at ether_nh_input+0x3ce
#12 0xffffffff80d3e7b4 at netisr_dispatch_src+0xb4
#13 0xffffffff80d209a5 at ether_input+0xd5
#14 0xffffffff82ee3b54 at epair_tx_start_deferred+0xd4
#15 0xffffffff80c3cd12 at taskqueue_run_locked+0x1c2
#16 0xffffffff80c3dc03 at taskqueue_thread_loop+0xd3
#17 0xffffffff80b80112 at fork_exit+0x82
lock order lle -> in6_multi_list_mtx attempted at:
#0 0xffffffff80c4ac0f at witness_checkorder+0xcaf
#1 0xffffffff80ba9111 at __mtx_lock_flags+0x91
#2 0xffffffff80e17701 at in6_lltable_delete_entry+0xc1
#3 0xffffffff80d2404a at lltable_delete_addr+0xda
#4 0xffffffff80e6837b at rtnl_handle_delneigh+0x7b
#5 0xffffffff80e64c12 at rtnl_handle_message+0x132
#6 0xffffffff80e6345c at nl_receive_message+0x11c
#7 0xffffffff80e62da5 at nl_taskqueue_handler+0x3e5
#8 0xffffffff80c3cd12 at taskqueue_run_locked+0x1c2
#9 0xffffffff80c3dc03 at taskqueue_thread_loop+0xd3
#10 0xffffffff80b80112 at fork_exit+0x82
#11 0xffffffff81101b9e at fork_trampoline+0xe
lock order reversal: (sleepable after non-sleepable)
1st 0xfffff80152159290 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2461
2nd 0xffffffff822fbd80 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1329
lock order lle -> in6_multi_sx attempted at:
#0 0xffffffff80c4ac0f at witness_checkorder+0xcaf
#1 0xffffffff80bdacc0 at _sx_xlock+0x60
#2 0xffffffff80e1dd07 at in6_leavegroup+0x27
#3 0xffffffff80e1774c at in6_lltable_delete_entry+0x10c
#4 0xffffffff80d2404a at lltable_delete_addr+0xda
#5 0xffffffff80e6837b at rtnl_handle_delneigh+0x7b
#6 0xffffffff80e64c12 at rtnl_handle_message+0x132
#7 0xffffffff80e6345c at nl_receive_message+0x11c
#8 0xffffffff80e62da5 at nl_taskqueue_handler+0x3e5
#9 0xffffffff80c3cd12 at taskqueue_run_locked+0x1c2
#10 0xffffffff80c3dc03 at taskqueue_thread_loop+0xd3
#11 0xffffffff80b80112 at fork_exit+0x82
#12 0xffffffff81101b9e at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [5.679s]
sys/netinet6/proxy_ndp:pndp_ifdestroy_success -> epair0a: Ethernet address: 26:96:c1:d0:d5:8d
epair0b: Ethernet address: ce:d1:4e:41:1d:da
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [1.752s]
sys/netinet6/proxy_ndp:pndp_neighbor_advert -> epair0a: Ethernet address: 2e:dc:e1:52:20:dd
epair0b: Ethernet address: a6:23:66:37:45:be
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [4.819s]
sys/netinet6/redirect:valid_redirect -> epair0a: Ethernet address: 6a:39:fd:bc:0b:5b
epair0b: Ethernet address: b6:29:b6:86:bd:4f
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [3.262s]
sys/netinet6/scapyi386:scapyi386 -> epair0a: Ethernet address: c6:47:23:0f:38:63
epair0b: Ethernet address: 3a:61:16:a0:02:92
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [4.381s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base -> broken: Test case body timed out [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop -> broken: Test case body timed out [300.006s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[empty] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ifsame] -> broken: Test case body timed out [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ipandif] -> broken: Test case body timed out [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[iponly1] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[nolocalip] -> broken: Test case body timed out [300.006s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLL::test_output6_linklocal -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-no_sav] -> broken: Test case body timed out [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-sav] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-no_sav] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-sav] -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-no_sav] -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-sav] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-no_sav] -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-sav] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-no_sav] -> broken: Test case body timed out [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-sav] -> broken: Test case body timed out [300.007s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-no_sav] -> broken: Test case body timed out [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-sav] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff02] -> 2026-04-08T15:22:10.399452+00:00 - auditd 1541 - - auditd_wait_for_events: SIGTERM
2026-04-08T15:22:10.401753+00:00 - auditd 1541 - - Auditing disabled
2026-04-08T15:22:10.405879+00:00 - auditd 1541 - - renamed /var/audit/20260408092527.not_terminated to /var/audit/20260408092527.20260408152210
2026-04-08T15:22:10.408500+00:00 - auditd 1541 - - Finished
2026-04-08T15:22:30.417051+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 0 done
All buffers synced.
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-28202' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./auto-shutdown
x ./disable-dtrace-tests.sh
x ./run-kyua.sh
x ./disable-zfs-tests.sh
x ./run.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins9281111414433552765.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'cff675e83cdb6c9027e94df9d010439e42e27dee', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../cff675e83cdb6c9027e94df9d010439e42e27dee/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address