FreeBSD-main-amd64-test - Build #28777 - Failure
Date: Sun, 14 Jun 2026 14:05:51 UTC
FreeBSD-main-amd64-test - Build #28777 (36b155a2b3baa747c1968a9094df9fa7fb0d02b3) - Failure
Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28777/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28777/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28777/console
Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
this is a notification to note that these changes have
not been fully tested by the CI system
Change summaries:
(Those commits are likely but not certainly responsible)
36b155a2b3baa747c1968a9094df9fa7fb0d02b3 by kib:
vfs: work around the race between vget() and vnlru
The end of the build log:
[...truncated 4.79 MiB...]
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80bde681 at __mtx_lock_flags+0x91
#2 0xffffffff82eef813 at ovpn_peer_release_ref+0x1e3
#3 0xffffffff82eebba2 at ovpn_clone_destroy+0x92
#4 0xffffffff80d5e47c at if_clone_destroyif_flags+0x8c
#5 0xffffffff80d5ed96 at if_clone_detach+0x106
#6 0xffffffff82ef18c5 at ovpn_prison_remove+0x55
#7 0xffffffff80be26a2 at osd_call+0xb2
#8 0xffffffff80bbe98c at prison_deref+0x5ec
#9 0xffffffff80bc0517 at sys_jail_remove+0x1a7
#10 0xffffffff81191569 at amd64_syscall+0x479
#11 0xffffffff8115f62b at fast_syscall_common+0xf8
lock order "so_rcv"(sleep mutex) -> "tcphash"(sleep mutex) first seen at:
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80bde681 at __mtx_lock_flags+0x91
#2 0xffffffff80e04153 at in_pcbbind+0xb3
#3 0xffffffff80e468b4 at tcp_usr_listen+0x114
#4 0xffffffff80cc6c21 at solisten+0x41
#5 0xffffffff80ccfa3e at kern_listen+0x7e
#6 0xffffffff81191569 at amd64_syscall+0x479
#7 0xffffffff8115f62b at fast_syscall_common+0xf8
hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first seen at:
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80bffdc9 at _rm_rlock_debug+0x129
#2 0xffffffff80e6a83e at in6_selectsrc+0x3ee
#3 0xffffffff80e6a3c0 at in6_selectsrc_socket+0x80
#4 0xffffffff80e67534 at in6_pcbconnect+0x264
#5 0xffffffff80e49c23 at tcp6_connect+0x83
#6 0xffffffff80e476ca at tcp6_usr_connect+0x2da
#7 0xffffffff80cc7bf6 at soconnectat+0xc6
#8 0xffffffff80cd027c at kern_connectat+0xec
#9 0xffffffff80cd0163 at sys_connect+0x73
#10 0xffffffff81191569 at amd64_syscall+0x479
#11 0xffffffff8115f62b at fast_syscall_common+0xf8
lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at:
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80c01fcd at __rw_rlock_int+0x7d
#2 0xffffffff80e5c73b at in6_lltable_lookup+0x10b
#3 0xffffffff80e7c0ac at nd6_lookup+0x8c
#4 0xffffffff80e87b3e at find_pfxlist_reachable_router+0x7e
#5 0xffffffff80e87966 at pfxlist_onlink_check+0x3c6
#6 0xffffffff80e850cc at nd6_ra_input+0x167c
#7 0xffffffff80e538a3 at icmp6_input+0x5b3
#8 0xffffffff80e6ebb1 at ip6_input+0xbc1
#9 0xffffffff80d7f70f at netisr_dispatch_src+0xbf
#10 0xffffffff80d6075a at ether_demux+0x17a
#11 0xffffffff80d61d7a at ether_nh_input+0x3ea
#12 0xffffffff80d7f70f at netisr_dispatch_src+0xbf
#13 0xffffffff80d60bc9 at ether_input+0xe9
#14 0xffffffff82ee5b94 at epair_tx_start_deferred+0xd4
#15 0xffffffff80c76b1e at taskqueue_run_locked+0x1ce
#16 0xffffffff80c77aa3 at taskqueue_thread_loop+0xd3
#17 0xffffffff80bb4332 at fork_exit+0x82
lock order "mld_mtx"(sleep mutex) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80bde681 at __mtx_lock_flags+0x91
#2 0xffffffff80dee7fd at arpresolve+0x34d
#3 0xffffffff80d5ffa0 at ether_output+0x300
#4 0xffffffff80e12063 at ip_output+0x18c3
#5 0xffffffff80d62cfa at gif_transmit+0x2fa
#6 0xffffffff80e72f7b at ip6_output+0x1b2b
#7 0xffffffff80e79340 at mld_dispatch_packet+0x330
#8 0xffffffff80e79e40 at mld_fasttimo+0x4f0
#9 0xffffffff80c26675 at softclock_call_cc+0x1b5
#10 0xffffffff80c27e56 at softclock_thread+0xc6
#11 0xffffffff80bb4332 at fork_exit+0x82
#12 0xffffffff8115fd5e at fork_trampoline+0xe
lock order "if_ovpn_lock"(rm) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80bde681 at __mtx_lock_flags+0x91
#2 0xffffffff80dee7fd at arpresolve+0x34d
#3 0xffffffff80d5ffa0 at ether_output+0x300
#4 0xffffffff80e12063 at ip_output+0x18c3
#5 0xffffffff82ef0f37 at ovpn_encap+0x6d7
#6 0xffffffff82ef10e2 at ovpn_encrypt_tx_cb+0x142
#7 0xffffffff8103cc0a at aesni_process+0xea
#8 0xffffffff80f446c5 at crypto_invoke+0x85
#9 0xffffffff80f43319 at crypto_dispatch_one+0xe9
#10 0xffffffff82ef0713 at ovpn_transmit_to_peer+0x663
#11 0xffffffff82eefe44 at ovpn_send_ping+0x124
#12 0xffffffff80c26675 at softclock_call_cc+0x1b5
#13 0xffffffff80c27e56 at softclock_thread+0xc6
#14 0xffffffff80bb4332 at fork_exit+0x82
#15 0xffffffff8115fd5e at fork_trampoline+0xe
lock order "lltable"(sleep mutex) -> "lle"(rw) first seen at:
#0 0xffffffff80c8427a at witness_checkorder+0x36a
#1 0xffffffff80c01245 at _rw_wlock_cookie+0x65
#2 0xffffffff80e7e3dc at nd6_add_ifa_lle+0xcc
#3 0xffffffff80e59ef0 at in6_update_ifa+0xdb0
#4 0xffffffff80e589ff at in6_addifaddr+0x7f
#5 0xffffffff80e58811 at in6_control_ioctl+0x9b1
#6 0xffffffff80eaf5ee at rtnl_handle_addr+0x62e
#7 0xffffffff80eac8f0 at rtnl_handle_message+0x1a0
#8 0xffffffff80eab0ba at nl_receive_message+0x12a
#9 0xffffffff80eaa9f5 at nl_taskqueue_handler+0x3f5
#10 0xffffffff80c76b1e at taskqueue_run_locked+0x1ce
#11 0xffffffff80c77aa3 at taskqueue_thread_loop+0xd3
#12 0xffffffff80bb4332 at fork_exit+0x82
#13 0xffffffff8115fd5e at fork_trampoline+0xe
lock order lle -> in6_multi_list_mtx attempted at:
#0 0xffffffff80c84c11 at witness_checkorder+0xd01
#1 0xffffffff80bde681 at __mtx_lock_flags+0x91
#2 0xffffffff80e5cb81 at in6_lltable_delete_entry+0xc1
#3 0xffffffff80d643ba at lltable_delete_addr+0xda
#4 0xffffffff80eb02d7 at rtnl_handle_delneigh+0x97
#5 0xffffffff80eac88d at rtnl_handle_message+0x13d
#6 0xffffffff80eab0ba at nl_receive_message+0x12a
#7 0xffffffff80eaa9f5 at nl_taskqueue_handler+0x3f5
#8 0xffffffff80c76b1e at taskqueue_run_locked+0x1ce
#9 0xffffffff80c77aa3 at taskqueue_thread_loop+0xd3
#10 0xffffffff80bb4332 at fork_exit+0x82
#11 0xffffffff8115fd5e at fork_trampoline+0xe
lock order reversal: (sleepable after non-sleepable)
1st 0xfffff8003c430590 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2461
2nd 0xffffffff822fcc60 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1329
lock order lle -> in6_multi_sx attempted at:
#0 0xffffffff80c84c11 at witness_checkorder+0xd01
#1 0xffffffff80c11bb0 at _sx_xlock+0x60
#2 0xffffffff80e63517 at in6_leavegroup+0x27
#3 0xffffffff80e5cbcc at in6_lltable_delete_entry+0x10c
#4 0xffffffff80d643ba at lltable_delete_addr+0xda
#5 0xffffffff80eb02d7 at rtnl_handle_delneigh+0x97
#6 0xffffffff80eac88d at rtnl_handle_message+0x13d
#7 0xffffffff80eab0ba at nl_receive_message+0x12a
#8 0xffffffff80eaa9f5 at nl_taskqueue_handler+0x3f5
#9 0xffffffff80c76b1e at taskqueue_run_locked+0x1ce
#10 0xffffffff80c77aa3 at taskqueue_thread_loop+0xd3
#11 0xffffffff80bb4332 at fork_exit+0x82
#12 0xffffffff8115fd5e at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [3.495s]
sys/netinet6/proxy_ndp:pndp_ifdestroy_success -> epair0a: Ethernet address: 06:6f:f5:96:a5:d1
epair0b: Ethernet address: fa:bb:9d:16:3d:54
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [1.712s]
sys/netinet6/proxy_ndp:pndp_neighbor_advert -> epair0a: Ethernet address: e2:63:2c:69:d8:69
epair0b: Ethernet address: e6:71:e0:97:51:43
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [4.628s]
sys/netinet6/redirect:valid_redirect -> epair0a: Ethernet address: 92:5e:bd:b9:27:e8
epair0b: Ethernet address: 5e:3f:93:43:e7:d1
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [2.978s]
sys/netinet6/scapyi386:scapyi386 -> epair0a: Ethernet address: 92:5d:a6:a3:dc:e3
epair0b: Ethernet address: 2a:d2:5a:b1:24:88
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [4.349s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop -> broken: Test case body timed out [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[empty] -> broken: Test case body timed out [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ifsame] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ipandif] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[iponly1] -> broken: Test case body timed out [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[nolocalip] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLL::test_output6_linklocal -> broken: Test case body timed out [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-no_sav] -> broken: Test case body timed out [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-sav] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-no_sav] -> broken: Test case body timed out [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-sav] -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-no_sav] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-sav] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-no_sav] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-sav] -> broken: Test case body timed out [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-no_sav] -> broken: Test case body timed out [300.003s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-sav] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-no_sav] -> broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-sav] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff02] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff05] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff08] -> broken: Test case body timed out [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff0e] -> broken: Test case body timed out [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6OutputNhopLL::test_output6_nhop_linklocal -> broken: Test case body timed out [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[gu_to_ll] -> broken: Test case body timed out [300.006s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[ll_differentif1] -> broken: Test case body timed out [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[ll_differentif2] -> 2026-06-14T14:04:50.633523+00:00 - auditd 1597 - - auditd_wait_for_events: SIGTERM
2026-06-14T14:04:50.637224+00:00 - auditd 1597 - - Auditing disabled
2026-06-14T14:04:50.638739+00:00 - auditd 1597 - - renamed /var/audit/20260614080755.not_terminated to /var/audit/20260614080755.20260614140450
2026-06-14T14:04:50.640971+00:00 - auditd 1597 - - Finished
2026-06-14T14:05:10.648261+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...
Syncing disks, vnodes remaining... 0 0 done
All buffers synced.
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-28777' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run.sh
x ./auto-shutdown
x ./disable-dtrace-tests.sh
x ./run-kyua.sh
x ./disable-notyet-tests.sh
x ./disable-zfs-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins1576924921542000635.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '36b155a2b3baa747c1968a9094df9fa7fb0d02b3', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../36b155a2b3baa747c1968a9094df9fa7fb0d02b3/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address