FreeBSD-main-amd64-test - Build #29864 - Failure
Date: Mon, 02 Nov 2026 13:48:00 UTC
FreeBSD-main-amd64-test - Build #29864 (013f1779f63413173535ab770abb70715e92bee6) - Failure
Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29864/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29864/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29864/console
Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
this is a notification to note that these changes have
not been fully tested by the CI system
Change summaries:
(Those commits are likely but not certainly responsible)
013f1779f63413173535ab770abb70715e92bee6 by kgalazka:
ice(4): Do not leave device non-functional if Tx scheduler config fails
The end of the build log:
[...truncated 6.06 MiB...]
lock order "inpcb_wild_bucket"(sleep mutex) -> "tcphash"(sleep mutex) first seen at:
#0 0xffffffff80cd35fa at witness_checkorder+0x36a
#1 0xffffffff80c2c041 at __mtx_lock_flags+0x91
#2 0xffffffff80e5bf95 at in_pcbinshash+0x195
#3 0xffffffff80e5c8c7 at in_pcbconnect+0x2e7
#4 0xffffffff80ea268e at tcp_connect+0x7e
#5 0xffffffff80e9e75d at tcp_usr_connect+0xed
#6 0xffffffff80d18fa6 at soconnectat+0xc6
#7 0xffffffff80d2166c at kern_connectat+0xec
#8 0xffffffff80d21553 at sys_connect+0x73
#9 0xffffffff811f7c1e at amd64_syscall+0x45e
#10 0xffffffff811c379b at fast_syscall_common+0xf8
lock order "inpcb_wild_bucket"(sleep mutex) -> "inpcb_port_bucket"(sleep mutex) first seen at:
#0 0xffffffff80cd35fa at witness_checkorder+0x36a
#1 0xffffffff80c2c041 at __mtx_lock_flags+0x91
#2 0xffffffff80e5b3e8 at in_pcblookup_local+0x1c8
#3 0xffffffff80e5af2c at in_pcb_lport_dest+0x37c
#4 0xffffffff80e5baf5 at in_pcbbind_setup_locked+0x385
#5 0xffffffff80e5bc34 at in_pcbbind+0xf4
#6 0xffffffff80e9eefe at tcp_usr_bind+0xae
#7 0xffffffff80d17e51 at sobind+0x41
#8 0xffffffff80d20be6 at kern_bindat+0xd6
#9 0xffffffff80d20a63 at sys_bind+0x73
#10 0xffffffff811f7c1e at amd64_syscall+0x45e
#11 0xffffffff811c379b at fast_syscall_common+0xf8
lock order "inpcb_port_bucket"(sleep mutex) -> "tcphash"(sleep mutex) first seen at:
#0 0xffffffff80cd35fa at witness_checkorder+0x36a
#1 0xffffffff80c2c041 at __mtx_lock_flags+0x91
#2 0xffffffff80e5bf95 at in_pcbinshash+0x195
#3 0xffffffff80e5bcdb at in_pcbbind+0x19b
#4 0xffffffff80e9eefe at tcp_usr_bind+0xae
#5 0xffffffff80d17e51 at sobind+0x41
#6 0xffffffff80d20be6 at kern_bindat+0xd6
#7 0xffffffff80d20a63 at sys_bind+0x73
#8 0xffffffff811f7c1e at amd64_syscall+0x45e
#9 0xffffffff811c379b at fast_syscall_common+0xf8
hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first seen at:
(No stack trace)
lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at:
(No stack trace)
lock order "mld_mtx"(sleep mutex) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80cd35fa at witness_checkorder+0x36a
#1 0xffffffff80c2c041 at __mtx_lock_flags+0x91
#2 0xffffffff80ed8937 at nd6_get_llentry+0x147
#3 0xffffffff80ed736a at nd6_resolve_slow+0x15a
#4 0xffffffff80ed707e at nd6_resolve+0x16e
#5 0xffffffff80db36f0 at ether_output+0x540
#6 0xffffffff80ecc1db at ip6_output+0x1b1b
#7 0xffffffff82b0ce42 at geneve_transmit+0xa62
#8 0xffffffff80db3a8e at ether_output_frame+0xde
#9 0xffffffff80db38c2 at ether_output+0x712
#10 0xffffffff80ecc1db at ip6_output+0x1b1b
#11 0xffffffff80ed25f0 at mld_dispatch_packet+0x330
#12 0xffffffff80ed30f0 at mld_fasttimo+0x4f0
#13 0xffffffff80c74bc8 at softclock_call_cc+0x1c8
#14 0xffffffff80c763d6 at softclock_thread+0xc6
#15 0xffffffff80c01852 at fork_exit+0x82
#16 0xffffffff811c3ece at fork_trampoline+0xe
lock order "if_ovpn_lock"(rm) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80cd35fa at witness_checkorder+0x36a
#1 0xffffffff80c2c041 at __mtx_lock_flags+0x91
#2 0xffffffff80e460bd at arpresolve+0x34d
#3 0xffffffff80db34b0 at ether_output+0x300
#4 0xffffffff80e6a28a at ip_output+0x163a
#5 0xffffffff82b2f01e at ovpn_encap+0x68e
#6 0xffffffff82b2f222 at ovpn_encrypt_tx_cb+0x142
#7 0xffffffff80fa1728 at crypto_done+0x168
#8 0xffffffff8109b2aa at aesni_process+0xea
#9 0xffffffff80fa1f85 at crypto_invoke+0x85
#10 0xffffffff80fa0b79 at crypto_dispatch_one+0xe9
#11 0xffffffff82b2e82a at ovpn_transmit_to_peer+0x66a
#12 0xffffffff82b2df54 at ovpn_send_ping+0x124
#13 0xffffffff80c74bc8 at softclock_call_cc+0x1c8
#14 0xffffffff80c763d6 at softclock_thread+0xc6
#15 0xffffffff80c01852 at fork_exit+0x82
#16 0xffffffff811c3ece at fork_trampoline+0xe
lock order "lltable"(sleep mutex) -> "lle"(rw) first seen at:
#0 0xffffffff80cd35fa at witness_checkorder+0x36a
#1 0xffffffff80c4f325 at _rw_wlock_cookie+0x65
#2 0xffffffff80e4662a at arp_add_ifa_lle+0x7a
#3 0xffffffff80e46539 at arp_ifinit+0x139
#4 0xffffffff80db4801 at ether_ioctl+0x1c1
#5 0xffffffff80e4f940 at in_control_ioctl+0xa80
#6 0xffffffff80f09cad at rtnl_handle_addr+0x41d
#7 0xffffffff80f05b10 at rtnl_handle_message+0x1a0
#8 0xffffffff80f042da at nl_receive_message+0x12a
#9 0xffffffff80f03c15 at nl_taskqueue_handler+0x3f5
#10 0xffffffff80cc5b0b at taskqueue_run_locked+0x1bb
#11 0xffffffff80cc6b43 at taskqueue_thread_loop+0xd3
#12 0xffffffff80c01852 at fork_exit+0x82
#13 0xffffffff811c3ece at fork_trampoline+0xe
lock order lle -> in6_multi_list_mtx attempted at:
#0 0xffffffff80cd3fcb at witness_checkorder+0xd3b
#1 0xffffffff80c2c041 at __mtx_lock_flags+0x91
#2 0xffffffff80eb55e1 at in6_lltable_delete_entry+0xc1
#3 0xffffffff80db81fa at lltable_delete_addr+0xda
#4 0xffffffff80f0ab97 at rtnl_handle_delneigh+0x97
#5 0xffffffff80f05aad at rtnl_handle_message+0x13d
#6 0xffffffff80f042da at nl_receive_message+0x12a
#7 0xffffffff80f03c15 at nl_taskqueue_handler+0x3f5
#8 0xffffffff80cc5b0b at taskqueue_run_locked+0x1bb
#9 0xffffffff80cc6b43 at taskqueue_thread_loop+0xd3
#10 0xffffffff80c01852 at fork_exit+0x82
#11 0xffffffff811c3ece at fork_trampoline+0xe
lock order reversal: (sleepable after non-sleepable)
1st 0xfffff800535e6890 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2465
2nd 0xffffffff81ea2d80 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1334
lock order lle -> in6_multi_sx attempted at:
#0 0xffffffff80cd3fcb at witness_checkorder+0xd3b
#1 0xffffffff80c600c0 at _sx_xlock+0x60
#2 0xffffffff80ebbf87 at in6_leavegroup+0x27
#3 0xffffffff80eb562c at in6_lltable_delete_entry+0x10c
#4 0xffffffff80db81fa at lltable_delete_addr+0xda
#5 0xffffffff80f0ab97 at rtnl_handle_delneigh+0x97
#6 0xffffffff80f05aad at rtnl_handle_message+0x13d
#7 0xffffffff80f042da at nl_receive_message+0x12a
#8 0xffffffff80f03c15 at nl_taskqueue_handler+0x3f5
#9 0xffffffff80cc5b0b at taskqueue_run_locked+0x1bb
#10 0xffffffff80cc6b43 at taskqueue_thread_loop+0xd3
#11 0xffffffff80c01852 at fork_exit+0x82
#12 0xffffffff811c3ece at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [8.148s]
sys/netinet6/proxy_ndp:pndp_ifdestroy_success -> epair0a: Ethernet address: 2e:91:cd:6e:76:83
epair0b: Ethernet address: 72:04:f7:93:ae:44
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [1.602s]
sys/netinet6/proxy_ndp:pndp_neighbor_advert -> epair0a: Ethernet address: 96:4c:23:d1:67:83
epair0b: Ethernet address: 42:23:f8:1e:ed:78
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [3.550s]
sys/netinet6/redirect:valid_redirect -> epair0a: Ethernet address: b2:1e:36:72:69:22
epair0b: Ethernet address: 1a:77:fa:f9:4c:07
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
broken: Test case execenv cleanup timed out [3.866s]
sys/netinet6/scapyi386:scapyi386 -> epair0a: Ethernet address: 7e:5c:bc:18:ca:df
epair0b: Ethernet address: 56:b5:d1:47:89:3c
broken: Test case body timed out [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base -> epair0a: Ethernet address: 58:9c:fc:10:6f:86
epair0b: Ethernet address: 58:9c:fc:10:55:18
epair1a: Ethernet address: 58:9c:fc:10:3f:05
epair1b: Ethernet address: 58:9c:fc:10:58:68
epair2a: Ethernet address: 58:9c:fc:10:e1:f5
epair2b: Ethernet address: 58:9c:fc:10:a8:73
broken: Test case body timed out [300.020s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop -> epair3a: Ethernet address: 58:9c:fc:10:1a:41
epair3b: Ethernet address: 58:9c:fc:10:8e:5f
epair4a: Ethernet address: 58:9c:fc:10:f3:34
epair4b: Ethernet address: 58:9c:fc:10:2f:2b
epair5a: Ethernet address: 58:9c:fc:10:68:e6
epair5b: Ethernet address: 58:9c:fc:10:68:6c
panic: deadlres_td_sleep_q: possible deadlock detected for 0xfffff8010241a780 (swi6: task queue), blocked for 180093 ticks
cpuid = 1
time = 1793627279
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x36/frame 0xfffffe008bdded20
vpanic() at vpanic+0x149/frame 0xfffffe008bddee50
panic() at panic+0x43/frame 0xfffffe008bddeeb0
deadlkres() at deadlkres+0x32a/frame 0xfffffe008bddeef0
fork_exit() at fork_exit+0x82/frame 0xfffffe008bddef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008bddef30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 0 tid 100079 ]
Stopped at kdb_enter+0x33: movq $0,0x115ada2(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid = 1
dynamic pcpu = 0xfffffe008d3bd380
curthread = 0xfffff80102452000: pid 0 tid 100079 critnest 1 "deadlkres"
curpcb = 0xfffff80102452550
fpcurthread = none
idlethread = 0xfffff8010240b000: tid 100004 "idle: cpu1"
self = 0xffffffff82611000
curpmap = 0xffffffff81da8d00
tssp = 0xffffffff82611384
rsp0 = 0xfffffe008bddf000
kcr3 = 0x8000000002551002
ucr3 = 0xffffffffffffffff
scr3 = 0x1967d4f94
gs32p = 0xffffffff82611404
ldt = 0xffffffff82611444
tss = 0xffffffff82611434
curvnet = 0
spin locks held:
db:0:kdb.enter.panic> reset
Uptime: 1h53m10s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-29864' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-zfs-tests.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./run-kyua.sh
x ./run.sh
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins13534475322871254744.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '013f1779f63413173535ab770abb70715e92bee6', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../013f1779f63413173535ab770abb70715e92bee6/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address