FreeBSD-main-amd64-test - Build #29888 - Still Failing
Date: Fri, 06 Nov 2026 14:48:59 UTC
FreeBSD-main-amd64-test - Build #29888 (e6fc1765bd34e4e1a2b56fddfdf4eccc218c2ff9) - Still Failing
Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29888/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29888/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29888/console
Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
this is a notification to note that these changes have
not been fully tested by the CI system
Change summaries:
(Those commits are likely but not certainly responsible)
764761d3169d37ebbf24566344e50bfca5f013b9 by seuros:
nvme: program the arbitration burst from Identify RAB
e6fc1765bd34e4e1a2b56fddfdf4eccc218c2ff9 by seuros:
nvme: drop the S3X single-outstanding-I/O quirk
The end of the build log:
[...truncated 6.39 MiB...]
epair1b: promiscuous mode enabled
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair1b: promiscuous mode disabled
epair1b: promiscuous mode enabled
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair1b: promiscuous mode disabled
epair1b: promiscuous mode enabled
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair1b: promiscuous mode disabled
epair1b: promiscuous mode enabled
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair1b: promiscuous mode disabled
epair2a: link state changed to DOWN
epair2b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1b: promiscuous mode enabled
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair1b: promiscuous mode disabled
epair1b: promiscuous mode enabled
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair1b: promiscuous mode disabled
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [11.920s]
sys/netpfil/pf/src_track:source_track -> epair0a: Ethernet address: b2:f0:35:15:c5:75
epair0b: Ethernet address: be:6e:f3:5e:94:cd
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [2.351s]
sys/netpfil/pf/status:basic -> epair0a: Ethernet address: f2:35:fc:8a:c9:11
epair0b: Ethernet address: 26:7e:6c:f9:8e:1b
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [0.390s]
sys/netpfil/pf/syncookie:adaptive -> epair0a: Ethernet address: 76:a8:37:54:41:33
epair0b: Ethernet address: be:0e:7f:55:c4:0f
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [2.137s]
sys/netpfil/pf/syncookie:basic -> epair0a: Ethernet address: 0a:8c:e0:c5:ed:0e
epair0b: Ethernet address: 16:78:38:15:58:63
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [0.297s]
sys/netpfil/pf/syncookie:basic_v6 -> epair0a: Ethernet address: e6:0f:11:2c:c3:3a
epair0b: Ethernet address: aa:92:b3:bb:71:73
epair0a: link state changed to UP
epair0b: link state changed to UP
lock order reversal:
1st 0xfffffe00d0f84c38 pf rulesets (pf rulesets, rm) @ /usr/src/sys/netpfil/pf/pf.c:11738
2nd 0xffffffff81ea1db8 in6_ifaddr_lock (in6_ifaddr_lock, rm) @ /usr/src/sys/netinet6/in6.c:1668
All lock orders from in6_ifaddr_lock -> pf rulesets:
"in6_ifaddr_lock" -> "nd6 DAD queue" -> "if_addr_lock" -> "pf rulesets"
lock order "in6_ifaddr_lock"(rm) -> "nd6 DAD queue"(rw) first seen at:
(No stack trace)
lock order "nd6 DAD queue"(rw) -> "if_addr_lock"(sleep mutex) first seen at:
(No stack trace)
lock order "if_addr_lock"(sleep mutex) -> "pf rulesets"(rm) first seen at:
(No stack trace)
lock order pf rulesets -> in6_ifaddr_lock attempted at:
#0 0xffffffff80ccdd4b at witness_checkorder+0xd3b
#1 0xffffffff80c4fe29 at _rm_rlock_debug+0x129
#2 0xffffffff80ead6f4 at in6ifa_ifwithaddr+0x44
#3 0xffffffff82c631da at pf_send_ip6_direct+0x1a
#4 0xffffffff82cbe02b at pf_syncookie_send+0xeb
#5 0xffffffff82c6f251 at pf_test+0x26e1
#6 0xffffffff82c922ed at pf_check6_in+0x5d
#7 0xffffffff80dd4108 at pfil_mbuf_in+0x58
#8 0xffffffff80ec153e at ip6_input+0x75e
#9 0xffffffff80dd024f at netisr_dispatch_src+0xbf
#10 0xffffffff80dada7a at ether_demux+0x17a
#11 0xffffffff80daf064 at ether_nh_input+0x3b4
#12 0xffffffff80dd024f at netisr_dispatch_src+0xbf
#13 0xffffffff80dadee9 at ether_input+0xe9
#14 0xffffffff82b03b94 at epair_tx_start_deferred+0xd4
#15 0xffffffff80cbf88b at taskqueue_run_locked+0x1bb
#16 0xffffffff80cc08c3 at taskqueue_thread_loop+0xd3
#17 0xffffffff80c037c2 at fork_exit+0x82
epair2a: link state changed to DOWN
epair2b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
failed: Failed to connect to syncookie protected echo daemon [6.779s]
sys/netpfil/pf/syncookie:forward -> epair0a: Ethernet address: ea:a5:91:50:51:1d
epair0b: Ethernet address: 66:9c:fc:6e:a4:d3
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 76:96:f1:d5:89:4d
epair1b: Ethernet address: 86:c5:d6:da:48:a2
epair1a: link state changed to UP
epair1b: link state changed to UP
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed [0.419s]
sys/netpfil/pf/syncookie:forward_v6 -> epair0a: Ethernet address: 86:e7:08:e1:94:2c
epair0b: Ethernet address: 1a:3f:7e:54:17:b0
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: f6:cd:27:35:ec:ca
epair1b: Ethernet address: e6:da:f9:9e:0c:77
epair1a: link state changed to UP
epair1b: link state changed to UP
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed [0.414s]
sys/netpfil/pf/syncookie:limits -> passed [0.289s]
sys/netpfil/pf/syncookie:loopback -> lo0: link state changed to UP
epair0a: Ethernet address: aa:17:30:84:ce:a0
epair0b: Ethernet address: 56:90:b6:9b:ff:2c
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [2.299s]
sys/netpfil/pf/syncookie:loopback_v6 -> lo0: link state changed to UP
epair0a: Ethernet address: 82:c5:42:23:39:c7
epair0b: Ethernet address: 2e:e5:08:10:1f:98
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed [2.294s]
sys/netpfil/pf/syncookie:nostate -> epair0a: Ethernet address: aa:a2:f9:6c:2e:08
epair0b: Ethernet address: 72:c0:1e:7a:a9:41
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed [2.081s]
sys/netpfil/pf/syncookie:nostate_v6 -> epair0a: Ethernet address: 82:e5:c2:15:e5:f8
epair0b: Ethernet address: ba:11:4b:5f:62:ba
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
broken: Test case cleanup timed out [22.628s]
sys/netpfil/pf/syncookie:port_reuse -> panic: deadlres_td_sleep_q: possible deadlock detected for 0xfffff8010241a780 (swi6: task queue), blocked for 180050 ticks
cpuid = 0
time = 1793976538
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x36/frame 0xfffffe008bdded20
vpanic() at vpanic+0x149/frame 0xfffffe008bddee50
panic() at panic+0x43/frame 0xfffffe008bddeeb0
deadlkres() at deadlkres+0x32a/frame 0xfffffe008bddeef0
fork_exit() at fork_exit+0x82/frame 0xfffffe008bddef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008bddef30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 0 tid 100079 ]
Stopped at kdb_enter+0x33: movq $0,0x115ff22(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid = 0
dynamic pcpu = 0x9b3380
curthread = 0xfffff80102452000: pid 0 tid 100079 critnest 1 "deadlkres"
curpcb = 0xfffff80102452550
fpcurthread = none
idlethread = 0xfffff8010240b780: tid 100003 "idle: cpu0"
self = 0xffffffff82610000
curpmap = 0xffffffff81da8d00
tssp = 0xffffffff82610384
rsp0 = 0xfffffe008bddf000
kcr3 = 0x8000000002551002
ucr3 = 0xffffffffffffffff
scr3 = 0x1005ccd6
gs32p = 0xffffffff82610404
ldt = 0xffffffff82610444
tss = 0xffffffff82610434
curvnet = 0
spin locks held:
db:0:kdb.enter.panic> reset
Uptime: 2h51m22s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-29888' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./run.sh
x ./disable-notyet-tests.sh
x ./run-kyua.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins12410872037535998949.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'e6fc1765bd34e4e1a2b56fddfdf4eccc218c2ff9', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../e6fc1765bd34e4e1a2b56fddfdf4eccc218c2ff9/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address