FreeBSD-main-amd64-test - Build #26923 - Still Failing

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #26924 - Still Failing"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #26922 - Still Failing"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 08 Oct 2025 14:54:48 UTC
FreeBSD-main-amd64-test - Build #26923 (d9c94e5eefc0d1ed772cc3af15d92f1960ba73a6) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/26923/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/26923/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/26923/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

d9c94e5eefc0d1ed772cc3af15d92f1960ba73a6 by glebius:
tests/netinet: fix so_reuseport_lb_test flakyness



The end of the build log:

[...truncated 4.29 MiB...]
epair0b: link state changed to UP
epair1a: Ethernet address: b2:16:71:46:c9:b2
epair1b: Ethernet address: 6e:cc:63:20:b9:8a
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.247s]
sys/netpfil/pf/nat64:tcp_in_floating  ->  epair0a: Ethernet address: ce:bd:96:2b:e8:64
epair0b: Ethernet address: 26:f8:69:ae:3f:31
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 4e:16:c4:0f:d3:ec
epair1b: Ethernet address: ba:ed:c3:29:db:b0
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.286s]
sys/netpfil/pf/nat64:tcp_in_if_bound  ->  epair0a: Ethernet address: e2:a2:82:be:b1:50
epair0b: Ethernet address: c6:39:6e:e2:d8:3a
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: ba:05:cb:e0:f6:6d
epair1b: Ethernet address: 7e:83:ee:bb:8f:3f
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.246s]
sys/netpfil/pf/nat64:tcp_out_floating  ->  epair0a: Ethernet address: 42:0b:eb:a8:5f:f7
epair0b: Ethernet address: 76:47:16:73:b7:4a
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: a2:c8:81:fa:0c:c5
epair1b: Ethernet address: 66:03:57:2b:06:6d
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.246s]
sys/netpfil/pf/nat64:tcp_out_if_bound  ->  epair0a: Ethernet address: 36:0d:36:de:2e:43
epair0b: Ethernet address: 8e:0a:12:c7:c8:9d
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: fa:77:89:0f:1c:a7
epair1b: Ethernet address: b6:8c:ef:4b:14:71
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.248s]
sys/netpfil/pf/nat64:tos  ->  epair0a: Ethernet address: 16:b9:5b:c4:30:e0
epair0b: Ethernet address: ce:a8:3f:b7:dc:cf
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 7a:32:f5:f3:e2:7c
epair1b: Ethernet address: 86:7e:a7:c5:2a:16
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.237s]
sys/netpfil/pf/nat64:udp_in  ->  epair0a: Ethernet address: aa:5a:cb:26:e0:17
epair0b: Ethernet address: d2:a3:9d:47:2a:3d
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: be:71:94:d4:f7:0d
epair1b: Ethernet address: 22:ae:40:c2:30:54
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.238s]
sys/netpfil/pf/nat64:udp_out  ->  epair0a: Ethernet address: 22:0a:22:71:85:18
epair0b: Ethernet address: fe:60:a3:81:3e:72
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: c2:54:d1:6a:1b:37
epair1b: Ethernet address: da:76:c4:29:14:67
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1b: link state changed to DOWN
epair1a: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.246s]
sys/netpfil/pf/nat64:v6_gateway  ->  epair0a: Ethernet address: f6:19:d7:75:8d:6c
epair0b: Ethernet address: ce:59:3c:62:be:e6
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: ea:7a:a9:b8:d2:70
epair1b: Ethernet address: ca:9c:54:af:be:b6
epair1a: link state changed to UP
epair1b: link state changed to UP
epair2a: Ethernet address: ea:ea:e3:97:ee:7a
epair2b: Ethernet address: 22:6e:bb:2b:68:60
epair2a: link state changed to UP
epair2b: link state changed to UP
epair2b: link state changed to DOWN
epair2a: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.347s]
sys/netpfil/pf/nat64.py:TestNAT64::test_address_unreachable  ->  epair0a: Ethernet address: 76:95:29:21:af:9b
epair0b: Ethernet address: 0a:00:1e:c3:76:0f
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 36:a0:0d:51:ae:e8
epair1b: Ethernet address: 06:2c:f1:a6:b0:55
epair1a: link state changed to UP
epair1b: link state changed to UP
epair2a: Ethernet address: d6:77:4e:ef:85:e2
epair2b: Ethernet address: a2:4f:7e:d3:8d:f7
epair2a: link state changed to UP
epair2b: link state changed to UP
lo0: link state changed to UP
lo0: link state changed to UP
lo0: link state changed to UP
lo0: link state changed to UP
lo0: promiscuous mode enabled
lo0: promiscuous mode disabled
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
epair2a: link state changed to DOWN
epair2b: link state changed to DOWN
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
failed: /usr/tests/sys/netpfil/pf/nat64.py:173: AttributeError  [5.025s]
sys/netpfil/pf/nat64.py:TestNAT64::test_bad_len  ->  epair0a: Ethernet address: 7e:f0:96:6b:f8:a3
epair0b: Ethernet address: 62:5c:f7:53:0e:ad
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 1e:be:07:c4:43:4d
epair1b: Ethernet address: 8a:8f:0c:e3:9b:d3
epair1a: link state changed to UP
epair1b: link state changed to UP
epair2a: Ethernet address: 8e:47:55:ad:9c:94
epair2b: Ethernet address: 02:39:84:ad:b5:95
epair2a: link state changed to UP
epair2b: link state changed to UP
lo0: link state changed to UP
lo0: link state changed to UP
lo0: link state changed to UP
lo0: link state changed to UP
lo0: promiscuous mode enabled
panic: in6_cksum_partial_l2: mbuf len (51) < off(40)+len(512)
cpuid = 1
time = 1759935287
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008baf0820
vpanic() at vpanic+0x136/frame 0xfffffe008baf0950
panic() at panic+0x43/frame 0xfffffe008baf09b0
in6_cksum_partial_l2() at in6_cksum_partial_l2+0x17f/frame 0xfffffe008baf0a00
fr_cksum() at fr_cksum+0xa5/frame 0xfffffe008baf0a30
ipf_checkl4sum() at ipf_checkl4sum+0xbd/frame 0xfffffe008baf0a60
ipf_checkv6sum() at ipf_checkv6sum+0x56/frame 0xfffffe008baf0a80
ipf_makefrip() at ipf_makefrip+0x1691/frame 0xfffffe008baf0b10
ipf_check() at ipf_check+0x15e/frame 0xfffffe008baf0ca0
ipf_check_wrapper6() at ipf_check_wrapper6+0x6f/frame 0xfffffe008baf0cd0
pfil_mbuf_in() at pfil_mbuf_in+0x58/frame 0xfffffe008baf0d00
ip6_input() at ip6_input+0x6be/frame 0xfffffe008baf0de0
swi_net() at swi_net+0x19b/frame 0xfffffe008baf0e60
ithread_loop() at ithread_loop+0x266/frame 0xfffffe008baf0ef0
fork_exit() at fork_exit+0x82/frame 0xfffffe008baf0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008baf0f30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 12 tid 100033 ]
Stopped at      kdb_enter+0x33: movq    $0,0x121da42(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid        = 1
dynamic pcpu = 0xfffffe008d1c25c0
curthread    = 0xfffff80004628780: pid 12 tid 100033 critnest 1 "swi1: netisr 0"
curpcb       = 0xfffff80004628cd0
fpcurthread  = none
idlethread   = 0xfffff8000460b000: tid 100004 "idle: cpu1"
self         = 0xffffffff82611000
curpmap      = 0xffffffff81d9f520
tssp         = 0xffffffff82611384
rsp0         = 0xfffffe008baf1000
kcr3         = 0x800000000259b002
ucr3         = 0xffffffffffffffff
scr3         = 0x19d6590a
gs32p        = 0xffffffff82611404
ldt          = 0xffffffff82611444
tss          = 0xffffffff82611434
curvnet      = 0xfffff8014a02a300
spin locks held:
db:0:kdb.enter.panic>  reset
Uptime: 1h35m59s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-26923' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./disable-zfs-tests.sh
x ./run.sh
x ./disable-notyet-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins8802949671861910606.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'd9c94e5eefc0d1ed772cc3af15d92f1960ba73a6', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../d9c94e5eefc0d1ed772cc3af15d92f1960ba73a6/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address