FreeBSD-stable-14-amd64-test - Build #1511 - Still Unstable

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-stable-14-amd64-test - Build #1512 - Still Unstable"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-stable-14-amd64-test - Build #1510 - Still Unstable"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Fri, 10 Oct 2025 21:25:11 UTC
FreeBSD-stable-14-amd64-test - Build #1511 (4b7c2a0193dd92b72628bc1c614d779cf77eef5d) - Still Unstable

Build information: https://ci.FreeBSD.org/job/FreeBSD-stable-14-amd64-test/1511/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-stable-14-amd64-test/1511/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-stable-14-amd64-test/1511/console

Status explanation:
"Unstable" - some tests are suspected being broken by the following changes
"Still Unstable" - the failing test cases have not been fixed by these
                   following changes and this is a notification to note that
                   these changes have not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

a3721403a384b6e44205b926b6eb620b18001b3d by ziaee:
add dtb support for RPI CM4, CM4s, CM4_ioBoard

8f38f734c8d0bfb836463342a48430221d1dba74 by ziaee:
release: remove the RPI CM4s .dtb

fce5d401a80377b8f2195280051348958d81698c by ziaee:
release/RPI: Add RPI Zero 2W device tree blob dtb

47acc6846564609d4fe01a94357e81044e055842 by olce:
sys: NOTES, GENERIC*: Re-order 'wlan_tkip'

6e888a22743f67d3b130dd0a9b9849bcee160d2f by olce:
jail.2: Mention EPERM is returned on open directories

563771ecdd0c6608d82a268b5624eb77520af012 by olce:
libc: compat.h: Remove a superfluous blank line at end

560c1bb21fe2da4fe5c9a1186262c035b2ece9c5 by olce:
cr_canseeothergids(): Make the logic easier to grasp

216460b806742c8c0a97aec2c9a689a17c564beb by olce:
linux: setgroups(): Avoid allocation under the process lock

22006b4525224f17908634488d39938790061df5 by olce:
linux: setgroups16(): Pre-extend the groups array

1086299d7abf67440668513bf387f03a8c667c21 by olce:
linux: getsockopt(): Simplify exporting groups a bit

faa9bcee15407bf8fc0985fbc759897290d79ca5 by olce:
initgroups(3): Fix return value on allocation failure

06e0e31f8698d49b692bbd56d7ac355b677b4b5d by olce:
initgroups.3: Revamp, mention FreeBSD 15's change in behavior

587263cb1ddb4c5a506852d675c2d873586155e2 by olce:
getgrouplist.3: Rework, use more appropriate terminology

7d5b7157e91970c11315d753c48aa6bdcd3aa9a2 by olce:
setgroups.2: Add SECURITY CONSIDERATIONS, rework

67cf21e16faf17caa51a53efd4b2fd004dae6821 by olce:
getgroups.2: Clarify, mention ascending order, add SECURITY

ac18468f3c4a5da4a7c8224151656d2391a5b262 by olce:
group.5: Add a reference to setcred(2)

3638aba1ceb99b8d687834af349fb73e33b1b0b3 by olce:
tools/regression/priv: Don't call setgroups() with the effective GID

92155298945f260fa41645ed19047d35e488cabd by olce:
stress2: Fix removal of supplementary groups

995d37ecd3b64f3d5c0689540357617e93b8566c by olce:
mac_do.4: Mention "from" part's GID can also match supplementary groups

2b5cc1e0e09592f36302d2cb5c6de1e159ea61ac by olce:
vfs cache: Add vn_fullpath_jail(), factor out common code

b025aa9f5abc44a19a6437bea17fcc80a7747200 by olce:
MAC/do: Check executable path from the current jail's root

b0f448f3e3215a37498164a59a3e40dde81a8cf1 by olce:
vn_fullpath.9: Add missing links for described functions

58f55afb301ba781f87991b0298a6a6545771376 by olce:
mdo(1): Add support and shortcuts for fully specifying users and groups

5fa6b203e186ae5d77fea778916bea59a3599066 by olce:
share/man/man9: Fix compilation

dbfdd93a188b089b35bee251ad3b60b50fc00117 by olce:
getgrouplist.3: Insist on the value returned in 'ngroups'; Minor changes

25624850a77babddc9e288639a3ced0f032a6ff2 by olce:
initgroups.3: Clarify that ENOMEM is a possible value for 'errno'

5fe22e3d09bd9e1f00913445bcf48a49ae0a1c6b by olce:
nfsuserd: Fix OOB access on membership of too many groups

4b7c2a0193dd92b72628bc1c614d779cf77eef5d by olce:
nfsuserd: Fix OOB access on membership of too many groups, take 2



The failed test cases:

550 tests failed.
FAILED:  sbin.ifconfig.inet6.broadcast

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sbin.ifconfig.inet6.netmask

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_4_c1_s56_t1_localhost]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_3_192_0.2.1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c1_192_0_2_1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c1_192_0_2_2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:739: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c1_2001_db8__1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c1_2001_db8__2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c3_192_0_2_2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:739: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c3_2001_db8__1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_A_c3_2001_db8__2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c1_192_0_2_1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c1_192_0_2_2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:739: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c1_2001_db8__1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c1_2001_db8__2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c1_S127_0_0_1_s56_t1_localhost]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c3_192_0_2_1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c3_192_0_2_2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:739: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c3_2001_db8__1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_c3_2001_db8__2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c1_192_0_2_1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c1_192_0_2_2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:739: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c1_2001_db8__1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c1_2001_db8__2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c3_192_0_2_1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c3_192_0_2_2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:739: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c3_2001_db8__1]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_ping[_q_c3_2001_db8__2]

Error Message:
/usr/tests/sbin/ping/test_ping.py:737: AssertionError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_EOL]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_LSRR]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_LSRR_trunc]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_NOP]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_NOP_40]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_RR]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_RR_same]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_RR_trunc]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_SSRR]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_SSRR_trunc]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_opts_unk]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_special_warp]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_0_0_special_wrong]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_3_1_flags_DF]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_3_1_opts_NOP_40]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_3_1_special_not_mine_verbose_false]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_3_1_special_tcp]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_3_1_special_udp]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_3_1_verbose_false]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_IHL_too_short]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_inner_IHL_too_short]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_inner_packet_too_short]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_max_inner_packet_ihl_without_payload]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.ping.test_ping.py.TestPing::test_pinger[_quoted_data_too_short]

Error Message:
/usr/local/lib/python3.11/subprocess.py:571: CalledProcessError

FAILED:  sbin.route.basic.basic_v4

Error Message:
Failed to add new route.

FAILED:  sbin.route.basic.basic_v6

Error Message:
Failed to add new route.

FAILED:  sys.kern.socket_accf.http

Error Message:
/usr/src/tests/sys/kern/socket_accf.c:129: accept(l, NULL, 0) == -1 not met

FAILED:  sys.net.if_bridge_test.bridge_transmit_ipv4_unicast

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.gif

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.mac_conflict

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.member_ifaddrs_disabled

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.member_ifaddrs_enabled

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.member_ifaddrs_vlan

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.vlan

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_epair_test.pcp

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_gif.4in4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_gif.4in6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_gif.6in4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_gif.6in6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_gif.etherip

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_gif.etherip6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.4in4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.4in6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.4mapped

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.6in4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.6in6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.bz283426

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.chacha

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.explicit_exit

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.gcm_128

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.multi_client

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.multihome4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.multihome6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.ra

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.route_to

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_ovpn.if_ovpn.timeout_client

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_stf.6rd

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_stf.6rd_peer

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_stf.6to4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_tun_test.basic

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_vlan.basic

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_vlan.qinq_deep

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_vlan.qinq_dot

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_vlan.qinq_legacy

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_vlan.qinq_simple

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_wg.wg_basic

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_wg.wg_basic_crossaf

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_wg.wg_basic_netmap

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_wg.wg_vnet_parent_routing

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.routing.test_routing_l3.py.TestIfOps::test_change_prefix_route[inet6]

Error Message:
/usr/tests/sys/net/routing/test_routing_l3.py:41: IndexError

FAILED:  sys.net.routing.test_routing_l3.py.TestIfOps::test_change_prefix_route[inet]

Error Message:
/usr/tests/sys/net/routing/test_routing_l3.py:41: IndexError

... and 450 other failed tests.