FreeBSD-main-amd64-test - Build #24083 - Still Unstable

From: <jenkins-admin_at_FreeBSD.org>
Date: Thu, 24 Aug 2023 00:40:42 UTC
FreeBSD-main-amd64-test - Build #24083 (d5b5497e10fd11dfea350d229406fa63fd0ea70f) - Still Unstable

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24083/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24083/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24083/console

Status explanation:
"Unstable" - some tests are suspected being broken by the following changes
"Still Unstable" - the failing test cases have not been fixed by these
                   following changes and this is a notification to note that
                   these changes have not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

69cfdc81ea7bdfe1e7300a7e1106419156aee434 by jrtc27:
tools/build/make.py: Keep bootstrapped bmake binary up-to-date

62f243acea24f52c6420720db615535045489c50 by jrtc27:
tools/build/make.py: Make --with-default-sys-path mirror usr.bin/bmake

ecf01a8ebc443d1b33c7b61a22f28145f41c25a9 by jrtc27:
Makefile: Support universe-toolchain on non-FreeBSD

c903f664780e2df7aff9ca84089d55dec5ff1dae by markj:
sh tests: Update $LINENO tests after $FreeBSD$ removal

0fd310c83c6b9d178d1bb4009a55bffdb1bd85c0 by manu:
arm64: Remove duplicate fdt build option

760987ecd39b54374aef40783b2c232997f3ac04 by rew:
bectl: make mount subcommand less verbose

d5b5497e10fd11dfea350d229406fa63fd0ea70f by markj:
m4 tests: Update tests after $FreeBSD$ removal



The failed test cases:

90 tests failed.
FAILED:  sys.net.if_ovpn.if_ovpn.ra

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.fs.tmpfs.times_test.empty

Error Message:
Incorrect atime

FAILED:  sbin.ping.ping_test.inject_opts

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sbin.ping.ping_test.inject_pip

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sbin.ping.ping_test.inject_reply

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sbin.ping.test_ping.py.__test_cases_list__

Error Message:
Test case list wrote to stderr

FAILED:  sys.net.if_bridge_test.span

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.net.if_bridge_test.stp_validation

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.divert.ipdivert_ip_input_local_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.divert.ipdivert_ip_output_remote_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.forward.fwd_ip_icmp_gw_fast_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.forward.fwd_ip_icmp_gw_slow_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.forward.fwd_ip_icmp_iface_fast_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.forward.fwd_ip_icmp_iface_slow_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet.redirect.valid_redirect

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.divert.ipdivert_ip6_output_remote_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.exthdr.exthdr

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.forward6.fwd_ip6_gu_icmp_gw_gu_fast_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.forward6.fwd_ip6_gu_icmp_gw_ll_fast_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.forward6.fwd_ip6_gu_icmp_gw_ll_slow_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.forward6.fwd_ip6_gu_icmp_iface_fast_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.forward6.fwd_ip6_gu_icmp_iface_slow_success

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_02.frag6_02

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_03.frag6_03

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_04.frag6_04

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_05.frag6_05_0

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_05.frag6_05_1

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_06.frag6_06_0

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_08.frag6_08

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_09.frag6_09

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_10.frag6_10

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_11.frag6_11

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_12.frag6_12

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_13.frag6_13

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_14.frag6_14

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_15.frag6_15

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_16.frag6_16

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_17.frag6_17

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_18.frag6_18

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_20.frag6_20

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.mld.mldraw01

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.scapyi386.scapyi386

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.common.forward.ipf_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.common.forward.ipfw_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.common.forward.pf_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.common.tos.ipfw_tos

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.common.tos.pf_tos

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.dup.dup_to

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.ether.bridge_to

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.forward.v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_compat.overindex

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_compat.overlimit

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_compat.overreplace

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_compat.v6

Error Message:
Test case body returned a non-ok exit code, but this is not allowed

FAILED:  sys.netpfil.pf.fragmentation_pass.no_df

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_pass.overindex

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_pass.overlimit

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_pass.overreplace

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_pass.reassemble_slowpath

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.fragmentation_pass.v6

Error Message:
Test case body returned a non-ok exit code, but this is not allowed

FAILED:  sys.netpfil.pf.icmp.cve_2019_5598

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.killstate.gateway

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.killstate.id

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.killstate.interface

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.killstate.label

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.killstate.multilabel

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.killstate.v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.modulate.modulate_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.modulate.modulate_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.pass_block.urpf

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.pfsync.defer

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.route_to.icmp_nat

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.rtable.forward_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.rtable.forward_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.max_mss_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.max_mss_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.min_ttl_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.min_ttl_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.no_scrub_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.no_scrub_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.set_tos_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_compat.set_tos_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_pass.max_mss_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_pass.max_mss_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_pass.min_ttl_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_pass.min_ttl_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_pass.set_tos_v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.scrub_pass.set_tos_v6

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netpfil.pf.set_tos.v4

Error Message:
atf-check failed; see the output of the test for details

FAILED:  sys.netinet6.frag6.frag6_19.frag6_19

Error Message:
atf-check failed; see the output of the test for details