[Bug 289150] sys/net/if_ovpn/if_ovpn tests failing in CI

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=289150

            Bug ID: 289150
           Summary: sys/net/if_ovpn/if_ovpn tests failing in CI
           Product: Base System
           Version: CURRENT
          Hardware: Any
                OS: Any
            Status: New
          Keywords: regression
          Severity: Affects Only Me
          Priority: ---
         Component: tests
          Assignee: kp@freebsd.org
          Reporter: me@svmhdvn.name
                CC: testing@FreeBSD.org

The following testcases in the 'sys/net/if_ovpn/if_ovpn' testsuite are failing
in CI:

sys/net/if_ovpn/if_ovpn:4in6  ->  failed: atf-check failed; see the output of
the test for details  [24.039s]
sys/net/if_ovpn/if_ovpn:float  ->  failed: Client not found in status list! 
[17.156s]
sys/net/if_ovpn/if_ovpn:linklocal  ->  failed: atf-check failed; see the output
of the test for details  [10.125s]

Currently, pkg.freebsd.org does not contain binary packages for
'security/openvpn' (as reported for FreeBSD:15:latest on both amd64 and aarch64
here: https://www.freshports.org/security/openvpn) due to previous package
build failures. However, these test failures are reproducible consistently
using a package repository built locally with poudriere on current
freebsd-ports HEAD.

I've attached the full Kyua test report from my test run in this bug, which
contains the stderr from these failing cases.

I have reproduced this error with two methods:

1. using src in-tree local CI (after overriding the ci.conf with a local pkg
repo):

# make -C tests/ci CITYPE=full PARALLEL_JOBS=2 VM_MEM_SIZE=4g
KYUA_TEST_FILTERS='sys/net/if_ovpn/if_ovpn'

2. using bricoler[0] with a local pkg repo:

$ bricoler run freebsd-src-regression-suite --param freebsd-src:url=/usr/src
--param freebsd-src:branch= --param
freebsd-src-regression-suite:hypervisor=bhyve --param
freebsd-src-regression-suite:memory=4096 --param
freebsd-src-regression-suite:ncpus=2 --param
freebsd-src-regression-suite:parallelism=1 --param
freebsd-src-regression-suite-vm-image:package_repo_file="/path/to/local.pkg.conf"
--param freebsd-src-regression-suite:tests='sys/net/if_ovpn/if_ovpn'

@kp I see that you wrote these test cases. Please triage as necessary.

[0] https://github.com/markjdb/bricoler

-- 
You are receiving this mail because:
You are on the CC list for the bug.