[Bug 291725] sys/netpfil/pf/snmp:table test fails in CI

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=291725

            Bug ID: 291725
           Summary: sys/netpfil/pf/snmp:table test fails in CI
           Product: Base System
           Version: 16.0-CURRENT
          Hardware: Any
                OS: Any
            Status: New
          Keywords: regression
          Severity: Affects Only Me
          Priority: ---
         Component: tests
          Assignee: kp@freebsd.org
          Reporter: me@svmhdvn.name
                CC: testing@FreeBSD.org

Created attachment 266271
  --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=266271&action=edit
kyua test report

The 'sys/netpfil/pf/snmp:table' testcase fails in CI:


===> sys/netpfil/pf/snmp:table
Result:     failed: atf-check failed; see the output of the test for details

Standard output:
Executing command [ ping -c 1 192.0.2.1 ]
Executing command [ bsnmpwalk -s public@192.0.2.1 -i pf_tree.def begemot ]
Executing command [ bsnmpwalk -s public@192.0.2.1 -i pf_tree.def pfTables ]
Executing command [ bsnmpwalk -s public@192.0.2.1 -i pf_tree.def pfTables ]
Executing command [ bsnmpwalk -s public@192.0.2.1 -i pf_tree.def pfTables ]
Executing command [ bsnmpwalk -s public@192.0.2.1 -i pf_tree.def pfTables ]

Standard error:
pf enabled
Ethernet rules cleared
rules cleared
nat cleared
0 tables deleted.
rules cleared
0 states cleared
source tracking entries cleared
pf: statistics cleared
pf: interface flags reset
Fail: regexp pfTablesAddrPktsInPass.* = [1-9][0-9]* not in stdout
pfTablesTblNumber.0 = 1
pfTablesTblDescr[6873] = foo
pfTablesTblCount[6873] = 1
pfTablesTblTZero[6873] = 600
pfTablesTblRefsAnchor[6873] = 0
pfTablesTblRefsRule[6873] = 0
pfTablesTblEvalMatch[6873] = 6
pfTablesTblEvalNoMatch[6873] = 0
pfTablesTblBytesInPass[6873] = 33392
pfTablesTblBytesInBlock[6873] = 0
pfTablesTblBytesInXPass[6873] = 0
pfTablesTblBytesOutPass[6873] = 34018
pfTablesTblBytesOutBlock[6873] = 0
pfTablesTblBytesOutXPass[6873] = 0
pfTablesTblPktsInPass[6873] = 437
pfTablesTblPktsInBlock[6873] = 0
pfTablesTblPktsInXPass[6873] = 0
pfTablesTblPktsOutPass[6873] = 436
pfTablesTblPktsOutBlock[6873] = 0
pfTablesTblPktsOutXPass[6873] = 0
pfTablesAddrNetType[1] = ipv4
pfTablesAddrNet[1] = 192.0.2.0
pfTablesAddrPrefix[1] = 24
pfTablesAddrTZero[1] = 600
pfTablesAddrBytesInPass[1] = 0
pfTablesAddrBytesInBlock[1] = 0
pfTablesAddrBytesOutPass[1] = 0
pfTablesAddrBytesOutBlock[1] = 0
pfTablesAddrPktsInPass[1] = 0
pfTablesAddrPktsInBlock[1] = 0
pfTablesAddrPktsOutPass[1] = 0
pfTablesAddrPktsOutBlock[1] = 0



I have reproduced this error using Bricoler with 100 runs for good measure and
attached the failing test report in this bug:

$ bricoler run freebsd-src-regression-suite --param freebsd-src:url=/usr/src
--param freebsd-src:branch= --param
freebsd-src-regression-suite:hypervisor=bhyve --param
freebsd-src-regression-suite:memory=4096 --param
freebsd-src-regression-suite:ncpus=2 --param
freebsd-src-regression-suite:parallelism=1 --param
freebsd-src-regression-suite:count=100 --param
freebsd-src-regression-suite:tests='sys/netpfil/pf/snmp:table'

@kp, since you made the last significant edit to the tests in
https://cgit.freebsd.org/src/commit/?id=f6aa57c86b6239e1f8c8ff50f28c9d0ed1af2ce3
(snmp_pf: use the libpfctl wrapper to retrieve astats), please triage as
necessary.

-- 
You are receiving this mail because:
You are on the CC list for the bug.