FreeBSD-main-amd64-test - Build #28870 - Still Failing

From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 24 Jun 2026 04:53:24 UTC
FreeBSD-main-amd64-test - Build #28870 (2c1482e305368af182a7bde0e53d0d180b319326) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28870/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28870/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28870/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

cf469ab83012ee47d06bc89874b6c109f49446e0 by mhorne:
hwpmc_amd: Avoid using PMCs if in use by firmware

ed4f5e590ee643d784af12541df3f13768937485 by mhorne:
hwpmc_ibs: Add more IBS register definitions

074ff8746388b3ed8581a84a7eea7b4b3e1bfe23 by gallatin:
iflib: handle transient errors from isc_txd_encap()

fdca6b70aa7ebbc95b544cec6e155ea5b1041899 by gallatin:
bnxt: Report actual link speed, rather than hard-coded 100Gbs

2c1482e305368af182a7bde0e53d0d180b319326 by asomers:
fusefs: fix a race in the pre-init tests



The end of the build log:

[...truncated 5.27 MiB...]
epair0b: Ethernet address: 58:9c:fc:10:ef:67
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed  [0.111s]
sbin/savecore/livedump_test:livedump_kldstat  ->  Dumping 1048 out of 8151 MB:..2%..11%..22%..31%..42%..51%..62%..71%..81%..91%
Dump complete
passed  [5.095s]
sys/acl/00:main  ->  passed  [0.414s]
sys/acl/01:main  ->  passed  [0.879s]
sys/acl/02:main  ->  passed  [0.823s]
sys/acl/03:main  ->  passed  [0.675s]
sys/acl/04:main  ->  passed  [0.206s]
sys/aio/lio_test:lio_listio_eagain_kevent  ->  passed  [0.009s]
sys/aio/lio_test:lio_listio_empty_nowait  ->  passed  [0.006s]
sys/aio/lio_test:lio_listio_empty_nowait_kevent  ->  expected_failure: Bug 251515 - lio_listio(2) never sends kevent if nent==0  [10.003s]
sys/aio/lio_test:lio_listio_empty_nowait_signal  ->  passed  [0.008s]
sys/aio/lio_test:lio_listio_empty_nowait_thread  ->  passed  [0.006s]
sys/aio/lio_test:lio_listio_empty_wait  ->  passed  [0.006s]
sys/aio/lio_test:lio_listio_invalid_opcode  ->  passed  [0.006s]
sys/aio/lio_test:lio_listio_opcodes  ->  passed  [0.006s]
sys/audit/administrative:acct_failure  ->  2026-06-24T04:53:21.584328+00:00 - auditd 1597 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:acct_success  ->  Accounting enabled
2026-06-24T04:53:21.604603+00:00 - auditd 1597 - - Got audit initialize trigger
Accounting disabled
passed  [0.008s]
sys/audit/administrative:adjtime_failure  ->  2026-06-24T04:53:21.670970+00:00 - auditd 1597 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:adjtime_success  ->  2026-06-24T04:53:21.691866+00:00 - auditd 1597 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditctl_failure  ->  2026-06-24T04:53:21.712191+00:00 - auditd 1597 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditctl_success  ->  2026-06-24T04:53:21.732390+00:00 - auditd 1597 - - Got audit initialize trigger
2026-06-24T04:53:21.790639+00:00 - auditd 1597 - - Got close and die trigger
2026-06-24T04:53:21.791226+00:00 - auditd 1597 - - Auditing disabled
2026-06-24T04:53:21.792191+00:00 - auditd 1597 - - renamed /var/audit/20260624023636.not_terminated to /var/audit/20260624023636.20260624045321
2026-06-24T04:53:21.792757+00:00 - auditd 1597 - - Finished
2026-06-24T04:53:21.794028+00:00 - auditd 1597 - - auditd exiting.
2026-06-24T04:53:21.841960+00:00 - auditd 75313 - - starting...
2026-06-24T04:53:21.842848+00:00 - auditd 75314 - - Auditing disabled
2026-06-24T04:53:21.843566+00:00 - auditd 75314 - - Configured trail files distribution.
2026-06-24T04:53:21.844535+00:00 - auditd 75314 - - Auditing enabled
2026-06-24T04:53:21.845087+00:00 - auditd 75314 - - New audit file is /var/audit/20260624045321.not_terminated
passed  [0.008s]
sys/audit/administrative:auditon_default_failure  ->  2026-06-24T04:53:21.847708+00:00 - auditd 75314 - - Registered 678 event to class mappings.
2026-06-24T04:53:21.847874+00:00 - auditd 75314 - - Registered non-attributable event mask.
2026-06-24T04:53:21.849117+00:00 - auditd 75314 - - Set audit policy in kernel.
2026-06-24T04:53:21.849272+00:00 - auditd 75314 - - Set audit trail size in kernel.
2026-06-24T04:53:21.849416+00:00 - auditd 75314 - - Set audit trail queue in kernel.
2026-06-24T04:53:21.849559+00:00 - auditd 75314 - - Set audit trail min free percent in kernel.
2026-06-24T04:53:21.849709+00:00 - auditd 75314 - - audit_control(5) may be missing 'host:' field
2026-06-24T04:53:21.849870+00:00 - auditd 75314 - - Audit controls init successful
2026-06-24T04:53:21.861048+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.009s]
sys/audit/administrative:auditon_default_success  ->  2026-06-24T04:53:21.881714+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_getcar_failure  ->  2026-06-24T04:53:21.901959+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getclass_failure  ->  2026-06-24T04:53:21.922729+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_getclass_success  ->  2026-06-24T04:53:21.942771+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_getcond_failure  ->  2026-06-24T04:53:21.962625+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getcond_success  ->  2026-06-24T04:53:21.982803+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_getcwd_failure  ->  2026-06-24T04:53:22.002755+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getkmask_failure  ->  2026-06-24T04:53:22.022355+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getkmask_success  ->  2026-06-24T04:53:22.042547+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_getpolicy_failure  ->  2026-06-24T04:53:22.062361+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getpolicy_success  ->  2026-06-24T04:53:22.081999+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getqctrl_failure  ->  2026-06-24T04:53:22.101517+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getqctrl_success  ->  2026-06-24T04:53:22.121075+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_getstat_failure  ->  2026-06-24T04:53:22.140255+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_setclass_failure  ->  2026-06-24T04:53:22.160236+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_setclass_success  ->  2026-06-24T04:53:22.179991+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_setcond_failure  ->  2026-06-24T04:53:22.199687+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_setcond_success  ->  2026-06-24T04:53:22.219585+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_setkmask_failure  ->  2026-06-24T04:53:22.243481+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_setkmask_success  ->  2026-06-24T04:53:22.263633+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_setpolicy_failure  ->  2026-06-24T04:53:22.283913+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_setpolicy_success  ->  2026-06-24T04:53:22.307165+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.011s]
sys/audit/administrative:auditon_setqctrl_failure  ->  2026-06-24T04:53:22.332906+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.009s]
sys/audit/administrative:auditon_setqctrl_success  ->  2026-06-24T04:53:22.355104+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_setsmask_failure  ->  2026-06-24T04:53:22.375321+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:auditon_setstat_failure  ->  2026-06-24T04:53:22.395035+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:auditon_setumask_failure  ->  2026-06-24T04:53:22.415132+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:clock_settime_failure  ->  2026-06-24T04:53:22.435320+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:clock_settime_success  ->  2026-06-24T04:53:22.455513+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:getaudit_addr_failure  ->  2026-06-24T04:53:22.475636+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:getaudit_addr_success  ->  2026-06-24T04:53:22.495783+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:getaudit_failure  ->  2026-06-24T04:53:22.516226+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:getaudit_success  ->  2026-06-24T04:53:22.536321+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:getauid_failure  ->  2026-06-24T04:53:22.556215+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:getauid_success  ->  2026-06-24T04:53:22.576081+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:mount_failure  ->  2026-06-24T04:53:22.595540+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:nfs_getfh_failure  ->  2026-06-24T04:53:22.615473+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:nfs_getfh_success  ->  2026-06-24T04:53:22.635117+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:nmount_failure  ->  2026-06-24T04:53:22.654756+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:ntp_adjtime_failure  ->  2026-06-24T04:53:22.674933+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:ntp_adjtime_success  ->  2026-06-24T04:53:22.694775+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:quotactl_failure  ->  2026-06-24T04:53:22.714936+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:reboot_failure  ->  2026-06-24T04:53:22.735557+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:setaudit_addr_failure  ->  2026-06-24T04:53:22.755860+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:setaudit_addr_success  ->  2026-06-24T04:53:22.776147+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:setaudit_failure  ->  2026-06-24T04:53:22.796178+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:setaudit_success  ->  2026-06-24T04:53:22.816018+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:setauid_failure  ->  2026-06-24T04:53:22.835975+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:setauid_success  ->  2026-06-24T04:53:22.855414+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:settimeofday_failure  ->  2026-06-24T04:53:22.875214+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:settimeofday_success  ->  2026-06-24T04:53:22.894787+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/administrative:swapoff_failure  ->  2026-06-24T04:53:22.914641+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/administrative:swapon_failure  ->  2026-06-24T04:53:22.934850+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-attribute-access:access_failure  ->  2026-06-24T04:53:22.954568+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-attribute-access:access_success  ->  2026-06-24T04:53:22.973662+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-attribute-access:eaccess_failure  ->  2026-06-24T04:53:22.993220+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-attribute-access:eaccess_success  ->  2026-06-24T04:53:23.013252+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-attribute-access:extattr_get_fd_failure  ->  2026-06-24T04:53:23.033207+00:00 - auditd 75314 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-attribute-access:extattr_get_fd_success  ->  panic: audit_syscall_enter: td->td_ar != NULL
cpuid = 1
time = 1782276803
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x36/frame 0xfffffe008c0f9c20
vpanic() at vpanic+0x149/frame 0xfffffe008c0f9d50
panic() at panic+0x43/frame 0xfffffe008c0f9db0
audit_syscall_enter() at audit_syscall_enter+0x1c7/frame 0xfffffe008c0f9df0
amd64_syscall() at amd64_syscall+0x466/frame 0xfffffe008c0f9f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe008c0f9f30
--- syscall (545, FreeBSD ELF64, ppoll), rip = 0x8257ce30a, rsp = 0x8207265a8, rbp = 0x820726e60 ---
KDB: enter: panic
[ thread pid 75433 tid 103879 ]
Stopped at      kdb_enter+0x33: movq    $0,0x15a7d02(%rip)
db:0:kdb.enter.panic> show pcpu
cpuid        = 1
dynamic pcpu = 0xfffffe008d3bde40
curthread    = 0xfffff80065806780: pid 75433 tid 103879 critnest 1 "file-attribute-acce"
curpcb       = 0xfffff80065806cd0
fpcurthread  = 0xfffff80065806780: pid 75433 "file-attribute-acce"
idlethread   = 0xfffff8010240c000: tid 100004 "idle: cpu1"
self         = 0xffffffff82a11000
curpmap      = 0xfffff8011abe0358
tssp         = 0xffffffff82a11384
rsp0         = 0xfffffe008c0fa000
kcr3         = 0x800000010ef603ee
ucr3         = 0x800000002a070bee
scr3         = 0x2a070bee
gs32p        = 0xffffffff82a11404
ldt          = 0xffffffff82a11444
tss          = 0xffffffff82a11434
curvnet      = 0
spin locks held:
db:0:kdb.enter.panic>  reset
Uptime: 2h16m49s
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-28870' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./disable-zfs-tests.sh
x ./run-kyua.sh
x ./run.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins12508530249082741024.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '2c1482e305368af182a7bde0e53d0d180b319326', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../2c1482e305368af182a7bde0e53d0d180b319326/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address