FreeBSD-main-amd64-test - Build #26432 - Failure

FreeBSD-main-amd64-test - Build #26432 (0f941203ac513f5ed3cf30038ac9e7a062acf1b7) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/26432/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/26432/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/26432/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

0f941203ac513f5ed3cf30038ac9e7a062acf1b7 by dougm:
vm_page: drop mpred from grab_valid_iter()



The end of the build log:

[...truncated 4.51 KiB...]
+ IMG_NAME=disk-test.img
+ JOB_DIR=freebsd-ci/jobs/FreeBSD-main-amd64-test
+ dirname freebsd-ci/scripts/test/run-tests.sh
+ TEST_BASE=freebsd-ci/scripts/test
+ TIMEOUT_MS=21600000
+ TIMEOUT=21600
+ TIMEOUT_EXPECT=21540
+ TIMEOUT_VM=21420
+ : 2
+ : 8192m
+ EXTRA_DISK_NUM=5
+ BHYVE_EXTRA_DISK_PARAM=''
+ METADIR=meta
+ METAOUTDIR=meta-out
+ fetch https://artifact.ci.freebsd.org/snapshot/main/0f941203ac513f5ed3cf30038ac9e7a062acf1b7/amd64/amd64/disk-test.img.zst
disk-test.img.zst                                     1114 MB  101 MBps    11s
+ zstd --rm -fd disk-test.img.zst
+ truncate -s 128m disk-cam
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam'
+ jot 5
+ truncate -s 128m disk1
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1'
+ truncate -s 128m disk2
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2'
+ truncate -s 128m disk3
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3'
+ truncate -s 128m disk4
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4'
+ truncate -s 128m disk5
+ BHYVE_EXTRA_DISK_PARAM=' -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4 -s 9:0,virtio-blk,disk5'
+ rm -fr meta
+ mkdir meta
+ cp -R freebsd-ci/jobs/FreeBSD-main-amd64-test/meta/ meta/
+ cp freebsd-ci/scripts/test/subr/disable-dtrace-tests.sh meta/
+ cp freebsd-ci/scripts/test/subr/disable-zfs-tests.sh meta/
+ cp freebsd-ci/scripts/test/subr/disable-notyet-tests.sh meta/
+ cp freebsd-ci/scripts/test/subr/run-kyua.sh meta/
+ touch meta/auto-shutdown
+ sh -ex freebsd-ci/scripts/test/create-meta.sh
+ rm -f meta.tar
+ truncate -s 512M meta.tar
+ tar rvf meta.tar -C meta .
a .
a ./run.sh
a ./disable-dtrace-tests.sh
a ./run-kyua.sh
a ./disable-zfs-tests.sh
a ./auto-shutdown
a ./disable-notyet-tests.sh
+ echo main
+ sed -e 's,.*-,,'
+ FBSD_BRANCH_SHORT=main
+ TEST_VM_NAME=testvm-main-amd64-26432
+ [ '' '=' 1 ]
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-26432' --destroy
vm_open: testvm-main-amd64-26432 could not be opened: No such file or directory
+ true
+ sudo /usr/sbin/bhyveload -c stdio -m 8192m -d disk-test.img testvm-main-amd64-26432
Consoles: userboot  

FreeBSD/amd64 User boot lua, Revision 3.0
(Mon Apr  7 16:14:49 UTC 2025 root@build-15.freebsd.org)
|/-\|Loading /boot/defaults/loader.conf
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
/Loading /boot/loader.conf
Loading /boot/loader.conf.local
-\c|/  ```                        ` s` `.....---.......--.```   -/ +o   .--`         /y:`      +.  yo`:.            :o      `+-   y/               -/`   -o/  .-                  ::/sy+:.  /                     `--  / `:                          :` `:                          :`  /                          /  .-                        -.   --                      -.    `:`                  `:`      .--             `--.         .---.....----.  ______               ____   _____ _____   |  ____|             |  _ \ / ____|  __ \  | |___ _ __ ___  ___ | |_) | (___ | |  | | |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | | | |   | | |  __/  __/| |_) |____) | |__| | | |   | | |    |    ||     |      |      | |_|   |_|  \___|\___||____/|_____/|_____/ ++++----------------------------------------------------------------------------|||||||||||||||||||||||||| Welcome to FreeBSD 1. Boot Multi user [Enter]2. Boot Single user3. Escape to loader prompt4. Reboot5. Cons: SerialKernel:-\|/-\|/-\|6. kernel (1 of 1)Options:7. Boot OptionsAutoboot in 1 seconds. [Space] to pause Autoboot in 0 seconds. [Space] to pause Loading kernel...
/-/boot/kernel/kernel text=0x18c008 \text=0xdfed38 |/-\|/-text=0x49a225 \|data=0x180+0xe80 data=0x1aecb0+0x451350 /0x8+0x1a7798-+0x8+0x1d3def\
Loading configured modules...
can't find '/etc/hostid'
|//boot/kernel/mac_bsdextended.ko size 0x61d8 at 0x237c000
-/boot/entropy size=0x1000
+ set +e
+ expect -c $'set timeout 21540; \t\tspawn sudo /usr/bin/timeout -k 60 21420 /usr/sbin/bhyve \t\t-c 2 -m 8192m -A -H -P \t\t-s 0:0,hostbridge \t\t-s 1:0,lpc \t\t-s 2:0,virtio-blk,disk-test.img \t\t-s 3:0,virtio-blk,meta.tar \t\t -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4 -s 9:0,virtio-blk,disk5 \t\t-l com1,stdio \t\ttestvm-main-amd64-26432; \t\texpect { eof }'
spawn sudo /usr/bin/timeout -k 60 21420 /usr/sbin/bhyve -c 2 -m 8192m -A -H -P -s 0:0,hostbridge -s 1:0,lpc -s 2:0,virtio-blk,disk-test.img -s 3:0,virtio-blk,meta.tar -s 4:0,ahci-hd,disk-cam -s 5:0,virtio-blk,disk1 -s 6:0,virtio-blk,disk2 -s 7:0,virtio-blk,disk3 -s 8:0,virtio-blk,disk4 -s 9:0,virtio-blk,disk5 -l com1,stdio testvm-main-amd64-26432
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
---<<BOOT>>---
Copyright (c) 1992-2025 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 15.0-CURRENT #0 0f941203ac51: Tue May 20 08:01:08 UTC 2025
    root@FreeBSD-main-amd64-build.jail.ci.FreeBSD.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
FreeBSD clang version 19.1.7 (https://github.com/llvm/llvm-project.git llvmorg-19.1.7-0-gcd708029e0b2)
WARNING: WITNESS option enabled, expect reduced performance.
VT: init without driver.
CPU: Intel(R) Xeon(R) CPU           X5675  @ 3.07GHz (3067.30-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x206c2  Family=0x6  Model=0x2c  Stepping=2
  Features=0x9f83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS,HTT,PBE>
  Features2=0x829e6217<SSE3,PCLMULQDQ,DTES64,DS_CPL,SSSE3,CX16,xTPR,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AESNI,HV>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant
Hypervisor: Origin = "bhyve bhyve "
real memory  = 9663676416 (9216 MB)
avail memory = 8257433600 (7874 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <BHYVE  BVAPIC >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 2 package(s) x 1 core(s)
random: unblocking device.
Security policy loaded: TrustedBSD MAC/BSD Extended (mac_bsdextended)
ioapic0 <Version 1.1> irqs 0-31
Launching APs: 1
random: entropy device external interface
kbd1 at kbdmux0
smbios0: <System Management BIOS> at iomem 0xf1000-0xf101e
smbios0: Entry point: v2.1 (32-bit), Version: 2.6, BCD Revision: 2.6
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS>
acpi0: <BHYVE BVXSDT >
acpi0: Power Button (fixed)
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 16777216 Hz quality 950
Event timer "HPET" frequency 16777216 Hz quality 550
Event timer "HPET1" frequency 16777216 Hz quality 450
Event timer "HPET2" frequency 16777216 Hz quality 450
Event timer "HPET3" frequency 16777216 Hz quality 450
Event timer "HPET4" frequency 16777216 Hz quality 450
Event timer "HPET5" frequency 16777216 Hz quality 450
Event timer "HPET6" frequency 16777216 Hz quality 450
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
virtio_pci0: <VirtIO PCI (legacy) Block adapter> port 0x2000-0x207f mem 0xc0000000-0xc0001fff irq 16 at device 2.0 on pci0
vtblk0: <VirtIO Block Adapter> on virtio_pci0
vtblk0: 9216MB (18874557 512 byte sectors)
virtio_pci1: <VirtIO PCI (legacy) Block adapter> port 0x2080-0x20ff mem 0xc0002000-0xc0003fff irq 17 at device 3.0 on pci0
vtblk1: <VirtIO Block Adapter> on virtio_pci1
vtblk1: 512MB (1048576 512 byte sectors)
ahci0: <Intel ICH8 AHCI SATA controller> mem 0xc0004000-0xc0005fff irq 18 at device 4.0 on pci0
ahci0: AHCI v1.30 with 32 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
virtio_pci2: <VirtIO PCI (legacy) Block adapter> port 0x2100-0x217f mem 0xc0006000-0xc0007fff irq 19 at device 5.0 on pci0
vtblk2: <VirtIO Block Adapter> on virtio_pci2
vtblk2: 128MB (262144 512 byte sectors)
virtio_pci3: <VirtIO PCI (legacy) Block adapter> port 0x2180-0x21ff mem 0xc0008000-0xc0009fff irq 20 at device 6.0 on pci0
vtblk3: <VirtIO Block Adapter> on virtio_pci3
vtblk3: 128MB (262144 512 byte sectors)
virtio_pci4: <VirtIO PCI (legacy) Block adapter> port 0x2200-0x227f mem 0xc000a000-0xc000bfff irq 21 at device 7.0 on pci0
vtblk4: <VirtIO Block Adapter> on virtio_pci4
vtblk4: 128MB (262144 512 byte sectors)
virtio_pci5: <VirtIO PCI (legacy) Block adapter> port 0x2280-0x22ff mem 0xc000c000-0xc000dfff irq 22 at device 8.0 on pci0
vtblk5: <VirtIO Block Adapter> on virtio_pci5
vtblk5: 128MB (262144 512 byte sectors)
virtio_pci6: <VirtIO PCI (legacy) Block adapter> port 0x2300-0x237f mem 0xc000e000-0xc000ffff irq 23 at device 9.0 on pci0
vtblk6: <VirtIO Block Adapter> on virtio_pci6
vtblk6: 128MB (262144 512 byte sectors)
vmgenc0: <VM Generation Counter> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
driver bug: Unable to set devclass (class: atkbdc devname: (unknown))
Unhandled ps2 mouse command 0xe1
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 15.0.
psm0: model Generic PS/2 mouse, device ID 0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (115200,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart2: <16550 or compatible> port 0x3e8-0x3ef irq 4 on acpi0
uart3: <16550 or compatible> port 0x2e8-0x2ef irq 3 on acpi0
vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff pnpid PNP0900 on isa0
Timecounter "TSC-low" frequency 1533473593 Hz quality 1000
Timecounters tick every 10.000 msec
usb_needs_explore_all: no devclass
Trying to mount root from ufs:/dev/gpt/rootfs [rw]...
WARNING: WITNESS option enabled, expect reduced performance.
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <BHYVE SATA DISK 001> ACS-2 ATA SATA 3.x device
ada0: Serial Number BHYVE-AC61-4EA8-6E92
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 128MB (262144 512 byte sectors)
panic: vm_page_assert_xbusied: page 0xfffff8010260c070 not exclusive busy @ /usr/src/sys/vm/vm_pager.c:299
cpuid = 1
time = 1747742030
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008de4a710
vpanic() at vpanic+0x136/frame 0xfffffe008de4a840
panic() at panic+0x43/frame 0xfffffe008de4a8a0
vm_pager_assert_in() at vm_pager_assert_in+0x191/frame 0xfffffe008de4a8e0
vm_pager_get_pages() at vm_pager_get_pages+0x3a/frame 0xfffffe008de4a930
vm_page_grab_valid_iter() at vm_page_grab_valid_iter+0x3e1/frame 0xfffffe008de4aa40
vm_page_grab_valid_unlocked() at vm_page_grab_valid_unlocked+0xe4/frame 0xfffffe008de4aaa0
exec_map_first_page() at exec_map_first_page+0x9d/frame 0xfffffe008de4aad0
kern_execve() at kern_execve+0x52f/frame 0xfffffe008de4ae60
start_init() at start_init+0x1c6/frame 0xfffffe008de4aef0
fork_exit() at fork_exit+0x82/frame 0xfffffe008de4af30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008de4af30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic
[ thread pid 1 tid 100002 ]
Stopped at      kdb_enter+0x33: movq    $0,0x1232382(%rip)
db> + rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-26432' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run.sh
x ./disable-dtrace-tests.sh
x ./run-kyua.sh
x ./disable-zfs-tests.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins12651565792666466414.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '0f941203ac513f5ed3cf30038ac9e7a062acf1b7', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../0f941203ac513f5ed3cf30038ac9e7a062acf1b7/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address