FreeBSD-main-amd64-test - Build #19824 - Still Failing

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #19825 - Unstable"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #19823 - Still Failing"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Tue, 16 Nov 2021 18:51:17 UTC
FreeBSD-main-amd64-test - Build #19824 (8ef0c11e7ce79106130012cb929a8324045f7ff9) - Still Failing

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19824/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19824/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/19824/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

8ef0c11e7ce79106130012cb929a8324045f7ff9 by kib:
nfsclient: upgrade vnode lock in VOP_OPEN()/VOP_CLOSE() if we need to



The end of the build log:

[...truncated 4.20 MB...]
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063bacc00
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063bacc10
_sleep() at _sleep+0x2dd/frame 0xfffffe0063baccb0
audit_read() at audit_read+0x9c/frame 0xfffffe0063bacce0
devfs_read_f() at devfs_read_f+0xe5/frame 0xfffffe0063bacd40
dofileread() at dofileread+0x81/frame 0xfffffe0063bacd90
sys_read() at sys_read+0xc0/frame 0xfffffe0063bace00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063bacf30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063bacf30
--- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8011d015a, rsp = 0x7fffffffeb68, rbp = 0x7fffffffebb0 ---

Tracing command sh pid 725 tid 100090 td 0xfffffe0079198c80
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b52a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b52a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b52a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b52ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b52ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b52b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b52c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b52e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b52f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b52f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120833a, rsp = 0x7fffffffcf58, rbp = 0x7fffffffd010 ---

Tracing command sh pid 738 tid 100094 td 0xfffffe0079197000
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b3ea10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b3ea30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b3ea70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b3eac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b3ead0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b3eb70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b3ec00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b3ee00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b3ef30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b3ef30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120833a, rsp = 0x7fffffffe7e8, rbp = 0x7fffffffe8a0 ---

Tracing command sh pid 745 tid 100098 td 0xfffffe0009959560
sched_switch() at sched_switch+0x559/frame 0xfffffe00085a4a10
mi_switch() at mi_switch+0x157/frame 0xfffffe00085a4a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00085a4a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe00085a4ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00085a4ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe00085a4b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe00085a4c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe00085a4e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe00085a4f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00085a4f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80120833a, rsp = 0x7fffffffe7e8, rbp = 0x7fffffffe8a0 ---

Tracing command kyua pid 746 tid 100092 td 0xfffffe0079197e40
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b48a10
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b48a30
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b48a70
sleepq_catch_signals() at sleepq_catch_signals+0x266/frame 0xfffffe0063b48ac0
sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe0063b48ad0
_sleep() at _sleep+0x2dd/frame 0xfffffe0063b48b70
kern_wait6() at kern_wait6+0x474/frame 0xfffffe0063b48c00
sys_wait4() at sys_wait4+0x7d/frame 0xfffffe0063b48e00
amd64_syscall() at amd64_syscall+0x6b4/frame 0xfffffe0063b48f30
fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0063b48f30
--- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80152233a, rsp = 0x7fffffffdc38, rbp = 0x7fffffffdc70 ---

Tracing command aiod27 pid 58250 tid 100116 td 0xfffffe00a6929560
sched_switch() at sched_switch+0x559/frame 0xfffffe0078ff0d60
mi_switch() at mi_switch+0x157/frame 0xfffffe0078ff0d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0078ff0dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0078ff0e00
_sleep() at _sleep+0x2ce/frame 0xfffffe0078ff0ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0078ff0ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0078ff0f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078ff0f30
--- trap 0xc, rip = 0x8011a5d9a, rsp = 0x7fffffffea08, rbp = 0x7fffffffea20 ---

Tracing command aiod28 pid 58251 tid 100088 td 0xfffffe0079199ac0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b5cd60
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b5cd80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b5cdc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b5ce00
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b5cea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe0063b5cef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b5cf30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b5cf30
--- trap 0xc, rip = 0x801205d9a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 ---

Tracing command aiod31 pid 58254 tid 100619 td 0xfffffe00a7153e40
sched_switch() at sched_switch+0x559/frame 0xfffffe00a72e5d60
mi_switch() at mi_switch+0x157/frame 0xfffffe00a72e5d80
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a72e5dc0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a72e5e00
_sleep() at _sleep+0x2ce/frame 0xfffffe00a72e5ea0
aio_daemon() at aio_daemon+0x305/frame 0xfffffe00a72e5ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a72e5f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a72e5f30
--- trap 0xc, rip = 0x801205d9a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe3f0 ---

Tracing command soaiod1 pid 58262 tid 101388 td 0xfffffe00a952a3a0
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7312d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7312d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7312dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a7312e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a7312eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a7312ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7312f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7312f30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd528, rbp = 0x7fffffffd540 ---

Tracing command soaiod2 pid 58263 tid 101387 td 0xfffffe00a7156900
sched_switch() at sched_switch+0x559/frame 0xfffffe00a720ed70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a720ed90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a720edd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a720ee10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a720eeb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a720eef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a720ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a720ef30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd528, rbp = 0x7fffffffd540 ---

Tracing command soaiod3 pid 58264 tid 101386 td 0xfffffe00a71bf020
sched_switch() at sched_switch+0x559/frame 0xfffffe00a72c7d70
mi_switch() at mi_switch+0x157/frame 0xfffffe00a72c7d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a72c7dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00a72c7e10
_sleep() at _sleep+0x2ce/frame 0xfffffe00a72c7eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe00a72c7ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a72c7f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a72c7f30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd538, rbp = 0x7fffffffd550 ---

Tracing command soaiod4 pid 58265 tid 100111 td 0xfffffe00a692b900
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b93d70
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b93d90
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b93dd0
sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0063b93e10
_sleep() at _sleep+0x2ce/frame 0xfffffe0063b93eb0
soaio_kproc_loop() at soaio_kproc_loop+0x125/frame 0xfffffe0063b93ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b93f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b93f30
--- trap 0xc, rip = 0x8011edd9a, rsp = 0x7fffffffd528, rbp = 0x7fffffffd540 ---

Tracing command g_mp_kt pid 967 tid 101397 td 0xfffffe00791b81e0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063bfeda0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063bfedc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063bfee00
_sleep() at _sleep+0x2e7/frame 0xfffffe0063bfeea0
g_multipath_kt() at g_multipath_kt+0x275/frame 0xfffffe0063bfeef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063bfef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063bfef30
--- trap 0xc, rip = 0x8011a7d9a, rsp = 0x7fffffffeae8, rbp = 0x7fffffffeb00 ---

Tracing command md0 pid 30328 tid 100112 td 0xfffffe00a692b1e0
sched_switch() at sched_switch+0x559/frame 0xfffffe0063b8eda0
mi_switch() at mi_switch+0x157/frame 0xfffffe0063b8edc0
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe0063b8ee00
_sleep() at _sleep+0x2e7/frame 0xfffffe0063b8eea0
md_kthread() at md_kthread+0xd5/frame 0xfffffe0063b8eef0
fork_exit() at fork_exit+0x80/frame 0xfffffe0063b8ef30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0063b8ef30
--- trap 0xc, rip = 0x801207d9a, rsp = 0x7fffffffe848, rbp = 0x7fffffffe940 ---

Tracing command atf-sh pid 57149 tid 102583 td 0xfffffe00a77ba560 (CPU 1)
cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00097cbe00
ipi_nmi_handler() at ipi_nmi_handler+0x39/frame 0xfffffe00097cbe10
trap() at trap+0x56/frame 0xfffffe00097cbf20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00097cbf20
--- trap 0x13, rip = 0xffffffff80f7b0d7, rsp = 0xfffffe00ac94ab80, rbp = 0xfffffe00ac94ac50 ---
vm_map_lookup() at vm_map_lookup+0x987/frame 0xfffffe00ac94ac50
vm_fault() at vm_fault+0xf8/frame 0xfffffe00ac94ad80
vm_fault_trap() at vm_fault_trap+0x71/frame 0xfffffe00ac94adc0
trap_pfault() at trap_pfault+0x22d/frame 0xfffffe00ac94ae20
trap() at trap+0x442/frame 0xfffffe00ac94af30
calltrap() at calltrap+0x8/frame 0xfffffe00ac94af30
--- trap 0xc, rip = 0x801043645, rsp = 0x7fffffffcf58, rbp = 0x7fffffffd0b0 ---

Tracing command KTLS pid 3949 tid 101410 td 0xfffffe00a71bc560
sched_switch() at sched_switch+0x559/frame 0xfffffe00a9971d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a9971d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a9971d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a9971e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a9971ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a9971f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a9971f30
--- trap 0xc, rip = 0x801241d9a, rsp = 0x7fffffffe728, rbp = 0x7fffffffe7e0 ---

Tracing command KTLS pid 3949 tid 102087 td 0xfffffe00a88b5c80
sched_switch() at sched_switch+0x559/frame 0xfffffe00a9967d00
mi_switch() at mi_switch+0x157/frame 0xfffffe00a9967d20
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a9967d60
_sleep() at _sleep+0x2e7/frame 0xfffffe00a9967e00
ktls_work_thread() at ktls_work_thread+0x19c/frame 0xfffffe00a9967ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a9967f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a9967f30
--- trap 0x16, rip = 0x8013fdd9a, rsp = 0x7fffdf7f9a88, rbp = 0x7fffdf7f9aa0 ---

Tracing command KTLS pid 3949 tid 102088 td 0xfffffe00a7194740
sched_switch() at sched_switch+0x559/frame 0xfffffe00a7335d40
mi_switch() at mi_switch+0x157/frame 0xfffffe00a7335d60
sleepq_switch() at sleepq_switch+0x107/frame 0xfffffe00a7335da0
_sleep() at _sleep+0x2e7/frame 0xfffffe00a7335e40
ktls_alloc_thread() at ktls_alloc_thread+0x204/frame 0xfffffe00a7335ef0
fork_exit() at fork_exit+0x80/frame 0xfffffe00a7335f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00a7335f30
--- trap 0x16, rip = 0x8013fdd9a, rsp = 0x7fffdfbfba88, rbp = 0x7fffdfbfbaa0 ---
db:0:kdb.enter.panic> dump
Dumping 503 out of 4058 MB:..4%..13%..23%..32%..42%..51%..61%..74%..83%..93%
Dump complete
db:0:kdb.enter.panic> reset
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-19824' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-notyet-tests.sh
x ./auto-shutdown
x ./run.sh
x ./disable-dtrace-tests.sh
x ./run-kyua.sh
x ./disable-zfs-tests.sh
+ rm -f 'test-report.*'
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins7337285900365282708.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '8ef0c11e7ce79106130012cb929a8324045f7ff9', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../8ef0c11e7ce79106130012cb929a8324045f7ff9/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address