FreeBSD-main-amd64-test - Build #24086 - Failure

From: <jenkins-admin_at_FreeBSD.org>
Date: Thu, 24 Aug 2023 15:01:12 UTC
FreeBSD-main-amd64-test - Build #24086 (d10de21f2f7df59344f8611546989b36e4fd867c) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24086/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24086/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24086/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

d10de21f2f7df59344f8611546989b36e4fd867c by kp:
pf: Access r->rpool.cur->kif under mutex protection



The end of the build log:

[...truncated 4.35 MB...]
sys/audit/file-create:mkfifoat_success  ->  2023-08-24T15:01:03.006159+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-create:mknod_failure  ->  2023-08-24T15:01:03.025247+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-create:mknod_success  ->  2023-08-24T15:01:03.044373+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-create:mknodat_failure  ->  2023-08-24T15:01:03.063143+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-create:mknodat_success  ->  2023-08-24T15:01:03.084094+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-create:rename_failure  ->  2023-08-24T15:01:03.102741+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-create:rename_success  ->  2023-08-24T15:01:03.120622+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-create:renameat_failure  ->  2023-08-24T15:01:03.145073+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.011s]
sys/audit/file-create:renameat_success  ->  2023-08-24T15:01:03.175106+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.011s]
sys/audit/file-create:symlink_failure  ->  2023-08-24T15:01:03.206080+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.011s]
sys/audit/file-create:symlink_success  ->  2023-08-24T15:01:03.227553+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-create:symlinkat_failure  ->  2023-08-24T15:01:03.251310+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-create:symlinkat_success  ->  2023-08-24T15:01:03.271544+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-delete:rename_failure  ->  2023-08-24T15:01:03.291099+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-delete:rename_success  ->  2023-08-24T15:01:03.308274+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-delete:renameat_failure  ->  2023-08-24T15:01:03.325543+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-delete:renameat_success  ->  2023-08-24T15:01:03.342796+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-delete:rmdir_failure  ->  2023-08-24T15:01:03.360516+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-delete:rmdir_success  ->  2023-08-24T15:01:03.377349+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-delete:unlink_failure  ->  2023-08-24T15:01:03.396685+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-delete:unlink_success  ->  2023-08-24T15:01:03.413194+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-delete:unlinkat_failure  ->  2023-08-24T15:01:03.429796+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-delete:unlinkat_success  ->  2023-08-24T15:01:03.447262+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-read:readlink_failure  ->  2023-08-24T15:01:03.464986+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-read:readlink_success  ->  2023-08-24T15:01:03.482203+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-read:readlinkat_failure  ->  2023-08-24T15:01:03.498946+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/file-read:readlinkat_success  ->  2023-08-24T15:01:03.516619+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/file-write:ftruncate_failure  ->  2023-08-24T15:01:03.534099+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-write:ftruncate_success  ->  2023-08-24T15:01:03.550647+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-write:truncate_failure  ->  2023-08-24T15:01:03.567547+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/file-write:truncate_success  ->  2023-08-24T15:01:03.583877+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.006s]
sys/audit/inter-process:msgctl_illegal_command  ->  2023-08-24T15:01:03.601327+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgctl_rmid_failure  ->  2023-08-24T15:01:03.618745+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgctl_rmid_success  ->  2023-08-24T15:01:03.636566+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgctl_set_failure  ->  2023-08-24T15:01:03.654606+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgctl_set_success  ->  2023-08-24T15:01:03.672654+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgctl_stat_failure  ->  2023-08-24T15:01:03.690854+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgctl_stat_success  ->  2023-08-24T15:01:03.709075+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgget_failure  ->  2023-08-24T15:01:03.727016+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgget_success  ->  2023-08-24T15:01:03.745227+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgrcv_failure  ->  2023-08-24T15:01:03.763624+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgrcv_success  ->  2023-08-24T15:01:03.781613+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgsnd_failure  ->  2023-08-24T15:01:03.799435+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:msgsnd_success  ->  2023-08-24T15:01:03.817370+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:pipe_failure  ->  2023-08-24T15:01:03.835330+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:pipe_success  ->  2023-08-24T15:01:03.853394+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:posix_openpt_failure  ->  2023-08-24T15:01:03.871851+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/inter-process:posix_openpt_success  ->  2023-08-24T15:01:03.890764+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/inter-process:semctl_getall_failure  ->  2023-08-24T15:01:03.909901+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getall_success  ->  2023-08-24T15:01:03.928123+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getncnt_failure  ->  2023-08-24T15:01:03.946904+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.008s]
sys/audit/inter-process:semctl_getncnt_success  ->  2023-08-24T15:01:03.965253+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getpid_failure  ->  2023-08-24T15:01:03.984086+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getpid_success  ->  2023-08-24T15:01:04.002641+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getval_failure  ->  2023-08-24T15:01:04.021370+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getval_success  ->  2023-08-24T15:01:04.039617+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getzcnt_failure  ->  2023-08-24T15:01:04.058202+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_getzcnt_success  ->  2023-08-24T15:01:04.076747+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_illegal_command  ->  2023-08-24T15:01:04.095062+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_rmid_failure  ->  2023-08-24T15:01:04.113631+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_rmid_success  ->  2023-08-24T15:01:04.131918+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_set_failure  ->  2023-08-24T15:01:04.150110+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_set_success  ->  2023-08-24T15:01:04.168433+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_setall_failure  ->  2023-08-24T15:01:04.186623+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_setall_success  ->  2023-08-24T15:01:04.204844+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_setval_failure  ->  2023-08-24T15:01:04.222736+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_setval_success  ->  2023-08-24T15:01:04.240843+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_stat_failure  ->  2023-08-24T15:01:04.259109+00:00 - auditd 25092 - - Got audit initialize trigger
passed  [0.007s]
sys/audit/inter-process:semctl_stat_success  ->  *** /usr/src/contrib/kyua/utils/process/executor.cpp:779: Invariant check failed: PID 25571 already in all_exec_handles; not properly cleaned up or reused too fast
*** Fatal signal 6 received
*** Log file is /.kyua/logs/kyua.20230824-142350.log
*** Please report this problem to kyua-discuss@googlegroups.com detailing what you were doing before the crash happened; if possible, include the log file mentioned above
2023-08-24T15:01:04.282603+00:00 - auditd 25092 - - Got audit initialize trigger
pid 790 (kyua), jid 0, uid 0: exited on signal 6 (core dumped)
Abort trap (core dumped)
+ rc=134
+ set -e
+ [ 134 -ne 0 ]
+ [ 134 -ne 1 ]
+ exit 134
+ tar cvf /dev/vtbd1 -C /meta .
a .
a ./run-kyua.sh
a ./disable-dtrace-tests.sh
a ./run.sh
a ./disable-zfs-tests.sh
a ./disable-notyet-tests.sh
a ./auto-shutdown
+ [ -f /meta/auto-shutdown ]
+ uname -p
+ shutdown -p now
Shutdown NOW!
shutdown: [pid 25575]
+ startmsg .
+ check_startmsgs
+ [ -n yes ]
+ checkyesno rc_startmsgs
+ eval '_value=$rc_startmsgs'
+ _value=YES
+ debug 'checkyesno: rc_startmsgs is set to YES.'
+ return 0
+ echo .
.
+ _return=0
+ umask 0022
+ [ 0 -ne 0 ]
+ return 0
+ _run_rc_postcmd
+ [ -n '' ]
+ return 0
+ return 0
2023-08-24T15:01:04.386438+00:002023-08-24T15:01:04.387164+00:00 - auditd 25092 - - auditd_wait_for_events: SIGTERM
2023-08-24T15:01:04.388413+00:00 - auditd 25092 - - Auditing disabled
2023-08-24T15:01:04.389615+00:00 - auditd 25092 - - renamed /var/audit/20230824150059.not_terminated to /var/audit/20230824150059.20230824150104
2023-08-24T15:01:04.391748+00:00 - auditd 25092 - - Finished
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 0 done
All buffers synced.
lock order reversal:
 1st 0xfffff8000ba0ee70 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2240
 2nd 0xfffff8000ba0e770 fdescfs (fdescfs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:3060
lock order devfs -> fdescfs attempted at:
#0 0xffffffff80bc0afe at witness_checkorder+0xbbe
#1 0xffffffff80b1a7b1 at lockmgr_lock_flags+0x181
#2 0xffffffff80c5af73 at _vn_lock+0x53
#3 0xffffffff80c4281d at vget_finish+0x4d
#4 0xffffffff82610262 at fdesc_root+0x22
#5 0xffffffff80c438bb at vflush+0x4b
#6 0xffffffff82610211 at fdesc_unmount+0x71
#7 0xffffffff80c38785 at dounmount+0x7b5
#8 0xffffffff80c44ffa at vfs_unmountall+0x6a
#9 0xffffffff80c157ac at bufshutdown+0x30c
#10 0xffffffff80b4d8b3 at kern_reboot+0x703
#11 0xffffffff80b4d159 at sys_reboot+0x3a9
#12 0xffffffff8104b3d8 at amd64_syscall+0x138
#13 0xffffffff8101cfeb at fast_syscall_common+0xf8
Uptime: 37m17s
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-24086' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./run-kyua.sh
x ./disable-dtrace-tests.sh
x ./run.sh
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
x ./auto-shutdown
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins9917208924008881071.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'd10de21f2f7df59344f8611546989b36e4fd867c', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../d10de21f2f7df59344f8611546989b36e4fd867c/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address