FreeBSD-main-amd64-test - Build #24076 - Failure

From: <jenkins-admin_at_FreeBSD.org>
Date: Wed, 23 Aug 2023 03:51:13 UTC
FreeBSD-main-amd64-test - Build #24076 (c7df87209634129df476049c2f38cd4ebefa386f) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24076/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24076/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/24076/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

c7f73a1588dc58db28100fcbc1d72a830b674b34 by erj:
ofed: mask seq_num identifier to occupy only 3 bytes

8882b7852acf2588d87ccb6d4c6bf7694511fc56 by kib:
add pmap_active_cpus()

74ccb8ecf6c115a79f008bc32d4981f1126b63a8 by kib:
Add cpu_sync_core()

4a69fc16a583face922319c476f3e739d9ce9140 by kib:
Add membarrier(2)

c7df87209634129df476049c2f38cd4ebefa386f by kib:
Regen



The end of the build log:

[...truncated 4.31 MB...]
libexec/tftpd/functional:unknown_modes_v4  ->  passed  [0.015s]
libexec/tftpd/functional:unknown_modes_v6  ->  passed  [0.014s]
libexec/tftpd/functional:unknown_opcode_v4  ->  passed  [0.008s]
libexec/tftpd/functional:unknown_opcode_v6  ->  passed  [0.008s]
libexec/tftpd/functional:w_flag_v4  ->  passed  [0.013s]
libexec/tftpd/functional:w_flag_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_dropped_ack_v4  ->  passed  [5.011s]
libexec/tftpd/functional:wrq_dropped_ack_v6  ->  passed  [5.017s]
libexec/tftpd/functional:wrq_dropped_data_v4  ->  passed  [5.015s]
libexec/tftpd/functional:wrq_dropped_data_v6  ->  passed  [5.015s]
libexec/tftpd/functional:wrq_duped_data_v4  ->  passed  [0.011s]
libexec/tftpd/functional:wrq_duped_data_v6  ->  passed  [0.010s]
libexec/tftpd/functional:wrq_eaccess_v4  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_eaccess_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_eaccess_world_readable_v4  ->  passed  [0.009s]
libexec/tftpd/functional:wrq_eaccess_world_readable_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_medium_v4  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_medium_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_medium_window_v4  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_medium_window_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_netascii_v4  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_netascii_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_nonexistent_v4  ->  passed  [0.009s]
libexec/tftpd/functional:wrq_nonexistent_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_small_v4  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_small_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_truncate_v4  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_truncate_v6  ->  passed  [0.008s]
libexec/tftpd/functional:wrq_window_rfc7440_v4  ->  passed  [5.018s]
libexec/tftpd/functional:wrq_window_rfc7440_v6  ->  passed  [5.016s]
libexec/rtld-elf/ld_library_pathfds:bad_library_directories  ->  passed  [0.009s]
libexec/rtld-elf/ld_library_pathfds:first_library_directory  ->  passed  [0.009s]
libexec/rtld-elf/ld_library_pathfds:last_library_directory  ->  passed  [0.008s]
libexec/rtld-elf/ld_library_pathfds:middle_library_directory  ->  passed  [0.007s]
libexec/rtld-elf/ld_library_pathfds:missing_library  ->  passed  [0.006s]
libexec/rtld-elf/ld_library_pathfds:single_library_directory  ->  passed  [0.007s]
libexec/rtld-elf/ld_library_pathfds:wrong_library_directories  ->  passed  [0.006s]
libexec/rtld-elf/ld_preload_fds:bad_librarys  ->  passed  [0.007s]
libexec/rtld-elf/ld_preload_fds:missing_library  ->  passed  [0.007s]
libexec/rtld-elf/ld_preload_fds:single_library  ->  passed  [0.008s]
libexec/rtld-elf/ld_preload_fds:two_librarys  ->  passed  [0.007s]
libexec/rc/rc_subr_test:oomprotect_all  ->  passed  [0.083s]
libexec/rc/rc_subr_test:oomprotect_yes  ->  passed  [0.066s]
cddl/usr.sbin/zfsd/zfsd_unittest:main  ->  passed  [0.026s]
cddl/usr.bin/ctfconvert/ctfconvert_test:invalid_usage  ->  passed  [0.047s]
cddl/usr.bin/ctfconvert/ctfconvert_test:no_arguments  ->  passed  [0.020s]
cddl/usr.bin/ztest/ztest:ztest  ->  skipped: Required configuration property 'rt_long' not defined  [0.004s]
sbin/ping/ping_test:inject_opts  ->  tun0: link state changed to UP
tun0: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [0.967s]
sbin/ping/ping_test:inject_pip  ->  tun0: link state changed to UP
tun0: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [1.925s]
sbin/ping/ping_test:inject_reply  ->  tun0: link state changed to UP
tun0: link state changed to DOWN
failed: atf-check failed; see the output of the test for details  [1.022s]
sbin/ping/ping_test:ping6_46  ->  passed  [0.025s]
sbin/ping/ping_test:ping6_c1_s8_t1  ->  passed  [0.033s]
sbin/ping/ping_test:ping6_c1t4  ->  passed  [0.028s]
sbin/ping/ping_test:ping_46  ->  passed  [0.023s]
sbin/ping/ping_test:ping_6_c1_s8_t1  ->  passed  [0.032s]
sbin/ping/ping_test:ping_c1_s56_t1  ->  passed  [0.032s]
sbin/ping/ping_test:ping_c1_s56_t1_S127  ->  passed  [0.040s]
sbin/ping/ping_test:ping_c1_s8_t1_S1  ->  passed  [0.040s]
sbin/ping/ping_test:ping_c1t6  ->  passed  [0.028s]
sbin/dhclient/pcp:normal  ->  skipped: ISC dhcp server (isc-dhcp44-server) not installed  [0.024s]
sbin/dhclient/pcp:pcp  ->  skipped: ISC dhcp server (isc-dhcp44-server) not installed  [0.021s]
lib/libc/gen/setdomainname_test:setdomainname_basic  ->  passed  [0.006s]
lib/libc/gen/setdomainname_test:setdomainname_limit  ->  passed  [0.006s]
lib/libc/gen/setdomainname_test:setdomainname_perm  ->  passed  [0.005s]
lib/libc/sys/msgctl_test:msgctl_err  ->  passed  [0.006s]
lib/libc/sys/msgctl_test:msgctl_perm  ->  passed  [0.006s]
lib/libc/sys/msgctl_test:msgctl_pid  ->  passed  [0.008s]
lib/libc/sys/msgctl_test:msgctl_set  ->  passed  [0.006s]
lib/libc/sys/msgctl_test:msgctl_time  ->  passed  [0.005s]
lib/libc/sys/msgget_test:msgget_excl  ->  passed  [0.006s]
lib/libc/sys/msgget_test:msgget_exit  ->  passed  [0.005s]
lib/libc/sys/msgget_test:msgget_init  ->  passed  [0.005s]
lib/libc/sys/msgget_test:msgget_limit  ->  passed  [0.007s]
lib/libc/sys/msgget_test:msgget_mode  ->  passed  [0.006s]
lib/libc/sys/msgrcv_test:msgrcv_basic  ->  passed  [0.006s]
lib/libc/sys/msgrcv_test:msgrcv_block  ->  passed  [2.092s]
lib/libc/sys/msgrcv_test:msgrcv_err  ->  passed  [0.006s]
lib/libc/sys/msgrcv_test:msgrcv_mtype  ->  passed  [0.005s]
lib/libc/sys/msgrcv_test:msgrcv_nonblock  ->  passed  [0.005s]
lib/libc/sys/msgrcv_test:msgrcv_truncate  ->  passed  [0.005s]
lib/libc/sys/msgsnd_test:msgsnd_block  ->  passed  [2.027s]
lib/libc/sys/msgsnd_test:msgsnd_count  ->  passed  [0.006s]
lib/libc/sys/msgsnd_test:msgsnd_err  ->  passed  [0.005s]
lib/libc/sys/msgsnd_test:msgsnd_nonblock  ->  passed  [0.006s]
lib/libc/sys/msgsnd_test:msgsnd_perm  ->  passed  [0.006s]
lib/libcasper/services/cap_sysctl/sysctl_test:cap_sysctl__just_size  ->  passed  [0.008s]
lib/libcasper/services/cap_sysctl/sysctl_test:cap_sysctl__names  ->  passed  [0.021s]
lib/libcasper/services/cap_sysctl/sysctl_test:cap_sysctl__no_limits  ->  passed  [0.009s]
lib/libcasper/services/cap_sysctl/sysctl_test:cap_sysctl__operation  ->  passed  [0.041s]
lib/libcasper/services/cap_sysctl/sysctl_test:cap_sysctl__recursive_limits  ->  passed  [0.009s]
usr.sbin/jail/jail_basic_test:basic  ->  passed  [0.064s]
usr.sbin/jail/jail_basic_test:commands  ->  passed  [0.048s]
usr.sbin/jail/jail_basic_test:nested  ->  passed  [0.059s]
usr.sbin/makefs/makefs_zfs_tests:autoexpand  ->  passed  [0.442s]
usr.sbin/makefs/makefs_zfs_tests:basic  ->  passed  [0.311s]
usr.sbin/makefs/makefs_zfs_tests:dataset_removal  ->  passed  [0.280s]
usr.sbin/makefs/makefs_zfs_tests:empty_dir  ->  passed  [0.173s]
usr.sbin/makefs/makefs_zfs_tests:empty_fs  ->  passed  [0.152s]
usr.sbin/makefs/makefs_zfs_tests:file_sizes  ->  passed  [0.252s]
usr.sbin/makefs/makefs_zfs_tests:hard_links  ->  passed  [0.251s]
usr.sbin/makefs/makefs_zfs_tests:indirect_dnode_array  ->  passed  [0.371s]
usr.sbin/makefs/makefs_zfs_tests:long_file_name  ->  passed  [0.407s]
usr.sbin/makefs/makefs_zfs_tests:multi_dataset_1  ->  passed  [0.236s]
usr.sbin/makefs/makefs_zfs_tests:multi_dataset_2  ->  passed  [0.167s]
usr.sbin/makefs/makefs_zfs_tests:multi_dataset_3  ->  passed  [0.207s]
usr.sbin/makefs/makefs_zfs_tests:multi_dataset_4  ->  passed  [0.251s]
usr.sbin/makefs/makefs_zfs_tests:multi_staging_1  ->  passed  [0.174s]
usr.sbin/makefs/makefs_zfs_tests:multi_staging_2  ->  passed  [0.163s]
usr.sbin/makefs/makefs_zfs_tests:reproducible  ->  passed  [2.080s]
usr.sbin/makefs/makefs_zfs_tests:root_props  ->  passed  [0.342s]
usr.sbin/makefs/makefs_zfs_tests:snapshot  ->  passed  [0.169s]
usr.sbin/makefs/makefs_zfs_tests:soft_links  ->  passed  [0.170s]
usr.bin/tftp/tftp_test:tftp_get_big  ->  passed  [4.747s]
usr.bin/tftp/tftp_test:tftp_get_host  ->  passed  [0.050s]
usr.bin/tftp/tftp_test:tftp_get_ipv4  ->  passed  [0.048s]
usr.bin/tftp/tftp_test:tftp_get_ipv6  ->  passed  [0.050s]
usr.bin/tftp/tftp_test:tftp_get_more  ->  passed  [0.330s]
usr.bin/tftp/tftp_test:tftp_get_multi_host  ->  passed  [0.071s]
usr.bin/tftp/tftp_test:tftp_get_one  ->  passed  [0.058s]
usr.bin/tftp/tftp_test:tftp_get_two  ->  passed  [0.057s]
usr.bin/tftp/tftp_test:tftp_put_big  ->  passed  [4.448s]
usr.bin/tftp/tftp_test:tftp_put_host  ->  passed  [0.053s]
usr.bin/tftp/tftp_test:tftp_put_ipv4  ->  passed  [0.066s]
usr.bin/tftp/tftp_test:tftp_put_ipv6  ->  passed  [0.052s]
usr.bin/tftp/tftp_test:tftp_put_more  ->  passed  [0.308s]
usr.bin/tftp/tftp_test:tftp_put_multi_host  ->  passed  [0.078s]
usr.bin/tftp/tftp_test:tftp_put_one  ->  passed  [0.053s]
usr.bin/tftp/tftp_test:tftp_put_two  ->  passed  [0.061s]
usr.bin/tftp/tftp_test:tftp_url_host  ->  *** /usr/src/contrib/kyua/utils/process/executor.cpp:822: Invariant check failed: PID 23019 already in all_exec_handles; not properly cleaned up or reused too fast
*** Fatal signal 6 received
*** Log file is /.kyua/logs/kyua.20230823-031355.log
*** Please report this problem to kyua-discuss@googlegroups.com detailing what you were doing before the crash happened; if possible, include the log file mentioned above
pid 790 (kyua), jid 0, uid 0: exited on signal 6 (core dumped)
Abort trap (core dumped)
+ rc=134
+ set -e
+ [ 134 -ne 0 ]
+ [ 134 -ne 1 ]
+ exit 134
+ tar cvf /dev/vtbd1 -C /meta .
a .
a ./disable-zfs-tests.sh
a ./run-kyua.sh
a ./run.sh
a ./disable-dtrace-tests.sh
a ./auto-shutdown
a ./disable-notyet-tests.sh
+ [ -f /meta/auto-shutdown ]
+ uname -p
+ shutdown -p now
Shutdown NOW!
shutdown: [pid 23044]
+ startmsg .
+ check_startmsgs
+ [ -n yes ]
+ checkyesno rc_startmsgs
+ eval '_value=$rc_startmsgs'
+ _value=YES
+ debug 'checkyesno: rc_startmsgs is set to YES.'
+ return 0
+ echo .
.
+ _return=0
+ umask 0022
+ [ 0 -ne 0 ]
+ return 0
+ _run_rc_postcmd
+ [ -n '' ]
+ return 0
+ return 0
2023-08-23T03:51:05.408586+00:00 - shutdown 23044 - - power-down by root: 

System shutdown time has arrived
2023-08-23T03:51:05.412514+00:00 - auditd 707 - - auditd_wait_for_events: SIGTERM
2023-08-23T03:51:05.413882+00:00 - auditd 707 - - Auditing disabled
2023-08-23T03:51:05.415298+00:00 - auditd 707 - - renamed /var/audit/20230823031355.not_terminated to /var/audit/20230823031355.20230823035105
2023-08-23T03:51:05.417594+00:00 - auditd 707 - - Finished
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 0 done
All buffers synced.
lock order reversal:
 1st 0xfffff8000ba0b070 devfs (devfs, lockmgr) @ /usr/src/sys/kern/vfs_mount.c:2240
 2nd 0xfffff8000ba0c930 fdescfs (fdescfs, lockmgr) @ /usr/src/sys/kern/vfs_subr.c:3060
lock order devfs -> fdescfs attempted at:
#0 0xffffffff80bc0afe at witness_checkorder+0xbbe
#1 0xffffffff80b1a7b1 at lockmgr_lock_flags+0x181
#2 0xffffffff80c5af13 at _vn_lock+0x53
#3 0xffffffff80c427bd at vget_finish+0x4d
#4 0xffffffff82610262 at fdesc_root+0x22
#5 0xffffffff80c4385b at vflush+0x4b
#6 0xffffffff82610211 at fdesc_unmount+0x71
#7 0xffffffff80c38725 at dounmount+0x7b5
#8 0xffffffff80c44f9a at vfs_unmountall+0x6a
#9 0xffffffff80c1574c at bufshutdown+0x30c
#10 0xffffffff80b4d8b3 at kern_reboot+0x703
#11 0xffffffff80b4d159 at sys_reboot+0x3a9
#12 0xffffffff8104b3d8 at amd64_syscall+0x138
#13 0xffffffff8101cf6b at fast_syscall_common+0xf8
Uptime: 37m13s
acpi0: Powering system off
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-24076' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-zfs-tests.sh
x ./run-kyua.sh
x ./run.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./disable-notyet-tests.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins1833105958332967715.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'c7df87209634129df476049c2f38cd4ebefa386f', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../c7df87209634129df476049c2f38cd4ebefa386f/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address