15 failed test on 13.2BETA3 (not ran on previous versions)

From: Paul Dufresne <dufresnep_at_zoho.com>
Date: Mon, 27 Feb 2023 15:51:52 UTC
This is the short version of the message I posted on Testing mailing list.

did read man 7 tests
and so:
cd  /usr/tests
kyua test
kyua report

root@dufresnep:~ # uname -a 
FreeBSD dufresnep.ca 13.2-BETA3 FreeBSD 13.2-BETA3 releng/13.2-n254537-d0e8ce556627 GENERIC amd64 
 
I found doubtful about zfs tests not exiting and thought it might be because I am using it. 
I thought maybe in single user-mode it might be better, but was not (make sense because I have mostly ZFS root and EFI partition). 
... 
===> Broken tests 
sys/audit/file-attribute-access:extattr_get_file_success  ->  broken: Test case body timed out  [30.004s] 
sys/audit/file-attribute-access:extattr_get_link_success  ->  broken: Test case body timed out  [30.003s] 
sys/cddl/zfs/include/libtest_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/acl/cifs/cifs_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/acl/nontrivial/nontrivial_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/acl/trivial/trivial_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/atime/atime_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/bootfs/bootfs_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cache/cache_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cachefile/cachefile_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/clean_mirror/clean_mirror_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zdb/zdb_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs/zfs_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_clone/zfs_clone_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_copies/zfs_copies_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_create/zfs_create_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_destroy/zfs_destroy_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_diff/zfs_diff_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_get/zfs_get_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_inherit/zfs_inherit_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_mount/zfs_mount_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_promote/zfs_promote_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_property/zfs_property_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_receive/zfs_receive_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_rename/zfs_rename_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_reservation/zfs_reservation_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_rollback/zfs_rollback_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_send/zfs_send_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_set/zfs_set_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_share/zfs_share_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_snapshot/zfs_snapshot_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_unmount/zfs_unmount_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_unshare/zfs_unshare_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zfs_upgrade/zfs_upgrade_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool/zpool_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_add/zpool_add_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_attach/zpool_attach_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_clear/zpool_clear_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_create/zpool_create_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_destroy/zpool_destroy_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_detach/zpool_detach_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_expand/zpool_expand_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_export/zpool_export_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_get/zpool_get_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_history/zpool_history_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_import/zpool_import_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_offline/zpool_offline_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_online/zpool_online_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_remove/zpool_remove_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_replace/zpool_replace_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_scrub/zpool_scrub_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_set/zpool_set_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_status/zpool_status_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_root/zpool_upgrade/zpool_upgrade_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_user/misc/misc_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_user/zfs_list/zfs_list_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_user/zpool_iostat/zpool_iostat_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/cli_user/zpool_list/zpool_list_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/compression/compression_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/ctime/ctime_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/delegate/zfs_allow_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/delegate/zfs_unallow_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/devices/devices_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/exec/exec_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/grow_pool/grow_pool_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/grow_replicas/grow_replicas_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/history/history_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/hotplug/hotplug_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/hotspare/hotspare_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/inheritance/inheritance_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/inuse/inuse_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/large_files/large_files_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/migration/migration_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/mmap/mmap_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/mount/mount_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/mv_files/mv_files_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/nestedfs/nestedfs_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/no_space/no_space_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/online_offline/online_offline_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/pool_names/pool_names_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/poolversion/poolversion_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/quota/quota_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/redundancy/redundancy_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/refquota/refquota_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/refreserv/refreserv_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/replacement/replacement_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/reservation/reservation_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/rootpool/rootpool_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/scrub_mirror/scrub_mirror_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/slog/slog_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/snapshot/snapshot_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/snapused/snapused_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/sparse/sparse_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/threadsappend/threadsappend_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/truncate/truncate_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/txg_integrity/txg_integrity_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/userquota/userquota_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/utils_test/utils_test_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/write_dirs/write_dirs_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zfsd/zfsd_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zil/zil_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zvol/zvol_ENOSPC/zvol_ENOSPC_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zvol/zvol_cli/zvol_cli_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zvol/zvol_misc/zvol_misc_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zvol/zvol_swap/zvol_swap_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/cddl/zfs/tests/zvol_thrash/zvol_thrash_test:__test_cases_list__  ->  broken: Test program did not exit cleanly  [0.003s] 
sys/kern/subr_physmem_test:hwregion  ->  broken: Empty test result or no new line  [0.003s] 
===> Failed tests 
lib/libc/nss/gethostby_test:gethostbyaddr_getnameinfo_ipv4  ->  failed: /root/src/lib/libc/tests/nss/gethostby_test.c:1157: run_tests(_hostlist_file, ((void *)0), 2, TEST_GETHOSTBYADDR_GETNAMEINFO, 0) == 0 not met  [18.902s] 
lib/libexecinfo/backtrace_test:backtrace_fmt_basic  ->  failed: /root/src/contrib/netbsd-tests/lib/libexecinfo/t_backtrace.c:93: nptrs >= ncalls + 2 + min_frames not met  [0.004s] 
local/atf/atf-c++/pkg_config_test:build  ->  failed: atf-check failed; see the output of the test for details  [0.576s] 
local/kyua/integration/cmd_about_test:topic__authors__installed  ->  failed: atf-check failed; see the output of the test for details  [0.011s] 
sys/audit/file-attribute-access:lpathconf_success  ->  failed: /root/src/tests/sys/audit/file-attribute-access.c:773: lpathconf(path, _PC_SYMLINK_MAX) != -1 not met  [0.003s] 
sys/audit/file-attribute-modify:extattr_delete_file_success  ->  failed: extattr_delete_file.*fileforaudit.*return,success,0 not found in auditpipe within the time limit  [10.210s] 
sys/audit/file-attribute-modify:extattr_delete_link_success  ->  failed: extattr_delete_link.*fileforaudit.*return,success,0 not found in auditpipe within the time limit  [10.145s] 
sys/audit/file-attribute-modify:extattr_set_file_success  ->  failed: extattr_set_file.*fileforaudit.*authorname.*return,success not found in auditpipe within the time limit  [10.114s] 
sys/audit/file-attribute-modify:extattr_set_link_success  ->  failed: extattr_set_link.*fileforaudit.*authorname.*return,success not found in auditpipe within the time limit  [10.022s] 
sys/kern/kern_copyin:kern_copyin  ->  failed: /root/src/tests/sys/kern/kern_copyin.c:123: maxuser != 0 not met  [0.002s] 
sys/netmap/ctrl-api-test:main  ->  failed: Returned non-success exit status 255  [0.401s] 
usr.bin/gh-bc/bc_tests:main  ->  failed: Returned non-success exit status 1  [0.004s] 
usr.bin/gh-bc/dc_tests:main  ->  failed: Returned non-success exit status 1  [0.004s] 
usr.bin/renice/renice_test:renice_abs_user  ->  failed: 3 !=  (3 != )  [0.118s] 
usr.bin/renice/renice_test:renice_rel_user  ->  failed: 6 !=  (6 != )  [0.064s] 
===> Summary 
Results read from /root/.kyua/store/results.usr_tests.20230226-232307-955021.db 
Test cases: 8869 total, 781 skipped, 36 expected failures, 107 broken, 15 failed 
Total time: 2024.394s 
 
Still, these 15 failed tests seems much more than what I have seeen here or on Jenkins. 
 
How much normal or anormal this is?