FreeBSD-main-amd64-test - Build #27511 - Failure

Reply: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #27512 - Still unstable"
In reply to: jenkins-admin_a_FreeBSD.org: "FreeBSD-main-amd64-test - Build #27510 - Still Unstable"
Go to: [ bottom of page ] [ top of archives ] [ this month ]
From: <jenkins-admin_at_FreeBSD.org>
Date: Mon, 29 Dec 2025 13:17:16 UTC
FreeBSD-main-amd64-test - Build #27511 (3088263177da2813dd09364171feadd0e31d1fc3) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/27511/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/27511/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/27511/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

37ddbbe5535cb6c27b8a026b2f28d64319b9f802 by kib:
libc/gen/err.c: remove 'extended error' herald from extended error

8bff95f3ce0396ff40b4f7d943ea856ac3f846c3 by kib:
exterror: add support for the format specifiers in the extended error

42210fe8dcd4684a45e0e4db1b8194e291dc8fda by kib:
exterror: Add EXTERROR_VERBOSE env variable to control verbosity

2904edaf2f09934142f9f6a6d2886879395145cc by kib:
vm/vm_mmap.c: inline erronous argument values for extended errors

14bd57d0a78dcd98449597fd3e19749799e36935 by kib:
exterror.9: describe formatting of optional arguments

543c86636f73119fa1dab860f07396df5a1884d4 by kib:
exterr_test: loosen the error string pattern

54b52f655e0fdaef21c3cde85e8bf030efa7b86e by kib:
fs/fuse: use dedicated category per source file

3ef25acf3600fb822bdf1487036184b4978d737f by kib:
Add a script to auto-generate mapping from exterr category to source

5685c07b5a8e4ccc19140eeaa5987a38dca7c668 by kib:
Add automatically generated file libc/gen/exterr_cat_filenames.h

874cdf6af695c42d561647f7165c99c2d3df0faa by kib:
exterr: in verbose mode, print the source file name

3088263177da2813dd09364171feadd0e31d1fc3 by kib:
man pages: provide some description for extended errors



The end of the build log:

[...truncated 4.15 MiB...]
#7 0xffffffff80dd20f2 at icmp6_input+0x14f2
#8 0xffffffff80debb33 at ip6_input+0xc93
#9 0xffffffff80d01934 at netisr_dispatch_src+0xb4
#10 0xffffffff80ce3aba at ether_demux+0x16a
#11 0xffffffff80ce502e at ether_nh_input+0x3ce
#12 0xffffffff80d01934 at netisr_dispatch_src+0xb4
#13 0xffffffff80ce3f05 at ether_input+0xd5
#14 0xffffffff82ae0b54 at epair_tx_start_deferred+0xd4
#15 0xffffffff80c01422 at taskqueue_run_locked+0x1c2
#16 0xffffffff80c02313 at taskqueue_thread_loop+0xd3
#17 0xffffffff80b47f72 at fork_exit+0x82
lock order reversal:
 1st 0xfffff8000918e890 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2439
 2nd 0xfffffe00a8a1b0a0 nd6 onlink (nd6 onlink, sleep mutex) @ /usr/src/sys/netinet6/nd6_rtr.c:1897
lock order lle -> nd6 onlink attempted at:
#0 0xffffffff80c0f231 at witness_checkorder+0xbe1
#1 0xffffffff80b71011 at __mtx_lock_flags+0x91
#2 0xffffffff80e0196a at pfxlist_onlink_check+0x4a
#3 0xffffffff80e02688 at defrouter_del+0x148
#4 0xffffffff80e023a3 at defrouter_remove+0x103
#5 0xffffffff80dfece1 at nd6_na_input+0x961
#6 0xffffffff80dd20f2 at icmp6_input+0x14f2
#7 0xffffffff80debb33 at ip6_input+0xc93
#8 0xffffffff80d01934 at netisr_dispatch_src+0xb4
#9 0xffffffff80ce3aba at ether_demux+0x16a
#10 0xffffffff80ce502e at ether_nh_input+0x3ce
#11 0xffffffff80d01934 at netisr_dispatch_src+0xb4
#12 0xffffffff80ce3f05 at ether_input+0xd5
#13 0xffffffff82ae0b54 at epair_tx_start_deferred+0xd4
#14 0xffffffff80c01422 at taskqueue_run_locked+0x1c2
#15 0xffffffff80c02313 at taskqueue_thread_loop+0xd3
#16 0xffffffff80b47f72 at fork_exit+0x82
#17 0xffffffff810c071e at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [16.483s]
sys/netinet6/ndp:ndp_slaac_default_route  ->  epair0a: Ethernet address: 6e:96:23:43:d2:b4
epair0b: Ethernet address: 26:b8:5b:2b:09:ba
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0b: promiscuous mode enabled
epair0b: promiscuous mode disabled
epair0b: promiscuous mode enabled
epair0b: promiscuous mode disabled
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [5.115s]
sys/netinet6/output6:output6_raw_flowid_mpath_success  ->  epair0a: Ethernet address: 66:41:00:ab:82:f0
epair0b: Ethernet address: 36:a3:fb:16:db:f9
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: b2:20:fe:9f:63:eb
epair1b: Ethernet address: 8a:89:74:ea:a7:4e
epair1a: link state changed to UP
epair1b: link state changed to UP
lo1: link state changed to UP
lo2: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [2.718s]
sys/netinet6/output6:output6_raw_success  ->  epair0a: Ethernet address: 0e:e8:c4:af:3c:a1
epair0b: Ethernet address: ca:61:4b:93:62:c0
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [2.195s]
sys/netinet6/output6:output6_tcp_flowid_mpath_success  ->  epair0a: Ethernet address: 82:90:b4:e8:13:fa
epair0b: Ethernet address: ca:a9:8c:b3:d7:51
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 5a:1f:b7:7b:ea:d3
epair1b: Ethernet address: 96:7c:19:6a:5c:19
epair1a: link state changed to UP
epair1b: link state changed to UP
lo1: link state changed to UP
lo2: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [2.963s]
sys/netinet6/output6:output6_tcp_setup_success  ->  epair0a: Ethernet address: 22:27:95:28:4d:a9
epair0b: Ethernet address: d2:93:f1:fe:e4:7f
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [1.706s]
sys/netinet6/output6:output6_udp_flowid_mpath_success  ->  epair0a: Ethernet address: c6:85:3a:7c:0d:2d
epair0b: Ethernet address: 4a:6b:e6:45:a4:5c
epair0a: link state changed to UP
epair0b: link state changed to UP
epair1a: Ethernet address: 02:8e:56:f3:6f:2f
epair1b: Ethernet address: 96:7a:ff:a5:10:f0
epair1a: link state changed to UP
epair1b: link state changed to UP
lo1: link state changed to UP
lo2: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
epair1a: link state changed to DOWN
epair1b: link state changed to DOWN
passed  [4.738s]
sys/netinet6/output6:output6_udp_setup_success  ->  epair0a: Ethernet address: b2:09:7b:07:6a:99
epair0b: Ethernet address: 56:c4:14:98:06:f9
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [3.001s]
sys/netinet6/proxy_ndp:pndp_add_gu_success  ->  epair0a: Ethernet address: 3a:c1:bc:bd:95:c5
epair0b: Ethernet address: ea:cf:68:6e:6c:42
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [1.287s]
sys/netinet6/proxy_ndp:pndp_del_gu_success  ->  epair0a: Ethernet address: d6:52:22:73:10:09
epair0b: Ethernet address: 5e:84:2f:3c:cf:2f
epair0a: link state changed to UP
epair0b: link state changed to UP
lock order reversal: (sleepable after non-sleepable)
 1st 0xfffff80009183290 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2439
 2nd 0xffffffff81eee4b0 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1329
lock order lle -> in6_multi_sx attempted at:
#0 0xffffffff80c0f231 at witness_checkorder+0xbe1
#1 0xffffffff80ba2bd0 at _sx_xlock+0x60
#2 0xffffffff80de0757 at in6_leavegroup+0x27
#3 0xffffffff80dda30c at in6_lltable_delete_entry+0x10c
#4 0xffffffff80ce75aa at lltable_delete_addr+0xda
#5 0xffffffff80e2b11b at rtnl_handle_delneigh+0x7b
#6 0xffffffff80e279e2 at rtnl_handle_message+0x132
#7 0xffffffff80e25c6d at nl_taskqueue_handler+0x52d
#8 0xffffffff80c01422 at taskqueue_run_locked+0x1c2
#9 0xffffffff80c02313 at taskqueue_thread_loop+0xd3
#10 0xffffffff80b47f72 at fork_exit+0x82
#11 0xffffffff810c071e at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [5.118s]
sys/netinet6/proxy_ndp:pndp_ifdestroy_success  ->  epair0a: Ethernet address: 1a:cd:66:57:e5:01
epair0b: Ethernet address: 3a:27:5d:f6:a6:46
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [1.422s]
sys/netinet6/proxy_ndp:pndp_neighbor_advert  ->  epair0a: Ethernet address: 1e:cc:cf:c0:87:75
epair0b: Ethernet address: 4e:cc:26:17:46:59
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [3.580s]
sys/netinet6/redirect:valid_redirect  ->  epair0a: Ethernet address: c6:b9:da:1d:c6:42
epair0b: Ethernet address: 9e:22:3c:f0:03:33
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed  [3.147s]
sys/netinet6/scapyi386:scapyi386  ->  epair0a: Ethernet address: d2:77:03:15:54:aa
epair0b: Ethernet address: 62:9b:5d:bc:f8:29
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed  [4.231s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base  ->  broken: Test case body timed out  [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[empty]  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ifsame]  ->  broken: Test case body timed out  [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ipandif]  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[iponly1]  ->  broken: Test case body timed out  [300.006s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[nolocalip]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLL::test_output6_linklocal  ->  broken: Test case body timed out  [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-no_sav]  ->  broken: Test case body timed out  [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-sav]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-no_sav]  ->  broken: Test case body timed out  [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-sav]  ->  broken: Test case body timed out  [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-no_sav]  ->  broken: Test case body timed out  [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-sav]  ->  broken: Test case body timed out  [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-no_sav]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-sav]  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-no_sav]  ->  broken: Test case body timed out  [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-sav]  ->  broken: Test case body timed out  [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-no_sav]  ->  broken: Test case body timed out  [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-sav]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff02]  ->  broken: Test case body timed out  [300.007s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff05]  ->  broken: Test case body timed out  [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff08]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff0e]  ->  2025-12-29T13:15:50.695179+00:00 - auditd 1540 - - auditd_wait_for_events: SIGTERM
2025-12-29T13:15:50.697072+00:00 - auditd 1540 - - Auditing disabled
2025-12-29T13:15:50.700384+00:00 - auditd 1540 - - renamed /var/audit/20251229071855.not_terminated to /var/audit/20251229071855.20251229131550
2025-12-29T13:15:50.702364+00:00 - auditd 1540 - - Finished
2025-12-29T13:16:10.713682+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 0 done
All buffers synced.
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-27511' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
x ./run.sh
x ./disable-dtrace-tests.sh
x ./auto-shutdown
x ./run-kyua.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins9991065146115072544.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '3088263177da2813dd09364171feadd0e31d1fc3', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../3088263177da2813dd09364171feadd0e31d1fc3/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address