From nobody Mon Nov 02 13:48:00 2026 X-Original-To: dev-ci@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4jJChK4KTBz6yNww for ; Mon, 02 Nov 2026 13:48:01 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange x25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4jJChJ5p3Gz4H6g; Mon, 02 Nov 2026 13:48:00 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) ARC-Seal: i=1; a=rsa-sha256; d=freebsd.org; s=dkim; cv=none; t=1793627280; b=tRmOcue1jaDSmEj/7fmP0hWS1MMydxan0mriJM5I5i3WEW2bnqJ13qa/6KQpO+WtFruSkP I3WLrb1CJkTOQ5yoguInnMyFA8YmIFx6+LP3LtDAHIv+ES4ttcV8/1YMgRfHsfBFf1yuBC 1rbgCqN1xmPRJy9BuQ+aO4AihRpZkOPOrCnNvSzMFEknEJd6WgP1H3P8jmP9l3P6OaTeyZ EFCvBbSkb6wflBeN0jkTcEAj8Wfmz32lnu4WkeYtsGly6ZGgCyxn3auEwxUBJ5xg7pCFF9 KhtBC3MySMKcKqY3/crdQksHNGCu8EFULJAx0J9Q+uHuOvOmw4s1C29JwGVOkQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1793627280; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:list-id; bh=+jJDQfcsKS+/pg9ImLGsmXYLtJ0C+mBWbgMU+IuFIGA=; b=EXkR4qYJVqx78EH72bUmCj0T80vA1x0omI9pV/tX88vsWst5jiVhJmDeFJ5a4LtmB2ZLvU jXU4aFibumFAQHIygTUX/W8S11IN+dYQZEpkBvwzXYbzQqGxmWKUMEg35cWkQMR2/njc90 +KjQDSZWKsDjPa+8b53Ewa28Gg0PUyOrn+lUH7/0RItiDUnjh6SWAh3zMqExKpSQRJdq9K IbGfWiemDmTrbjMNspm3px1lxCbyC1iBkITxr5zlYIAte68LlBhr+sD5fhr/nAKoBCnlCN dm3aQq2uq3DXGJ4uzeboVeEz0MEKtcDzC9bwKSZ8Ut30fUM6IYKjVFyCZFzRQQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none Received: from jenkins.ci.freebsd.org (jenkins.ci.freebsd.org [IPv6:2610:1c1:1:607c::16:16]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4jJChJ5P63znll; Mon, 02 Nov 2026 13:48:00 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Date: Mon, 2 Nov 2026 13:48:00 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: kgalazka@FreeBSD.org, dev-ci@FreeBSD.org Cc: jenkins-admin@FreeBSD.org Message-ID: <1151229596.393.1793627280762@jenkins.ci.freebsd.org> In-Reply-To: <581289181.389.1793620426457@jenkins.ci.freebsd.org> References: <581289181.389.1793620426457@jenkins.ci.freebsd.org> Subject: FreeBSD-main-amd64-test - Build #29864 - Failure List-Archive: https://lists.freebsd.org/archives/dev-ci X-BeenThere: dev-ci@freebsd.org Sender: owner-dev-ci@FreeBSD.org List-Id: Continuous Integration Build and Test Results List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_392_1889469776.1793627280538" X-Jenkins-Job: FreeBSD-main-amd64-test X-Jenkins-Result: FAILURE List-ID: FreeBSD CI Build Notifications Precedence: bulk ------=_Part_392_1889469776.1793627280538 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable FreeBSD-main-amd64-test - Build #29864 (013f1779f63413173535ab770abb70715e9= 2bee6) - Failure Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29864= / Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29864/c= hanges Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29864/co= nsole Status explanation: "Failure" - the build is suspected being broken by the following changes "Still Failing" - the build has not been fixed by the following changes and this is a notification to note that these changes have not been fully tested by the CI system Change summaries: (Those commits are likely but not certainly responsible) 013f1779f63413173535ab770abb70715e92bee6 by kgalazka: ice(4): Do not leave device non-functional if Tx scheduler config fails The end of the build log: [...truncated 6.06 MiB...] lock order "inpcb_wild_bucket"(sleep mutex) -> "tcphash"(sleep mutex) first= seen at: #0 0xffffffff80cd35fa at witness_checkorder+0x36a #1 0xffffffff80c2c041 at __mtx_lock_flags+0x91 #2 0xffffffff80e5bf95 at in_pcbinshash+0x195 #3 0xffffffff80e5c8c7 at in_pcbconnect+0x2e7 #4 0xffffffff80ea268e at tcp_connect+0x7e #5 0xffffffff80e9e75d at tcp_usr_connect+0xed #6 0xffffffff80d18fa6 at soconnectat+0xc6 #7 0xffffffff80d2166c at kern_connectat+0xec #8 0xffffffff80d21553 at sys_connect+0x73 #9 0xffffffff811f7c1e at amd64_syscall+0x45e #10 0xffffffff811c379b at fast_syscall_common+0xf8 lock order "inpcb_wild_bucket"(sleep mutex) -> "inpcb_port_bucket"(sleep mu= tex) first seen at: #0 0xffffffff80cd35fa at witness_checkorder+0x36a #1 0xffffffff80c2c041 at __mtx_lock_flags+0x91 #2 0xffffffff80e5b3e8 at in_pcblookup_local+0x1c8 #3 0xffffffff80e5af2c at in_pcb_lport_dest+0x37c #4 0xffffffff80e5baf5 at in_pcbbind_setup_locked+0x385 #5 0xffffffff80e5bc34 at in_pcbbind+0xf4 #6 0xffffffff80e9eefe at tcp_usr_bind+0xae #7 0xffffffff80d17e51 at sobind+0x41 #8 0xffffffff80d20be6 at kern_bindat+0xd6 #9 0xffffffff80d20a63 at sys_bind+0x73 #10 0xffffffff811f7c1e at amd64_syscall+0x45e #11 0xffffffff811c379b at fast_syscall_common+0xf8 lock order "inpcb_port_bucket"(sleep mutex) -> "tcphash"(sleep mutex) first= seen at: #0 0xffffffff80cd35fa at witness_checkorder+0x36a #1 0xffffffff80c2c041 at __mtx_lock_flags+0x91 #2 0xffffffff80e5bf95 at in_pcbinshash+0x195 #3 0xffffffff80e5bcdb at in_pcbbind+0x19b #4 0xffffffff80e9eefe at tcp_usr_bind+0xae #5 0xffffffff80d17e51 at sobind+0x41 #6 0xffffffff80d20be6 at kern_bindat+0xd6 #7 0xffffffff80d20a63 at sys_bind+0x73 #8 0xffffffff811f7c1e at amd64_syscall+0x45e #9 0xffffffff811c379b at fast_syscall_common+0xf8 hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first = seen at: (No stack trace) lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at: (No stack trace) lock order "mld_mtx"(sleep mutex) -> "lltable"(sleep mutex) first seen at: #0 0xffffffff80cd35fa at witness_checkorder+0x36a #1 0xffffffff80c2c041 at __mtx_lock_flags+0x91 #2 0xffffffff80ed8937 at nd6_get_llentry+0x147 #3 0xffffffff80ed736a at nd6_resolve_slow+0x15a #4 0xffffffff80ed707e at nd6_resolve+0x16e #5 0xffffffff80db36f0 at ether_output+0x540 #6 0xffffffff80ecc1db at ip6_output+0x1b1b #7 0xffffffff82b0ce42 at geneve_transmit+0xa62 #8 0xffffffff80db3a8e at ether_output_frame+0xde #9 0xffffffff80db38c2 at ether_output+0x712 #10 0xffffffff80ecc1db at ip6_output+0x1b1b #11 0xffffffff80ed25f0 at mld_dispatch_packet+0x330 #12 0xffffffff80ed30f0 at mld_fasttimo+0x4f0 #13 0xffffffff80c74bc8 at softclock_call_cc+0x1c8 #14 0xffffffff80c763d6 at softclock_thread+0xc6 #15 0xffffffff80c01852 at fork_exit+0x82 #16 0xffffffff811c3ece at fork_trampoline+0xe lock order "if_ovpn_lock"(rm) -> "lltable"(sleep mutex) first seen at: #0 0xffffffff80cd35fa at witness_checkorder+0x36a #1 0xffffffff80c2c041 at __mtx_lock_flags+0x91 #2 0xffffffff80e460bd at arpresolve+0x34d #3 0xffffffff80db34b0 at ether_output+0x300 #4 0xffffffff80e6a28a at ip_output+0x163a #5 0xffffffff82b2f01e at ovpn_encap+0x68e #6 0xffffffff82b2f222 at ovpn_encrypt_tx_cb+0x142 #7 0xffffffff80fa1728 at crypto_done+0x168 #8 0xffffffff8109b2aa at aesni_process+0xea #9 0xffffffff80fa1f85 at crypto_invoke+0x85 #10 0xffffffff80fa0b79 at crypto_dispatch_one+0xe9 #11 0xffffffff82b2e82a at ovpn_transmit_to_peer+0x66a #12 0xffffffff82b2df54 at ovpn_send_ping+0x124 #13 0xffffffff80c74bc8 at softclock_call_cc+0x1c8 #14 0xffffffff80c763d6 at softclock_thread+0xc6 #15 0xffffffff80c01852 at fork_exit+0x82 #16 0xffffffff811c3ece at fork_trampoline+0xe lock order "lltable"(sleep mutex) -> "lle"(rw) first seen at: #0 0xffffffff80cd35fa at witness_checkorder+0x36a #1 0xffffffff80c4f325 at _rw_wlock_cookie+0x65 #2 0xffffffff80e4662a at arp_add_ifa_lle+0x7a #3 0xffffffff80e46539 at arp_ifinit+0x139 #4 0xffffffff80db4801 at ether_ioctl+0x1c1 #5 0xffffffff80e4f940 at in_control_ioctl+0xa80 #6 0xffffffff80f09cad at rtnl_handle_addr+0x41d #7 0xffffffff80f05b10 at rtnl_handle_message+0x1a0 #8 0xffffffff80f042da at nl_receive_message+0x12a #9 0xffffffff80f03c15 at nl_taskqueue_handler+0x3f5 #10 0xffffffff80cc5b0b at taskqueue_run_locked+0x1bb #11 0xffffffff80cc6b43 at taskqueue_thread_loop+0xd3 #12 0xffffffff80c01852 at fork_exit+0x82 #13 0xffffffff811c3ece at fork_trampoline+0xe lock order lle -> in6_multi_list_mtx attempted at: #0 0xffffffff80cd3fcb at witness_checkorder+0xd3b #1 0xffffffff80c2c041 at __mtx_lock_flags+0x91 #2 0xffffffff80eb55e1 at in6_lltable_delete_entry+0xc1 #3 0xffffffff80db81fa at lltable_delete_addr+0xda #4 0xffffffff80f0ab97 at rtnl_handle_delneigh+0x97 #5 0xffffffff80f05aad at rtnl_handle_message+0x13d #6 0xffffffff80f042da at nl_receive_message+0x12a #7 0xffffffff80f03c15 at nl_taskqueue_handler+0x3f5 #8 0xffffffff80cc5b0b at taskqueue_run_locked+0x1bb #9 0xffffffff80cc6b43 at taskqueue_thread_loop+0xd3 #10 0xffffffff80c01852 at fork_exit+0x82 #11 0xffffffff811c3ece at fork_trampoline+0xe lock order reversal: (sleepable after non-sleepable) 1st 0xfffff800535e6890 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2465 2nd 0xffffffff81ea2d80 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/neti= net6/in6_mcast.c:1334 lock order lle -> in6_multi_sx attempted at: #0 0xffffffff80cd3fcb at witness_checkorder+0xd3b #1 0xffffffff80c600c0 at _sx_xlock+0x60 #2 0xffffffff80ebbf87 at in6_leavegroup+0x27 #3 0xffffffff80eb562c at in6_lltable_delete_entry+0x10c #4 0xffffffff80db81fa at lltable_delete_addr+0xda #5 0xffffffff80f0ab97 at rtnl_handle_delneigh+0x97 #6 0xffffffff80f05aad at rtnl_handle_message+0x13d #7 0xffffffff80f042da at nl_receive_message+0x12a #8 0xffffffff80f03c15 at nl_taskqueue_handler+0x3f5 #9 0xffffffff80cc5b0b at taskqueue_run_locked+0x1bb #10 0xffffffff80cc6b43 at taskqueue_thread_loop+0xd3 #11 0xffffffff80c01852 at fork_exit+0x82 #12 0xffffffff811c3ece at fork_trampoline+0xe epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [8.148s] sys/netinet6/proxy_ndp:pndp_ifdestroy_success -> epair0a: Ethernet addres= s: 2e:91:cd:6e:76:83 epair0b: Ethernet address: 72:04:f7:93:ae:44 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [1.602s] sys/netinet6/proxy_ndp:pndp_neighbor_advert -> epair0a: Ethernet address:= 96:4c:23:d1:67:83 epair0b: Ethernet address: 42:23:f8:1e:ed:78 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [3.550s] sys/netinet6/redirect:valid_redirect -> epair0a: Ethernet address: b2:1e:= 36:72:69:22 epair0b: Ethernet address: 1a:77:fa:f9:4c:07 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: promiscuous mode enabled epair0a: promiscuous mode disabled epair0b: link state changed to DOWN epair0a: link state changed to DOWN broken: Test case execenv cleanup timed out [3.866s] sys/netinet6/scapyi386:scapyi386 -> epair0a: Ethernet address: 7e:5c:bc:1= 8:ca:df epair0b: Ethernet address: 56:b5:d1:47:89:3c broken: Test case body timed out [300.010s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base -> epair= 0a: Ethernet address: 58:9c:fc:10:6f:86 epair0b: Ethernet address: 58:9c:fc:10:55:18 epair1a: Ethernet address: 58:9c:fc:10:3f:05 epair1b: Ethernet address: 58:9c:fc:10:58:68 epair2a: Ethernet address: 58:9c:fc:10:e1:f5 epair2b: Ethernet address: 58:9c:fc:10:a8:73 broken: Test case body timed out [300.020s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop -> epair= 3a: Ethernet address: 58:9c:fc:10:1a:41 epair3b: Ethernet address: 58:9c:fc:10:8e:5f epair4a: Ethernet address: 58:9c:fc:10:f3:34 epair4b: Ethernet address: 58:9c:fc:10:2f:2b epair5a: Ethernet address: 58:9c:fc:10:68:e6 epair5b: Ethernet address: 58:9c:fc:10:68:6c panic: deadlres_td_sleep_q: possible deadlock detected for 0xfffff8010241a7= 80 (swi6: task queue), blocked for 180093 ticks cpuid =3D 1 time =3D 1793627279 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x36/frame 0xfffffe008bdde= d20 vpanic() at vpanic+0x149/frame 0xfffffe008bddee50 panic() at panic+0x43/frame 0xfffffe008bddeeb0 deadlkres() at deadlkres+0x32a/frame 0xfffffe008bddeef0 fork_exit() at fork_exit+0x82/frame 0xfffffe008bddef30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008bddef30 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- KDB: enter: panic [ thread pid 0 tid 100079 ] Stopped at kdb_enter+0x33: movq $0,0x115ada2(%rip) db:0:kdb.enter.panic> show pcpu cpuid =3D 1 dynamic pcpu =3D 0xfffffe008d3bd380 curthread =3D 0xfffff80102452000: pid 0 tid 100079 critnest 1 "deadlkres= " curpcb =3D 0xfffff80102452550 fpcurthread =3D none idlethread =3D 0xfffff8010240b000: tid 100004 "idle: cpu1" self =3D 0xffffffff82611000 curpmap =3D 0xffffffff81da8d00 tssp =3D 0xffffffff82611384 rsp0 =3D 0xfffffe008bddf000 kcr3 =3D 0x8000000002551002 ucr3 =3D 0xffffffffffffffff scr3 =3D 0x1967d4f94 gs32p =3D 0xffffffff82611404 ldt =3D 0xffffffff82611444 tss =3D 0xffffffff82611434 curvnet =3D 0 spin locks held: db:0:kdb.enter.panic> reset Uptime: 1h53m10s + rc=3D0 + echo 'bhyve return code =3D 0' bhyve return code =3D 0 + sudo /usr/sbin/bhyvectl '--vm=3Dtestvm-main-amd64-29864' --destroy + sh -ex freebsd-ci/scripts/test/extract-meta.sh + METAOUTDIR=3Dmeta-out + rm -fr meta-out + mkdir meta-out + tar xvf meta.tar -C meta-out x ./ x ./disable-zfs-tests.sh x ./disable-dtrace-tests.sh x ./auto-shutdown x ./run-kyua.sh x ./run.sh x ./disable-notyet-tests.sh + rm -f test-report.txt test-report.xml + mv 'meta-out/test-report.*' . mv: rename meta-out/test-report.* to ./test-report.*: No such file or direc= tory + report=3Dtest-report.xml + [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report= .xml ] + rm -f disk-cam + jot 5 + rm -f disk1 + rm -f disk2 + rm -f disk3 + rm -f disk4 + rm -f disk5 + rm -f disk-test.img [PostBuildScript] - [INFO] Executing post build scripts. [FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins13534475322871254744.sh + ./freebsd-ci/artifact/post-link.py Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '013f1779f6341= 3173535ab770abb70715e92bee6', 'branch': 'main', 'target': 'amd64', 'target_= arch': 'amd64', 'link_type': 'latest_tested'} "Link created: main/latest_tested/amd64/amd64 -> ../../013f1779f63413173535= ab770abb70715e92bee6/amd64/amd64\n" Recording test results ERROR: Step =E2=80=98Publish JUnit test result report=E2=80=99 failed: No t= est report files were found. Configuration error? Checking for post-build Performing post-build step Checking if email needs to be generated Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Sending mail from default account using System Admin e-mail address ------=_Part_392_1889469776.1793627280538--