From nobody Mon Aug 29 12:06:46 2022 X-Original-To: dev-ci@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MGTgp6qy8z4b0dZ for ; Mon, 29 Aug 2022 12:06:46 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MGTgp4xR9z42Mf; Mon, 29 Aug 2022 12:06:46 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins.ci.freebsd.org (jenkins.ci.freebsd.org [IPv6:2610:1c1:1:607c::16:16]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4MGTgp3k2kzQZY; Mon, 29 Aug 2022 12:06:46 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Date: Mon, 29 Aug 2022 12:06:46 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: melifaro@FreeBSD.org, dev-ci@FreeBSD.org Cc: jenkins-admin@FreeBSD.org Message-ID: <2041606026.7095.1661774806528@jenkins.ci.freebsd.org> Subject: FreeBSD-main-amd64-test - Build #21969 - Failure List-Id: Continuous Integration Build and Test Results List-Archive: https://lists.freebsd.org/archives/dev-ci List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-ci@freebsd.org X-BeenThere: dev-ci@freebsd.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_7094_198223969.1661774806156" X-Jenkins-Job: FreeBSD-main-amd64-test X-Jenkins-Result: FAILURE List-ID: FreeBSD CI Build Notifications Precedence: bulk ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1661774806; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: list-id; bh=tDDOBObG/3nBbPNtNTo5vt/jqi9uMIbzLoaVz8rsvCU=; b=iIGfF+dUGTaq+9iBeN0m4DZIvADVwcp7e9bRhWVY5V52EP/JbS3UNyp5WKIWotB3JFZx8V zroEQYJuoJ8Z04opBYsSeuB5IhKBmtxp4PH0h0PFIN2wNiKo0f0wxC9LGRuC2JLc5brljC yYFJrr6eY9K6Y9J/GUAbfo/FCxOB1ZkzN7hJ55x+3Fo5U/xWdh3c1lPJZz9Rtfg0EPrB2n tE7oyvUmpPuUXJE1hLhAIG+PKznDyTI/JUeT1BXTO72nOmDJq/ca6MnKjOB0zFupUsQzs0 bUr4BeJhmzQ+pa/nHplTicxIJfJeLZzdBwlLYK7WBibPmoRTAVAK7HXK0zBxTA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1661774806; a=rsa-sha256; cv=none; b=aaLYfYZVlWvYrqBzVjncWpPhN6Bjk1dpKoilgpVOw8Bsrp+2T4R8wuU3HJPqYkASigImwg 3iBEdKu31qjC/FUCMHsrdjxLIS9nNvtPsGQAZFIbYVxn9ENuq1PQxI65dwoW4YFiUA0goP eXSBtCEAybBswZzHdhM7TV7nvbTZgTsKnqGtb5YQy313rQCO4NAL5lSYUbBWCBVseSzxnV 8CMYn/ucMBqH8x7hXARt8PCQ6lf3IWmhpmB0D7vPEeYE1iRYjdYTvb/hFvs+EDPZY60yGy 4Qlg7JM9DUDc4M5ifmpHfFmeYOKF2K5XifPEOMURqkYaLuAXPcHqN5qQ0CzQFg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none X-ThisMailContainsUnwantedMimeParts: N ------=_Part_7094_198223969.1661774806156 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable FreeBSD-main-amd64-test - Build #21969 (6d4f6e4c704d17084144ac3fe0c8507015f= 1357f) - Failure Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/21969= / Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/21969/c= hanges Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/21969/co= nsole Status explanation: "Failure" - the build is suspected being broken by the following changes "Still Failing" - the build has not been fixed by the following changes and this is a notification to note that these changes have not been fully tested by the CI system Change summaries: (Those commits are likely but not certainly responsible) a1b59379db7d879551118b921f6e9692b4bf200c by melifaro: routing: install prefix and loopback routes using new nhop-based KPI. d8b2693414ae5cebdbd4c64c9559275c4baff11e by melifaro: routing: add rib_add_default_route() wrapper 835a611e684094d82de306209071e233bb83123a by melifaro: routing: make IPv6 defrouter code use new nhop-based KPI. 6d4f6e4c704d17084144ac3fe0c8507015f1357f by melifaro: routing: make rib_add_redirect() use new nhop-based KPI The end of the build log: [...truncated 3.85 MB...] epair1b: link state changed to DOWN ifa_del_loopback_route: failed to delete interface epair1b route: 3 ifa_del_loopback_route: failed to delete interface epair1b route: 3 ifa_del_loopback_route: failed to delete interface epair1b route: 3 carp: demoted by -240 to 0 (vhid removed) epair1b: promiscuous mode disabled passed [5.438s] sys/netinet/carp:basic_v6 -> bridge0: Ethernet address: 58:9c:fc:10:ff:90 epair0a: Ethernet address: 02:49:4c:6f:b1:0a epair0b: Ethernet address: 02:49:4c:6f:b1:0b epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 02:11:9e:c9:a6:0a epair1b: Ethernet address: 02:11:9e:c9:a6:0b epair1a: link state changed to UP epair1b: link state changed to UP bridge0: link state changed to UP epair0a: promiscuous mode enabled epair1a: promiscuous mode enabled epair0b: promiscuous mode enabled carp: 1@epair0b: INIT -> BACKUP (initialization complete) epair1b: promiscuous mode enabled carp: 1@epair1b: INIT -> BACKUP (initialization complete) carp: 1@epair0b: BACKUP -> MASTER (master timed out) add_loopback_route_flags: failed to update interface epair0b route: 17 epair1a: promiscuous mode disabled epair0a: promiscuous mode disabled bridge0: link state changed to DOWN epair0a: link state changed to DOWN carp: 1@epair0b: MASTER -> INIT (hardware interface down) carp: demoted by 240 to 240 (interface down) epair0b: link state changed to DOWN lock order reversal: (sleepable after non-sleepable) 1st 0xfffff80019b7dd08 carp_softc (carp_softc, sleep mutex) @ /usr/src/sys= /netinet/ip_carp.c:1992 2nd 0xffffffff81fb6210 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/neti= net6/in6_mcast.c:1306 lock order carp_softc -> in6_multi_sx attempted at: #0 0xffffffff80c5c80d at witness_checkorder+0xbfd #1 0xffffffff80bf6193 at _sx_xlock+0x63 #2 0xffffffff80e0af67 at in6_leavegroup+0x27 #3 0xffffffff8287b283 at carp_detach+0x363 #4 0xffffffff80e02cf8 at in6_purgeaddr+0x38 #5 0xffffffff80e02976 at in6_purgeifaddr+0x16 #6 0xffffffff80d14326 at if_purgeaddrs+0x146 #7 0xffffffff80d14892 at if_detach_internal+0x1c2 #8 0xffffffff80d14501 at if_detach+0x71 #9 0xffffffff8290b80b at epair_clone_destroy+0x6b #10 0xffffffff80d1c34c at if_clone_destroyif+0x19c #11 0xffffffff80d1c134 at if_clone_destroy+0x114 #12 0xffffffff80d18e71 at ifioctl+0x741 #13 0xffffffff80c62572 at kern_ioctl+0x202 #14 0xffffffff80c622ba at sys_ioctl+0x12a #15 0xffffffff810ca956 at amd64_syscall+0x6a6 #16 0xffffffff8109d08b at fast_syscall_common+0xf8 carp: demoted by -240 to 0 (vhid removed) epair0b: promiscuous mode disabled ifa_del_loopback_route: failed to delete interface epair0b route: 3 epair1a: link state changed to DOWN carp: 1@epair1b: BACKUP -> INIT (hardware interface down) carp: demoted by 240 to 240 (interface down) epair1b: link state changed to DOWN carp: demoted by -240 to 0 (vhid removed) epair1b: promiscuous mode disabled ifa_del_loopback_route: failed to delete interface epair1b route: 3 passed [5.440s] sys/netinet/carp:nd6_ns_source_mac -> bridge0: Ethernet address: 58:9c:fc= :10:ff:90 epair0a: Ethernet address: 02:99:bc:96:57:0a epair0b: Ethernet address: 02:99:bc:96:57:0b epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 02:3f:12:f5:52:0a epair1b: Ethernet address: 02:3f:12:f5:52:0b epair1a: link state changed to UP epair1b: link state changed to UP bridge0: link state changed to UP epair0a: promiscuous mode enabled epair1a: promiscuous mode enabled epair0b: promiscuous mode enabled carp: 1@epair0b: INIT -> BACKUP (initialization complete) epair1b: promiscuous mode enabled carp: 1@epair1b: INIT -> BACKUP (initialization complete) carp: 1@epair0b: BACKUP -> MASTER (master timed out) add_loopback_route_flags: failed to update interface epair0b route: 17 epair1a: promiscuous mode disabled epair0a: promiscuous mode disabled bridge0: link state changed to DOWN epair0a: link state changed to DOWN carp: 1@epair0b: MASTER -> INIT (hardware interface down) carp: demoted by 240 to 240 (interface down) epair0b: link state changed to DOWN carp: demoted by -240 to 0 (vhid removed) epair0b: promiscuous mode disabled ifa_del_loopback_route: failed to delete interface epair0b route: 3 epair1a: link state changed to DOWN carp: 1@epair1b: BACKUP -> INIT (hardware interface down) carp: demoted by 240 to 240 (interface down) epair1b: link state changed to DOWN carp: demoted by -240 to 0 (vhid removed) epair1b: promiscuous mode disabled ifa_del_loopback_route: failed to delete interface epair1b route: 3 passed [18.613s] sys/netinet/carp:negative_demotion -> epair0a: Ethernet address: 02:52:a7= :5f:b0:0a epair0b: Ethernet address: 02:52:a7:5f:b0:0b epair0a: link state changed to UP epair0b: link state changed to UP epair0a: promiscuous mode enabled carp: 1@epair0a: INIT -> BACKUP (initialization complete) epair0b: promiscuous mode enabled carp: 1@epair0b: INIT -> BACKUP (initialization complete) carp: 1@epair0a: BACKUP -> MASTER (master timed out) carp: demoted by -1 to -1 (sysctl) carp: 1@epair0a: MASTER -> INIT (hardware interface down) carp: demoted by 240 to 239 (interface down) epair0a: link state changed to DOWN carp: 1@epair0b: BACKUP -> INIT (hardware interface down) carp: demoted by 240 to 240 (interface down) epair0b: link state changed to DOWN ifa_del_loopback_route: failed to delete interface epair0a route: 3 ifa_del_loopback_route: failed to delete interface epair0a route: 3 carp: demoted by -240 to -1 (vhid removed) epair0a: promiscuous mode disabled ifa_del_loopback_route: failed to delete interface epair0b route: 3 ifa_del_loopback_route: failed to delete interface epair0b route: 3 ifa_del_loopback_route: failed to delete interface epair0b route: 3 carp: demoted by -240 to 0 (vhid removed) epair0b: promiscuous mode disabled passed [6.356s] sys/netinet/divert:ipdivert_ip_input_local_success -> epair0a: Ethernet a= ddress: 02:ee:9e:9d:03:0a epair0b: Ethernet address: 02:ee:9e:9d:03:0b epair0a: link state changed to UP epair0b: link state changed to UP epair0b: link state changed to DOWN epair0a: link state changed to DOWN passed [1.056s] sys/netinet/divert:ipdivert_ip_output_remote_success -> epair0a: Ethernet= address: 02:40:63:a4:15:0a epair0b: Ethernet address: 02:40:63:a4:15:0b epair0a: link state changed to UP epair0b: link state changed to UP epair0b: link state changed to DOWN epair0a: link state changed to DOWN passed [0.943s] sys/netinet/fibs:fibs_ifroutes1_success -> epair0a: Ethernet address: 02:= 02:f8:98:ed:0a epair0b: Ethernet address: 02:02:f8:98:ed:0b epair0a: link state changed to UP epair0b: link state changed to UP WARNING: Adding ifaddrs to all fibs has been turned off by default. Conside= r tuning net.add_addr_allfibs if needed epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [0.118s] sys/netinet/fibs_test:arpresolve_checks_interface_fib -> skipped: firewal= ls interfere with this test [0.044s] sys/netinet/fibs_test:default_route_with_multiple_fibs_on_same_subnet -> = tap0: Ethernet address: 58:9c:fc:10:b1:59 tap1: Ethernet address: 58:9c:fc:10:ff:c2 passed [0.071s] sys/netinet/fibs_test:default_route_with_multiple_fibs_on_same_subnet_inet6= -> tap0: Ethernet address: 58:9c:fc:10:b1:59 tap1: Ethernet address: 58:9c:fc:10:ff:c2 passed [0.055s] sys/netinet/fibs_test:loopback_and_network_routes_on_nondefault_fib -> ta= p0: Ethernet address: 58:9c:fc:10:b1:59 passed [0.051s] sys/netinet/fibs_test:loopback_and_network_routes_on_nondefault_fib_inet6 = -> tap0: Ethernet address: 58:9c:fc:10:b1:59 passed [0.058s] sys/netinet/fibs_test:same_ip_multiple_ifaces -> tap0: Ethernet address: = 58:9c:fc:10:b1:59 tap1: Ethernet address: 58:9c:fc:10:ff:c2 tap2: Ethernet address: 58:9c:fc:10:ff:c4 tap3: Ethernet address: 58:9c:fc:10:b9:17 panic: Lock rib head lock not locked @ /usr/src/sys/net/route/route_ctl.c:3= 60 cpuid =3D 0 time =3D 1661774805 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00d1d7b= 830 vpanic() at vpanic+0x151/frame 0xfffffe00d1d7b880 panic() at panic+0x43/frame 0xfffffe00d1d7b8e0 _rm_assert() at _rm_assert+0x263/frame 0xfffffe00d1d7b920 rib_add_route_px() at rib_add_route_px+0xbb/frame 0xfffffe00d1d7b990 add_loopback_route_flags() at add_loopback_route_flags+0x109/frame 0xfffffe= 00d1d7ba00 ifa_switch_loopback_route() at ifa_switch_loopback_route+0x36/frame 0xfffff= e00d1d7ba50 in_scrubprefix() at in_scrubprefix+0x76/frame 0xfffffe00d1d7bad0 in_difaddr_ioctl() at in_difaddr_ioctl+0x2fb/frame 0xfffffe00d1d7bb30 in_control() at in_control+0xac/frame 0xfffffe00d1d7bbd0 ifioctl() at ifioctl+0x7f4/frame 0xfffffe00d1d7bcc0 kern_ioctl() at kern_ioctl+0x202/frame 0xfffffe00d1d7bd30 sys_ioctl() at sys_ioctl+0x12a/frame 0xfffffe00d1d7be00 amd64_syscall() at amd64_syscall+0x6a6/frame 0xfffffe00d1d7bf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00d1d7bf30 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip =3D 0x1af55b4af97a, rsp =3D= 0x1af5571c35d8, rbp =3D 0x1af5571c3620 --- KDB: enter: panic [ thread pid 83815 tid 101224 ] Stopped at kdb_enter+0x32: movq $0,0x12a4cf3(%rip) db:0:kdb.enter.panic> show pcpu cpuid =3D 0 dynamic pcpu =3D 0x9c2e00 curthread =3D 0xfffffe00d1b35ac0: pid 83815 tid 101224 critnest 1 "ifcon= fig" curpcb =3D 0xfffffe00d1b35fe0 fpcurthread =3D 0xfffffe00d1b35ac0: pid 83815 "ifconfig" idlethread =3D 0xfffffe001122c3a0: tid 100003 "idle: cpu0" self =3D 0xffffffff82610000 curpmap =3D 0xfffffe00d2153530 tssp =3D 0xffffffff82610384 rsp0 =3D 0xfffffe00d1d7c000 kcr3 =3D 0x8000000043532638 ucr3 =3D 0x800000003e229e38 scr3 =3D 0x3e229e38 gs32p =3D 0xffffffff82610404 ldt =3D 0xffffffff82610444 tss =3D 0xffffffff82610434 curvnet =3D 0xfffff800031c1f40 spin locks held: db:0:kdb.enter.panic> reset + rc=3D0 + echo 'bhyve return code =3D 0' bhyve return code =3D 0 + sudo /usr/sbin/bhyvectl '--vm=3Dtestvm-main-amd64-21969' --destroy + sh -ex freebsd-ci/scripts/test/extract-meta.sh + METAOUTDIR=3Dmeta-out + rm -fr meta-out + mkdir meta-out + tar xvf meta.tar -C meta-out x ./ x ./disable-notyet-tests.sh x ./disable-zfs-tests.sh x ./run.sh x ./run-kyua.sh x ./disable-dtrace-tests.sh x ./auto-shutdown + rm -f test-report.txt test-report.xml + mv 'meta-out/test-report.*' . mv: rename meta-out/test-report.* to ./test-report.*: No such file or direc= tory + report=3Dtest-report.xml + [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report= .xml ] + rm -f disk-cam + jot 5 + rm -f disk1 + rm -f disk2 + rm -f disk3 + rm -f disk4 + rm -f disk5 + rm -f disk-test.img [PostBuildScript] - [INFO] Executing post build scripts. [FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins3835861165357751562.sh + ./freebsd-ci/artifact/post-link.py Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '6d4f6e4c704d1= 7084144ac3fe0c8507015f1357f', 'branch': 'main', 'target': 'amd64', 'target_= arch': 'amd64', 'link_type': 'latest_tested'} "Link created: main/latest_tested/amd64/amd64 -> ../../6d4f6e4c704d17084144= ac3fe0c8507015f1357f/amd64/amd64\n" Recording test results ERROR: Step =E2=80=98Publish JUnit test result report=E2=80=99 failed: No t= est report files were found. Configuration error? Checking for post-build Performing post-build step Checking if email needs to be generated Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Sending mail from default account using System Admin e-mail address ------=_Part_7094_198223969.1661774806156--