From nobody Fri Jun 27 20:12:04 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bTRYB683Pz60CWR for ; Fri, 27 Jun 2025 20:12:14 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx-01.divo.sbone.de (mx-01.divo.sbone.de [IPv6:2003:a:140a:2200:6:594:fffe:19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (prime256v1) client-digest SHA256) (Client CN "mx-01.divo.sbone.de", Issuer "E5" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bTRYB1mM3z3FVs; Fri, 27 Jun 2025 20:12:14 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; none Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mx-01.divo.sbone.de (Postfix) with ESMTPS id D4925A64805; Fri, 27 Jun 2025 20:12:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=zabbadoz.net; s=20240622; t=1751055123; bh=9dDZgAWfyMd08Fm72yaDxNeyf3WeALbEEmEDNgzZ7T0=; h=Date:From:To:cc:Subject:In-Reply-To:References; b=Ez/onqZDiBiy3XRnIefheGJZI7Ni/7GwiYWXQQ8KC3NYlnurXvQHCT5gjEfqcZqqa EFaQHXmR2FRqJv4pBG6+31k+B80c8B5l/kM3dn437EwOM6+MRAvL4DioKvhuYH320c FWeSYGi4hArthQXbEIvqkuk1WaliRW0RScBEmPpjgdhXqtC5UcgB2JLmpTqWQ5mCdT Y/XntUSsI0asZMbJ7jGNEcmCd0vT8yXkZuCydGSY/A5QDlhJ3O+YIvhlOLuUOEWm/h JD8poihvgard1TjMF1RUq6l6xyv4H/ZdRSvamB6BZ6UT+CAWVTjQ0caFgdkT8ctnDt WW9yaJrzWw10lXOUAKYCMpceD5gaT8dJkJZmWNljACk9vdIcMucEoUsMNzJOj1a2zC sQya8bJvSBVELf+SpZXUj0d9s92FYfiPSSPz6PXWEevQRjpHTJe0Pcn5M/fd0Ro8/v fUn/DYvoQ20kEGu5SVPkXEu9UWmivUDowc3UQGDHJsoNNE9WN1UjsvfMrD2un9fSFb HwY0MiImFBoPUu+keTSXytgXRDIpzRwVH5gvPGsXqJIfuM1FxIvNJ14d9U1RAM3WGv JoWYitbbTh0aQK36r9EstsCO1Txs2RsAXtd1a9jlPCS1IyozDBUKx2CSEuXgPnt6n8 8hmmJDPPytoB6YklgJForj1k= Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 5F9562D029E0; Fri, 27 Jun 2025 20:12:06 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id vioaYZLfnMEU; Fri, 27 Jun 2025 20:12:05 +0000 (UTC) Received: from strong-rtwn0.sbone.de (strong-rtwn0.sbone.de [IPv6:fde9:577b:c1a9:4902:3e64:cfff:fe55:bc80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 257662D029D8; Fri, 27 Jun 2025 20:12:05 +0000 (UTC) Date: Fri, 27 Jun 2025 20:12:04 +0000 (UTC) From: "Bjoern A. Zeeb" To: Zhenlei Huang cc: FreeBSD Current , Olivier Certner Subject: Re: regression: memory issues on main/arm64 over sched/runq changes In-Reply-To: <6A003013-415A-4594-AB04-AF5A9B2D660D@FreeBSD.org> Message-ID: <23n1773o-10o2-5p5o-25s4-r623rnn44649@yvfgf.mnoonqbm.arg> References: <43005447-2rq0-6nn2-pnr5-4939s112npr4@yvfgf.mnoonqbm.arg> <0A01B9F5-C49C-41D8-BAB7-4378DEDBF647@FreeBSD.org> <28o26o81-so5r-qq79-6q6n-0q6746o7oo79@yvfgf.mnoonqbm.arg> <6A003013-415A-4594-AB04-AF5A9B2D660D@FreeBSD.org> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 4bTRYB1mM3z3FVs X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:3320, ipnet:2003::/19, country:DE] On Sat, 28 Jun 2025, Zhenlei Huang wrote: > > >> On Jun 27, 2025, at 11:02 PM, Bjoern A. Zeeb wrote: >> >> On Wed, 25 Jun 2025, Zhenlei Huang wrote: >> >> Hi, >> >> I appplied olce's change from the review but it didn't make a difference >> on my arm64 and now on a tree with local changes (wifi bits, user sapce >> bits, etc). >> >> Now I netbooted that tree on X86 hardware (an old Lenovo Laptop) and ran >> into something else (the same tree boots in a bhyve instance on a >> different machine from a local disk image). >> >> At the end of if_addgroup() I had added the following for local >> debugging (really crude sorry): >> >> ... >> >> + atomic_thread_fence_seq_cst(); >> IF_ADDR_WLOCK(ifp); >> CK_STAILQ_INSERT_TAIL(&ifg->ifg_members, ifgm, ifgm_next); >> CK_STAILQ_INSERT_TAIL(&ifp->if_groups, ifgl, ifgl_next); >> IF_ADDR_WUNLOCK(ifp); >> >> IFNET_WUNLOCK(); // excl unlock >> >> if (new) >> EVENTHANDLER_INVOKE(group_attach_event, ifg); >> EVENTHANDLER_INVOKE(group_change_event, groupname); >> >> + IFNET_RLOCK(); // shared, panic >> + CK_STAILQ_FOREACH(ifgl, &ifp->if_groups, ifgl_next) { >> + if (bz_debug_groups) if_printf(ifp, "XXXXXXXXXXXXXXXXXXXXXXXXXXX-BZ %s:%d: ifgl %p, ifgl_group %p, ifg_group %p\n", __func__, __LINE__, ifgl, (ifgl != NULL) ? ifgl->ifgl_group : NULL, (ifgl != NULL && ifgl->ifgl_group != NULL) ? ifgl->ifgl_group->ifg_group : NULL); >> + } >> + IFNET_RUNLOCK(); >> + >> return (0); >> } >> >> >> >> You see the anotation //shared ? >> >> I got a panic: excl->share with that. > > Well, I applied identical patch with you and I can repeat that panic, but my screen freezes and the top most stack is I took a video of the boot at 60fps so I could "scroll" a bit backwards. > ``` > _sx_slock_int() at _sx_slock_int+0x64/frame 0xff.... > if_addgroup() at ..... > .... > device_attach() at ... > ... > root_bus_configure() at ... > configure() at ... > mi_startup() at .. > ``` > > I've no idea what's wrong. From the disassembly it appears the panic happens just after witness_checkorder . That is interesting. So it's not just me. Did you do a netboot or from disk? -- Bjoern A. Zeeb r15:7