From nobody Sun Jul 27 22:25:37 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bqx5Y6yW6z63Bl0 for ; Sun, 27 Jul 2025 22:25:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic.asd.mail.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4bqx5Y4Gjhz3N0F for ; Sun, 27 Jul 2025 22:25:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1753655151; bh=0saad6Bpc+h0mAJ0kf57gX5WEDVXx8dBZuuYofmLSdE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=gJbNZqkmKOVZGMS1pUt3IUTEjsFP0kJhFnmtqKJRjimE6znRa4zL26LZH9N1pMURcM8P+Ar3k+OTQx+TyM2tiNAcRJIdNfZ8yb81aaWAdkRRonUZKE65LVFo3qqprcCUlB996uKN2OFpRKmEtQx9zgZnAaaQSeUPxD/tT+mX5M+JSOzudcIO3rieyq9O3Ildq9VdCdppHCt0J4Rt6ArGYtQoXblNRJ6hVARf/N/f/KWNLqm3gvE3TqzP177DAuzhFj0HUdWgvUXEm9dwCl3o8xQ/FlPPGXL2KYN8LZzgnVHH3JJgHYw+SvK2yA/wwP0GSn43SkyfCWHNhCO27KC9uw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1753655151; bh=LfVKqJXzhklHFJ6DjrMEs/S/v1tq12QlpxzA+Qc7u8Z=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=hPMk7uNuqc17tMTCQIaBnYe0qD57X6yproWSsiuZlvsgMXacvODDjNnWgKxL4MSgUhd1B1roneOSFmaWMJVVLXqADW2q61q9DVKnToHduKdXAiSMedsT2kdrFqa7W9PTUVwT0DZMsjXdCsielMp/f9Lp/Wl7ik9nyMMAIIazpOUBXbokv2dvD3pAxg/fIHtfS/V+65xC8r7nQ3n7Rr+CnllaC3tAC4DYe/+hxzfgrgRDaNLCw0Gz7CVvRQNiYcwkmlWjmh7S+DJYfrdHKTN0tSyuhbHHLIYygQBrmbPXkSQG9qT1uznO3zN6ITNgOIIGI2+uZtl8LFWxCdVKIJc6Eg== X-YMail-OSG: 59kGWHsVM1lPNCVKupXTehfOr5CtrXyXqQMKpT2u8qrrqvU1v5LXfZUI7jrOpvq Jzq7eLWrjUoe_TztN7x4xJz74ofBRORFiBleMQiQ_gO0d9vLXSOWL_fY5rzYyOlaMRRluJf9dHCZ TwVx_2SKNmA9qgTL3bYbVlOggv5b.LVJTQfrdrG9_KxcHbtdzyJpYQptVqHb.TQCUn86kDJohKoX G.C5QBSRpEjWFT2IaTECafvYzhRDkC4kOmUUOTY_JLaIaqNsr46giFxHv8J41sdjq8bTBGRdjuFU uEYNXxeyTBqSlE4qEwr5tOTNUEKx8NfWp_IY5RsPyIVvR3gxjJhMf.9KafnnjeGkQcRYN1R5Cl6c Q9fWPTs3RFrut0PiXesU_rSFARAUC6ty.04WTdw8HgM4DzaM3U7U9iNc_3nhhKxwQ2jBOM4.8BBc 55d9FAZufcf2tw0hscg0kWVNB3XvFEY2THrAYDPnU2R4176ga_5FssTNFk3_fuZdQ_sqkqFECuSG awTw2Y3z4oiBtlox_oIsQmmoYMn4tclmE3_OVbhdSzTdqE5JZDW9ws8WsNeWcAbJMrGxZCD8UlTb Z2OnZnIvPYJIrueKIZgVZVq7i6E6lYtJ3oEDQas9B.cE3QbIv.ah6CwihorXp4_WiMCk5bzTNfyW 9JcG_9qHpTNK7Kx.93OX3z67wmNtlTUH_yYaP4aJRK4q_c7X42uXNKEubxLhJ4qDtadXVIZ9nYbN LBVT.OU4HashXWQCWrzk7d8cMzpLFkGh_wwS7hz2KgkKuurOiTHmJNz5F33tv8ohK4yfUA.JXOwP N7RCtyKkyyK7zEc93oOmAqZxueRrZKI4AdlVH7Mic7rgztOuaKEsLwTlUd6hYqfktxmTlABukz3M 72qoLMRdOIqVs7ODDdrCpQcpcjX0Ck6av2WINWXbfza5q48p0ofFv5EMSp1cuQdiGumOgL87roTD GlHrMeH4DBgx2nGDjTLgP3g8SBQ6d1pC5pvcWojIYE33BN6AgB5MDrdJavz7K96goIwotA68Tcph 7yV8F9DskLLmZzJG5FU4BE7SJAei1aWNOIBiEqA6A8Jr9mGGPuExOKM0JUPoM.xenX7od4AByaGG 5sHWMl8BjyPSqOA6XFZbnTCEguF_fVqTqjLkbW8CF7HEc2FezjGaX2G_Le6Z6LUVvYVtQoC4yqeO mKqcr2JV08b1AaTcun3r0S5viVcOhwPf8YvQIV8IuXqpYpBqno_lfGM6fh54XLR4HTLT7D32IL0I YRWLtRw0Z1sUALC9S5ZKUymNMtkLBngchJi2190oOUZk0ij8m._Nglid.lAYbaWGTmSk34W.hjCK _eqOuXQD4kUfy55aOFwQMUmPQvyHMDKDBu.h0bLpwOmCAwuTIwxkprOvRzPcbfAyz3YSjzoTexOW IHG6oCnRK.tT_xn0ysjoZQmLDrzhQgD3iRxY3x1mkqKAQhh0x0e4JJlTZ261FFOwp1.vDpSdpfps GrnoGWatROHtpgx0QtoB_Pnt2YdWCk9hFFN33yG4RPsb31G6VvWIQWO8m6kSHN51dTDfI7Rw1idB Bucu3_j.sKB1M3DaPGh0pRXvTkPXqKjMSuYf.IQpyjeRe3V90k2Q9C0T91l_YbeJvHgvngcYEVFt bTs2NnMLCd4Ocv9eoLLec2DA1csBbIc3CueOHDfts3yrnItg7UhI7mqmHIwLwNP81TQ7GTDkX0cu jq7sfovbLhKzJGQYg64g4UfT.AvLxPfbtDq2mvyg8ElhMznVJ7pDaysKoNT_i2rcSNfH3l0rKy7g YYc_3z9xcH_jg.A_4HZWsBENojOUwO_Gkf7_pJUHyr.80rV7JVH5zzYhcyxFj7HukG2YZ1LR1qBU 9TMejiBuCw2Ma.4DX9PErFnWMx7CtBVqOhfpO1QKzBvdvaSViUG16NurGipMNONeL5udUgvrLnwT QuCEEn0.6122KfMMMKSDRUUl_FTz5WONSk3OZbYJ4aRgP9VBTC64gPNN.zQOUdmWXyjGJKJYIFQE 2vFigGr8MWpfiJyqCP0i2PsgsRWh285uXWSrXwvdCYd9H7P1NoFC6quxCjx3gE8tSLrdHqRfOrnJ QDsmHnZZI1_ZUS9WaobQum5y3C0Gtvzjr4155YR8AAanTbfgpU39zNC.TACOERGfnJMQi8o7Nalw y1DEnln.RK8.mGLS2Rp_okj41Ve8N0A5tZB5NrK4.hv5DdPczK1_z8XkFg0zmr1A8J4ZKDzea3w3 wBaJsy97s72KiNsduDQw6F.d8M39FXQ-- X-Sonic-MF: X-Sonic-ID: 1d889b5d-fb86-4ef1-b241-740fa46448ba Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sun, 27 Jul 2025 22:25:51 +0000 Received: by hermes--production-gq1-74d64bb7d7-fddgg (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2bb667d84bd44947c6dd588065a6e759; Sun, 27 Jul 2025 22:25:48 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.600.51.1.1\)) Subject: Re: A panic by vm_pageout_scan_active activity, some details in case they might help From: Mark Millard In-Reply-To: Date: Sun, 27 Jul 2025 15:25:37 -0700 Cc: FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Mark Johnston X-Mailer: Apple Mail (2.3826.600.51.1.1) X-Rspamd-Queue-Id: 4bqx5Y4Gjhz3N0F X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] On Jul 27, 2025, at 15:00, Mark Johnston wrote: >=20 > On Sun, Jul 27, 2025 at 02:26:29PM -0700, Mark Millard wrote: >> I tried a poudriere(-devel) bulk -Ca on the amd64 system that >> I have access to and a package build used up much of the >> RAM+SWAP =3D=3D 704 GiBytes before a panic happened. Past examples >> OOM'd without panics, although I did not know the context until >> examining this crash dump. >=20 > What is the panic string? The picture I took shows: Fatal Trap 12: page fault while in kernel mode # more /var/crash/info.4 Dump header from device: /dev/gpt/OptBswp364 Architecture: amd64 Architecture Version: 2 Dump Length: 20258381824 Blocksize: 512 Compression: none Dumptime: 2025-07-26 18:56:16 -0700 Hostname: 7950X3D-ZFS Magic: FreeBSD Kernel Dump Version String: FreeBSD 15.0-CURRENT main-n278320-3a33e39edd48 = GENERIC-NODEBUG Panic String: page fault Dump Parity: 668710208 Bounds: 4 Dump Status: good > Could you please open a report on bugzilla > and include the full core.txt.4? Okay. >> # uname -apKU >> FreeBSD 7950X3D-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT = main-n278320-3a33e39edd48 GENERIC-NODEBUG amd64 amd64 1500048 1500048 >>=20 >> That is an official PkgBase installation of the boot-kernel and >> boot-world, not a personal build. >>=20 >> The dump materials had references for doxygen and for dot to : >>=20 >> /usr/local/poudriere/data/.m/main-ZNV4-bulk_a-alt/06/dev >>=20 >> that let me track this to the [06] builder running at the time >> of the crash: >>=20 >> [2D:01:22:29] [06] [00:00:00] Building graphics/sdl2_gpu | = sdl2_gpu-0.12.0 >>=20 >> It was running doxygen, which in turn was running mulitple dot's. >>=20 >> =46rom /var/crash/core.txt.4 : >>=20 >> UID PID PPID C PRI NI VSZ RSS MWCHAN STAT TT = TIME COMMAND >> . . . >> 0 79229 40923 4 59 0 23524 4148 wait D - = 0:00.00 [sh] >> 0 79230 79229 5 59 0 14208 172 wait Ds - = 0:00.01 [make] >> 0 79233 79230 4 59 0 14668 176 wait D - = 0:00.00 [sh] >> 0 79234 79233 5 59 0 14668 176 wait D - = 0:00.00 [sh] >> 0 79235 79234 12 0 0 16284 356 select D - = 0:00.01 [ninja] >> 0 79236 79235 28 59 0 223048 1052 uwait D - = 0:00.44 [doxygen] >> 0 79272 79236 25 59 0 157589964 41424308 pfault D - = 3:25.33 [dot] >> 0 79279 79236 31 59 0 157601740 41513520 pfault D - = 3:23.41 [dot] >> 0 79289 79236 14 59 0 157589964 41361600 pfault D - = 3:22.72 [dot] >> 0 79301 79236 18 49 0 157667276 41208476 pfault D - = 3:24.32 [dot] >> . . . >>=20 >> . . . >> #14 >> No locals. >> #15 vm_pageout_scan_active (vmd=3D0xffffffff81c22380 , >> page_shortage=3D102849) >> at /home/pkgbuild/worktrees/main/sys/vm/vm_pageout.c:1264 >> ss =3D {bq =3D {bq_pa =3D {0xfffffe0030a1e500, = 0xfffffe00a8798110, >> 0xfffffe00e3083e30, 0xfffffe00a47a4228, = 0xfffffe002b6d8ef8, >> 0xfffffe0065cf29a0, 0xfffffe007a1b83b8, = 0xfffffe008cf7b3c0, >> 0xfffffe005cd565e0, 0xfffffe0048ced5d8, = 0xfffffe00c761d488, >> 0xfffffe008a5efe90, 0xfffffe00cf341738, = 0xfffffe00413f97b8, >> 0xfffffe005270cc68, 0xfffffe00a5d9d690, = 0xfffffe00294329e0, >> 0xfffffe005ef52f00, 0xfffffe0020dff308, = 0xfffffe00ce1e9a40, >> 0xfffffe007ec47618, 0xfffffe005d1ba7e8, = 0xfffffe0032d73470, >> 0xfffffe0030835e88, 0xfffffe009969c438, = 0xfffffe00f151b0c8, >> 0xfffffe0063916fe8, 0xfffffe00dac0b778, = 0xfffffe0016267348, >> 0xfffffe00b74a5fe0, 0xfffffe003434ef80, = 0xfffffe009e31e840, >> 0xfffffe00530f6408, 0xfffffe00e0649508, = 0xfffffe0102e87ad8, >> 0xfffffe0092c52848, 0xfffffe00ba829618, = 0xfffffe008bf0fd10, >> 0xfffffe00550708c0, 0xfffffe00eedc67b8, = 0xfffffe00d45f8210, >> 0xfffffe00b89a8698, 0xfffffe0082ffb310, = 0xfffffe00accd53c0, >> 0xfffffe0091c8f5d8, 0xfffffe004e20f180, = 0xfffffe004dfb4f90, >> 0xfffffe00a437fbb0, 0xfffffe00218cb698, = 0xfffffe004ee5d278, >> 0xfffffe00a9e845a0, 0xfffffe0025d4a7c8, = 0xfffffe0037612ac8, >> 0xfffffe005c7d3da8, 0xfffffe00d307c1b8, = 0xfffffe00ee416538, >> 0xfffffe0043747508, 0xfffffe00ef30b508, = 0xfffffe00c04de600, >> 0xfffffe008c0e3040, 0xfffffe0071a97b40, = 0xfffffe005b644ad8, >> 0xfffffe00dd5da3b0}, bq_cnt =3D 39}, >> pq =3D 0xffffffff81c22400 , >> marker =3D 0xffffffff81c22778 , maxscan =3D = 37165731, >> scanned =3D 15440544} >> marker =3D 0xffffffff81c22778 >> pq =3D 0xffffffff81c22400 >> old =3D >> scan_tick =3D >> min_scan =3D >> m =3D 0xfffffe00eedc67b8 >> object =3D 0x2b6c70f000 >> refs =3D >> new =3D >> ps_delta =3D >> act_delta =3D >> max_scan =3D >> nqueue =3D >> _v =3D >> _tid =3D >> _v =3D >> _tid =3D >> _v =3D >> _v =3D >> _tid =3D >> _v =3D >> . . . >>=20 >> =46rom the /usr/src/sys/ for the PkgBase installation in use, there = is in >> vm_pageout_scan_active : >>=20 >> /home/pkgbuild/worktrees/main/sys/vm/vm_pageout.c: unmodified, = readonly: line 1264 of 2416 [52%] >>=20 >> /* >> * Check to see "how much" the page has been used. >> * >> * Test PGA_REFERENCED after calling = pmap_ts_referenced() so >> * that a reference from a concurrently destroyed = mapping is >> * observed here and now. >> * >> * Perform an unsynchronized object ref count check. = While >> * the page lock ensures that the page is not = reallocated to >> * another object, in particular, one with unmanaged = mappings >> * that cannot support pmap_ts_referenced(), two races = are, >> * nonetheless, possible: >> * 1) The count was transitioning to zero, but we saw = a non- >> * zero value. pmap_ts_referenced() will return = zero >> * because the page is not mapped. >> * 2) The count was transitioning to one, but we saw = zero. >> * This race delays the detection of a new = reference. At >> * worst, we will deactivate and reactivate the = page. >> */ >> refs =3D object->ref_count !=3D 0 ? = pmap_ts_referenced(m) : 0; >>=20 >> I am unlikely to be able to replicate the panic. >>=20 >> I hope that this is of some use. >>=20 >> Note: >>=20 >> I linked /home/pkgbuild/worktrees/main/sys to >> /usr/sys/src so that such paths work in my >> context. >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com