From nobody Thu Dec 11 02:08:56 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dRbcX2Ytyz6K68G for ; Thu, 11 Dec 2025 02:09:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4dRbcV1PRBz3qg5 for ; Thu, 11 Dec 2025 02:09:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=uGnyyl3z; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1765418951; bh=Ot+k1MOcJOUnKRpNRcLji5Iom8B1UzgmbkuxlK1CoNg=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=uGnyyl3zALw3jnGOnlj/lRN/sF17ShludubfxJ/nRVG7q5Un8fr9i58c5QLpGRRsMKVUlooUS3nGocKewP2xM4RY+/DSAxBTNUEwg9mLP+cpcSQIjF+bO/lwUoGXvivsgmwi5/b0glk/jKXLSpTXZ1rXcTqYqeIqLgMMVZYGbSFvbZCyW+RAOpzWMQVGyqrg/QDj3p5Y1f43P+DCZ+4QP/t5uxhKg5cTJjyqfvhSHlKK5njPAaTjelUF1PhaxsbpAXhrQhwFt/bpmFtDSBG6xvXebUeXQ96eDwH/JpguVf+3PzPoHV6aoUpV7FhM4x6MOTd0dH2NF9okwp4LL2ol+w== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1765418951; bh=Y2XP8fD8NkzzMDelwh6exp4P/N2358WZXWpPSV6nl2p=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=hm9BQqs19UODQmZiTNAiso8LcQ9pZE1731V+Wn+THyjr3UMmFz4ivkclAi0KQwqH+N2RVTNXUDEHRBfHJ5CVWhqtaoDTsYxZWlRRT5Df0sJkVC3jBmLtkoAUN6AAJWZHlcSK5MZ0+IpLwk2PYyl9SiK4YhigInqMeghfSqazL2xRnswW8vobqv6C7WXtrzZZovDRBxG+e0DEJawabQpfpA6GfMYb+mdCmH5RluIjD9ChaPQnB8A4ljEpk+7S3Yg2cQxcTbqcg2DuLb26//53KVYgW7SHLCaEdzA5cuGT80VpfLYLm4d8WJekPVIXcY75W0tXinYbW8V1m9mrJz+xrA== X-YMail-OSG: rx1TCcYVM1lIFn4WE90AyIS8bS57wN9kgl22kIiWmj.sXMeon5i0Vc5YfhZF56q AOWOQqT51zWamDDVDs5_Vf5rpzP.Y5parNb2ScGBmqnLs09SpKhAFOyTCjNMLspBA_x_eo.xnJ3h ng3LPnadJak74MTBwuMLjI1o.osWwHlC81hxWsCGzqM4sSRka8R3eJPXPNnAkYTEo24XM5R5lr5v nHsr90wvZ0X2K141Yj9RgLqYQOig7tziS2AWZPKx7uyz9WWzZv_hpv1iYp_RquK59B3oGYkFTDAn txYlDLpYpjgbv8sPddL7.lZ6NZMIQ.SxXtBkzvVZx63FRL4_tUfA7b4Bge7Tu.LOH9ug.cArWpN4 sDLx4ojLjquPSyPT4kI4zlGv7CrvtuTvzwl_LbBdiDAtxLfO9xwoedgBPXIFhcNuzL0guz4lrpaq 3.mWl48.hjHbC3r4iTOFMuiB0pSq3u142XnZnRwEkrcPzJhDEfzVTfVkL7wvcfHL_wbrgSDjK0x2 tolUnEeBpySB2fN_A7r5og2OzxSGzDvKTSXPeCzynxIJBcQWbpPTsETwjcugdUkqnBE2zUmx1nIC jwc0hRS7ZF9sL5ENAe0Up14XipUa02OR9MbYuIz.j075cn289cnkGQJwnEj7mYBTHBnzymKEesvg hOO07DifnL_UPsKVJ0cIPE11C.e5c27QMTUPpACTVPR3TK4yI71tqaYpvo3S1EwK8QNmIvxIgaRc HvfQjwQsWY3eOrXxGJoNvV9pbFXqyaNLCu8Mxv1vDGSo7j1dlkM_Y_4JWVw2.TdWPAlIllKZGQYP Kpqt.b459hxOZWMw4nYtKk27cpbeR_MBlKHFTIHGWtwQwSRibOVNlDxlkvRGkt1nwuv.1xCFM.6J MMm7dGjrwDJUOYdg_q7sjyb5RHoTOCY0AE9Gje4MyHgDtaf.8kgu2m4GiIpWn3HlaSodfubvgdUm _X51gV.QZqRC6JwAdnc4Fa78qlZrlSm8eszT_IuA5L.FSTCMOyit.RBUpB_Rxkp0F.T6OAG04j5N 4TLsSsQbIr6NDFqgyKtm4oRzYhehNOsWvE0wAGc52j5j__w93cSKv6T.GA57HcegGn.M4OhAgupb jjK4VWPGjlZi364pEl6ki5IaGilDnhJIdkOpXS3Ed.e3WmUXijKoADUURWkkBvQ8hm7IjGrbT9Mi icxKLJNXjGcqbKKNMW9GnLGjg3NBjOYzC3OYOsut9FukIB5.UbjVX1ICSJfPfCjG2.BvauAOkC_Y krj9bPierSN8dCPuwtHMylw6J9efWhC3HoTR6tTrsuvVTZ7UYAmIukAzn7YTUUmucep92O5IS7Jh qy.Iboo.BXJQHhxUd4oo4B0ctN8kXEOv8puv61TLTuXAXF35Bg7zp51uBlYOuzsXVvj5h4zhc37O Ge3uEfYOb81haY27v2PfEdxtV4IZkAdZmadB6ctbIhS2G66yBX6DwZaMC.H_6TOFeYEOjSTKZl3_ c6N8efcwjE9A.hzNW6fQFpxwzSBpbc_jdTDQEhMrfKxdB_YIWXO5EXvIb5fwAdisSXVVGiv3S3Gp MzCD_W1vN1A_fUqDVlr6JjzDP7rpkvdAYDNb6.OE5hrGdCH97Us.xcGMO34WAopkUqlmzQFiFz71 IIcCFkAjMB3feSc6fJuAfwzUTIG7g3THIk.fyrOaJ0xDWB5PFJftLJg9Y5zfiwtW1jQnxfzlrH4s 7IciVU5kz_1CaF9WZqwXOroQPfCVyi8cv9fvVXq1G8p0aK8wbvuXiJp1Hy5LjqGuyOpGs4Du03FX pv0tnm5NZtDKnOwRjw7qH3hihKG6wApsjqlASakzsfpIbrUcP4b3mpPHZOq9RgrJAsMSh6jsc6ny KRz36cmwLCsI_4rOyXEh3y9546D4v8gUhpGyBgv6ZxdoUFCvdv1BMQn3_HmNDS1EnkT4Hq5c7ipC RGk6rJoHPnisOHinQFp.p9aTmHHcq3VQGW2JO0GUPLREtoymELyQSH6AMpDcQ.ZoMKCEMdU2n5DR ME6.4JbtN0XKOiAqj1MsNWh0NwuyWPuMs4rAUCiuxARjtvyep2Y2EixMZy3UKJDvShA6YD3Lu93T xB2m1gKEp7.qwmUQXLGVg3Cza_iruf4X5.Lpdab_b23we0gRM89c52f9hhNTZPN5T3EV3ZDNf9fx AwW3CFBhK4_1GM_CLp1BDXr7MEY8qwh_z__FKvRAtyT7ruGzdAV8f4MU.yeqcxKv4mCaoXRuchBV LWJDjpOhbWWSOSgN1Vr8hoDDTftzPyml7rPkxgH7VCqCPOzoR4hL.w4dLj66jsplNMTFM73oUL3T MNUNKHKP4yLnoW92TpSJIXS.mexAjlpEB5w-- X-Sonic-MF: X-Sonic-ID: ca2748e4-868a-4cf9-91ef-07df22041e90 Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Thu, 11 Dec 2025 02:09:11 +0000 Received: by hermes--production-gq1-54bf57fc64-8j6k2 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b0f73ce5814b2594bb4e55a0b33db908; Thu, 11 Dec 2025 02:09:07 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.700.81\)) Subject: Re: performance regressions in 15.0 [Single example of amd64 7950X3CD system's build-time ratio for 14.3-STABLE / 14.3-RELEASE (jails)] From: Mark Millard In-Reply-To: <577319E0-2051-436A-B9C0-6C1A2DE90618@yahoo.com> Date: Wed, 10 Dec 2025 18:08:56 -0800 Cc: Rozhuk Ivan Content-Transfer-Encoding: quoted-printable Message-Id: References: <18FB2858-5CBB-4B7A-8089-224A58C6A160@yahoo.com> <19A848A6-0042-4873-B70D-AD6805225B92@yahoo.com> <902C948B-0A4C-48E1-8C6C-1BC7A15209D7@yahoo.com> <33F5F7DE-8DFA-47E2-A890-E07564825D05@yahoo.com> <20251209172255.6d1a7f4c@rimwks.local> <927C3BBE-BA9E-45A4-A43E-6416CF388FF5@yahoo.com> <577319E0-2051-436A-B9C0-6C1A2DE90618@yahoo.com> To: Warner Losh , Konstantin Belousov , Mateusz Guzik , FreeBSD Current , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3826.700.81) X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.47 / 15.00]; SUSPICIOUS_RECIPS(1.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.972]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; TO_DN_ALL(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.146:from]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_CC(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEMAIL_TO(0.00)[bsdimp.com,freebsd.org,gmail.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; APPLE_MAILER_COMMON(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.146:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-Rspamd-Queue-Id: 4dRbcV1PRBz3qg5 On Dec 9, 2025, at 20:10, Mark Millard wrote: > On Dec 9, 2025, at 17:15, Mark Millard wrote: >=20 >> On Dec 9, 2025, at 12:32, Mark Millard wrote: >>=20 >>> On Dec 9, 2025, at 07:22, Rozhuk Ivan wrote: >>>=20 >>>> On Mon, 8 Dec 2025 09:23:52 -0800 >>>> Mark Millard wrote: >>>>=20 >>>>> But, as of yet, I've no good evidence for blaming >>>>> jemalloc as a major contributor to those timing >>>>> ratios --or for blaming any other specific part >>>>> of 15.0 . >>>>=20 >>>> If you want to bench jmalloc - there is another ways to do that = without building something. >>>> Try to find some sythetic benchmarks. >>>> Also jmalloc can be build without OS rebuild and linked with bench. >>>>=20 >>>> This 2 things can reduce time to tests, but it will eliminate OS = integation factors. >>>> Run same bench on different OS may give more info. >>>>=20 >>>=20 >>> [I've eliminated direct Email to most everyone >>> for this reply. There is not even minor new >>> technical content.] >>>=20 >>> At this point I'm more likely to explore if I >>> get similar ratios as ampere[13] do for some >>> port-package builds that have the large ratios on >>> ampere[13]. There are examples that are not as >>> overall time consuming for ampere[13] as what I've >>> already referenced (but are still non-trivial for >>> the time taken). As stands, I do not have a good >>> reproduce-the-issue context, much less one with >>> build time frames I'd be willing to deal with in >>> my environment. >>=20 >> Time-ratios similar to the ampere[13] ones for >> 15.0 vs. 14.3 (or 13.5) were easily repeatable >> on the Microsoft Windows Dev Kit 2023 for doing >> poudriere builds of the examples that I tried. >>=20 >> port-package builds tested for below: devel/cmake-core >> TMPFS_BLACKLIST empty >> ALLOW_MAKE_JOBS=3D in use (no explicit MAKE_JOBS_NUMBER like = restrictions) >> UFS context (except for what USE_TMPFS=3Dall does in poudriere) >> The below did not update /usr/ports/distfiles/ . >>=20 >> This does some exploration of USE_TMPFS=3Dno vs. >> USE_TMPFS=3Dall as well, starting with >> USE_TMPFS=3Dno . >>=20 >> Listed in the sequence executed, first time >> runs shown first: >>=20 >>=20 >> USE_TMPFS=3Dno . . . >> (Note: The first times had other port-packages to build first.) >>=20 >> 15.0 poudriere jail: >> [00:37:37] [01] [00:12:30] Finished devel/cmake-core | = cmake-core-3.31.9: Success >>=20 >> 14.3 poudriere jail: >> [00:28:26] [01] [00:09:38] Finished devel/cmake-core | = cmake-core-3.31.9: Success >>=20 >> Approx. 1.30 time ratio (15.0's 12:30 / 14.3's 9:38) >>=20 >>=20 >> USE_TMPFS=3Dall (no tmpfs black list) . . . >>=20 >> 14.3 poudriere jail: >> [00:09:32] [03] [00:09:24] Finished devel/cmake-core | = cmake-core-3.31.9: Success >>=20 >> 15.0 poudriere jail: >> [00:12:45] [03] [00:12:34] Finished devel/cmake-core | = cmake-core-3.31.9: Success >>=20 >> Approx. 1.34 time ratio (15.0's/14.3's) >>=20 >>=20 >> The following also prefixed the poudriere bulk -C command >> with: time -l >>=20 >> 15.0 poudriere jail: >> [00:12:36] [04] [00:12:25] Finished devel/cmake-core | = cmake-core-3.31.9: Success >> . . . >> 757.10 real 4613.06 user 251.09 sys >> 866580 maximum resident set size >> 131 average shared memory size >> 27 average unshared data size >> 234 average unshared stack size >> 31148816 page reclaims >> 0 page faults >> 0 swaps >> 14 block input operations >> 36 block output operations >> 37061 messages sent >> 33671 messages received >> 1758 signals received >> 143987 voluntary context switches >> 167515 involuntary context switches >>=20 >> 14.3 poudriere jail: >> [00:09:23] [01] [00:09:15] Finished devel/cmake-core | = cmake-core-3.31.9: Success >> . . . >> 564.48 real 3449.89 user 204.14 sys >> 822900 maximum resident set size >> 64692 average shared memory size >> 791 average unshared data size >> 235 average unshared stack size >> 28153497 page reclaims >> 0 page faults >> 0 swaps >> 9 block input operations >> 12 block output operations >> 34180 messages sent >> 31539 messages received >> 1758 signals received >> 131899 voluntary context switches >> 132775 involuntary context switches >>=20 >> Approx. 1.34 time ratio (15.0's/14.3's) >>=20 >>=20 >> USE_TMPFS=3Dno . . . (again) >>=20 >> 15.0 poudriere jail: >> [00:13:01] [04] [00:12:27] Finished devel/cmake-core | = cmake-core-3.31.9: Success >> . . . >> 784.89 real 4596.42 user 257.12 sys >> 866600 maximum resident set size >> 128 average shared memory size >> 25 average unshared data size >> 234 average unshared stack size >> 31194466 page reclaims >> 2371 page faults >> 0 swaps >> 3573 block input operations >> 6687 block output operations >> 37643 messages sent >> 33840 messages received >> 1756 signals received >> 241548 voluntary context switches >> 304249 involuntary context switches >>=20 >> 14.3 poudriere jail: >> [00:09:49] [04] [00:09:18] Finished devel/cmake-core | = cmake-core-3.31.9: Success >> . . . >> 592.83 real 3446.18 user 207.61 sys >> 823880 maximum resident set size >> 64712 average shared memory size >> 787 average unshared data size >> 236 average unshared stack size >> 28176650 page reclaims >> 2374 page faults >> 0 swaps >> 3481 block input operations >> 5148 block output operations >> 34521 messages sent >> 31580 messages received >> 1758 signals received >> 218881 voluntary context switches >> 255193 involuntary context switches >>=20 >> Approx. 1.34 time ratio (15.0's/14.3's) >>=20 >>=20 >> Only some port-packages have time-ratios >> near 1.34. For example, building lang/gcc15 >> does not on ampere[13]: closer to 1.1 as >> I remember. (For the most part, lang/gcc15 >> does most of its own building based on a >> smaller amount of clang-built code >> to bootstrap.) >>=20 >>=20 >> For reference: >>=20 >> # poudriere jail -l >> JAILNAME VERSION OSVERSION ARCH METHOD = TIMESTAMP PATH >> release14-aarch64 14.3-RELEASE-p6 1403000 arm64.aarch64 ftp-archive = 2025-12-09 12:54:06 /usr/local/poudriere/jails/release14-aarch64 >> . . . >> release-aarch64 15.0-RELEASE 1500068 aarch64 pkgbase = 2025-12-06 11:34:39 /usr/local/poudriere/jails/release-aarch64 >> . . . >>=20 >> # ~/fbsd-based-on-what-commit.sh -C /usr/ports >> bb7b77417165 (HEAD -> main, freebsd/main, freebsd/HEAD) www/hurl: = update 7.0.0 -> 7.1.0 >> Author: Rodrigo Osorio >> Commit: Rodrigo Osorio >> CommitDate: 2025-11-28 23:11:52 +0000 >> branch: main >> merge-base: bb7b774171651eea0dc56376c225fe976231daa5 >> merge-base: CommitDate: 2025-11-28 23:11:52 +0000 >> n726888 (--first-parent --count for merge-base) >>=20 >> # uname -apKU >> FreeBSD aarch64-main-pbase 16.0-CURRENT FreeBSD 16.0-CURRENT = main-n281922-4872b48b175c GENERIC-NODEBUG arm64 aarch64 1600004 1600004 >>=20 >> (That last was an official pkgbase distribution.) >=20 > 14.3-STABLE does not have jemalloc 5.3.0 or libsys > but performs like 15.0-RELEASE, not 14.3-RELEASE > for the aarch64 devel/cmake-core build tests. > But 14.3-STABLE does have: >=20 > # ldd /usr/local/poudriere/jails/official14-aarch64/usr/bin/cc > /usr/local/poudriere/jails/official14-aarch64/usr/bin/cc: > libprivateclang.so.19 =3D> /usr/lib/libprivateclang.so.19 = (0x732e0d600000) > libprivatellvm.so.19 =3D> /usr/lib/libprivatellvm.so.19 = (0x732e12600000) > . . . >=20 > while 14.3-RELEASE does not. >=20 > (Another data point is that lang/gcc15 does not have > nearly as large of a time-ratio vs. 14.3-RELEASE > in the data from ampere[13] .) >=20 >=20 >=20 > Details from the Microsoft Dev Kit 2023 experiments > . . . >=20 > I've collected a sequence for a new poudriere jail > to compare/contrast with: >=20 > # poudriere jail -l > JAILNAME VERSION OSVERSION ARCH METHOD = TIMESTAMP PATH > . . . > official14-aarch64 14.3-STABLE 1403506 arm64.aarch64 freebsdci = 2025-12-09 18:24:20 /usr/local/poudriere/jails/official14-aarch64 > . . . >=20 > (ampere[13] do not have examples of recent 14.3-STABLE builds at this = point.) >=20 >=20 > USE_TMPFS=3Dno . . . > (Note: The first times had other port-packages to build first. > But the system still has the cached the file system data.) >=20 > stable/14 poudriere jail: > [00:36:29] [01] [00:12:31] Finished devel/cmake-core | = cmake-core-3.31.9: Success >=20 > So: 12:31 is far more like 15.0-RELEASE >=20 >=20 > USE_TMPFS=3Dall . . . >=20 > stable/14 poudriere jail: > [00:12:21] [07] [00:12:10] Finished devel/cmake-core | = cmake-core-3.31.9: Success > . . . > 742.70 real 4586.53 user 248.37 sys > 864996 maximum resident set size > 133 average shared memory size > 24 average unshared data size > 235 average unshared stack size > 30958626 page reclaims > 0 page faults > 0 swaps > 456 block input operations > 80 block output operations > 35920 messages sent > 33223 messages received > 1760 signals received > 140580 voluntary context switches > 164112 involuntary context switches >=20 > So: 12:10 is far more like 15.0-RELEASE >=20 >=20 > stable/14 poudriere jail (again): > [00:12:30] [08] [00:12:19] Finished devel/cmake-core | = cmake-core-3.31.9: Success > . . . > 751.98 real 4604.85 user 251.40 sys > 866056 maximum resident set size > 125 average shared memory size > 21 average unshared data size > 235 average unshared stack size > 30976603 page reclaims > 0 page faults > 0 swaps > 20 block input operations > 11 block output operations > 36297 messages sent > 33327 messages received > 1761 signals received > 144213 voluntary context switches > 166975 involuntary context switches >=20 > So: 12:19 is far more like 15.0-RELEASE >=20 >=20 > USE_TMPFS=3Dno . . . > (Note: The first times had other port-packages to build first.) >=20 > stable/14 poudriere jail: > [00:13:16] [05] [00:12:49] Finished devel/cmake-core | = cmake-core-3.31.9: Success > . . . > 799.95 real 4626.06 user 261.49 sys > 865940 maximum resident set size > 134 average shared memory size > 24 average unshared data size > 235 average unshared stack size > 31110419 page reclaims > 2380 page faults > 0 swaps > 3577 block input operations > 6262 block output operations > 37253 messages sent > 33801 messages received > 1758 signals received > 236161 voluntary context switches > 312615 involuntary context switches >=20 >=20 > So: 12:49 is far more like 15.0-RELEASE >=20 >=20 > (Nice to have a known repeatable context to try > variations with.) >=20 On the 7950X3D system that I have access to, I created: # poudriere jail -l JAILNAME VERSION OSVERSION ARCH METHOD = TIMESTAMP PATH release14-amd64 14.3-RELEASE-p6 1403000 amd64 ftp-archive = 2025-12-10 12:55:10 /usr/local/poudriere/jails/release14-amd64 official14-amd64 14.3-STABLE 1403506 amd64 freebsdci = 2025-12-10 12:55:17 /usr/local/poudriere/jails/official14-amd64 . . . I then did builds of qt6-webengine-6.9.3 for each (all 32 FreeBSD CPUs allowed, with 32 builders allowed when building prerequisites): amd64 7950XCD 14.3-RELEASE poudriere jail: [01:35:37] [01] [00:32:14] Finished www/qt6-webengine | = qt6-webengine-6.9.3: Success amd64 7950XCD 14.3-STABLE poudriere jail: [01:56:15] [01] [00:40:46] Finished www/qt6-webengine | = qt6-webengine-6.9.3: Success 40:46 / 32:14 approx.=3D 1.26 as a suggestive figure for the specific test context, an actual example. But I've no way to test across the variety of FreeBSD official builder systems and do not see a point in exploring the variability just for my specific type of amd64 context. 1.26 is smaller than on the ampere*'s or the Microsoft Dev Kit 2023 context (aarch64) got but is still notable for its size. It suggests that the issue is not aarch64 specific overall. I'll note that I've only explored the one type of example performance regression: port-package build time ratios that are notable. There could be other regressions that are unrelated or are minor for the examples that I've looked at but are important for other contexts. It looks to me like the tradeoff between builder-time and memory use by clang/clang++/related needs an explicit choice about the handling going forwards. If only the ampere*'s port-package building was being considered, it looks like "take less time" would seem the likely judgment: there are lots of time problems already for the 3 aarch64 builder machines. =3D=3D=3D Mark Millard marklmi at yahoo.com