From nobody Sat Dec 06 19:19:47 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4dNykK3xZrz6J01c for ; Sat, 06 Dec 2025 19:20:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-25.consmr.mail.gq1.yahoo.com (sonic304-25.consmr.mail.gq1.yahoo.com [98.137.68.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4dNykJ74pBz3dWB for ; Sat, 06 Dec 2025 19:20:08 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=UueDCxrW; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1765048801; bh=fCCsTvC3oQK/10luGXx7CGXhyFsIhcFS0F04cysnawY=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=UueDCxrW2nQTS6QPNG4Ii/5j+byWCQ9Ra4ohFLxQ1/MmZxa4O+Vr9D3Aak3jcL12GgoSYGORhTgcDLrfZ+Ru9nz+rM7wavcDt0Tm7Ve1+q8g7VjESZkJpAYWIrW6ukItm1+gomuErYuJWcuSunGpB5Dm+yAJC6mY2cSpxICP+96qtS0vi/eFDN4CehlDNT2PvGmwAcBS2pYS7HdSxKRfcWGYdN1kLqwwJUruIIdO8ECvuRd13VWb+OIoYnswhajiWUYotvldH6CsQUInbEvKOIUome6oTlc4QJ9NJV7CxYPNsoRXaUmmI+u1u3RmxDBE9MOAKLtiP05QNh9Su0H2rA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1765048801; bh=e3ae2PCyYlfvl82zpb9TqyhgMGMiKQ0nIRo+ahZw2HP=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=KUQIoFTjJD163Hm8glkBrkxh3JP5EsLP2uD/MRHxMp/bqQWKaoYp0xJAVIEnACwN7cutWB4jZPMwXH+iDqw0A0RP/nqfpH9+EAIBGsYJOyuDEw0pZ7q0qoZeOYsjbNAyoB7rgPYwdEeMcWeKuIG6Wl0vACvWOrZurM9tiskZ9ODBBGQNMucg4DKiaLyDSmRfVQBYTMuZ3nuEJrXFqTULeoWv9DzvlHCSQveW5ieoyfRKTLYlqym9s60WhMnL8QAD99zv8WKA3NOIklQYJ1ASO0oirhEAPMezWQR4DtrIjkISQsnxFFmU8nZvlFXQ9i4N/YYQV7jXqnHc7LSRrFNEgQ== X-YMail-OSG: .gtshYAVM1m4Y9DzqW2IAyMSQKVNZqDlodniQ7adW.DhPJT_KQ..u7N9mLLsS1n sYNyFsE.QvyFn8V9ND.zFxBSy1lSk.0c99L_Mv9HkRUgrnaMgsxNaZvgVeqJbEeG_rqREvcbP4cF 1AzBq9f4jcEEo.0iALEskobPYt8Nlufj2zhdQdOY.daTq5BPPt.b9Fdz5uxp3LgN1q4.lkP9e7S2 xU82nMdmVC2f8TjttlBCqDtC7hqkjh39x3rfJDuprpZmOr2RzSHV0XfGokHQDW7dolj0X3nOoF9C U7jNIWvlttCdvCXNHNfdHl4glZvu1INXc1TMXRetG2OakfF6Bn8_HjPecCFszssAJQfMn97lZnfP DqplSXvP7TP3kPROjjtwokmRXu.IFwP3rEnValV_KGJSDOMLIPZk4Qw855mhHvpiDXIHEm0b8YBn b9Wxi0TtA0_V_vCwcG5_BkrmvYu.nk1dM_xoQE09OXFAyny73xnHeaqYP19R7zIjQttR0jdaCWwL v2DyS2EEDP6JEcG3nx82v6x6uS1QgSLjyLS8TBKT78.YAQ5trPvpqhxOZFWo41YiTgFV603oKvF1 iIBaLtVE_f7AZm44ftse8IY3JhE1rdgdruceL0nF2dUXayctfocM7SqVvbqqlfNd8ItMVxAeZyRq euexFIzJzpIAxX9cjEYi1RBb.Ir_XPAITnmzGW7DaxVIeG1G8WLP_G91G0_sJZWa4joJ2wV0z5nZ 1_LsVZ5Crdhkhx7oz7N_uQnXA1SJ2pBFI39elUiIxTII5lU.CQIoXTSeC.tvF_DvZNfP0_S10mSI 5ZG4QDSUqgm_2K_bVgXweHQumVrJVDMWuzoYZNLBQZc7Aoj_5FFA.SBbczpudI1HxS6CIBG3bYml _0szVIpiEEAz3J1voStERxomOOND4ztvbA5g3kdSX9v00RCL05nZhV.J7mrU7Axv4fH6CUpt9OXi 5cLY9KS4DxP5GT5wLBiw1WaeIQIooTmegmYG57FNeS8KmqZP8.K9Z9BE9m3wJnoFeYq7e_09qhF. yOXfeQCn90Cc4Fb50lbF9xskMkv7WrnEF4pW0VCeTGciKAMNUaizS0t41XzTX7z.077k1lNTbZM4 rF4kYQ0RW1sKSGbqKNa_pNtT_SkIh993gVD6sKf1G7x.sMoSPyDQr2YQgxMZ7sdVDbxSPYgvmG0v t1BV.fph2jHOnhC7nu6ZExNEgry4Ays4BOuZQ6gG6Bth.QspO38wih.KMveuqVvz621P8ulspnQC lqCTHabubQGYYR1Yu1cvZXwzJH7hFfjswT9SQrCouLGT5wN1iBeCtZ1t5pNJgfMq.IXEPUfSawO7 o8yELhn0k7VFjU5ER6o1VlIJArhfl6ZbDAs_jVPmzEvB0lF188IxtxhdWo9iRHDQsHwscl8wndWE r6G_9iFGgHlBwKlHTqwxtMxnA0N2SRCFZhZo4PK2SO5XkWXtYu_GEUk6Yi9sFBXvcF0gOFrrDnHU ZifTOp44eP0AJ0NjuTt_UQS3m96J5Ci.GJAmCkISsdct_nWCDJZ_7dUXeUTREObVzPaI47tXEdn3 .ZhPnh56qHz6pKNbfeId3PpLgm_LjNabIfrgNasanT.kso0WNTHNjvkFCjoxBeSTsePiHXndB5_C 7EE1UhvnBRvcuGJhOCgdORbcw3TaSHcdTsKLMI1Tq18HlRH23rvsib1VGTgoOTLPbQdewMylH87m jc9hopJZN2p4qShwpumJmhl8eV0az5ELxV4stLO1kSwPGbFR_GcsfPOOgMktb9PafIYhJTR7BHPk I3eQNCtRbb97YUacPhvGxsJyevkA29wSh8nhIyJJjpkpLN8ROmEmmQhVOU.UuMVyB66LW9s0jv3q eKM2RWoVZlGomXK0PdsHALlJhtsN0JINoiaiXQWnVgCihfVaGXjSTirKpCggdTFi5l5P2uSmMtEk CT2TKyfuuV6SwJNflDzYAssxeLP83dJuYIiOCTC91SFB_b_2uRAZlro7kbGA1SxtRSstAoZ0kxu7 GzBvvD55Hf.SOMWek4jw9mhjs0XP8nPdRs8gB1IpnfBXA.1QuUrkX9Sfc5TtGcHvB7tY07fHz5a1 AJqenV4cKqy5QeEszvbhTPTtnXZn3GhDJZfGHyBUH6AG3GMyJgCrvr2eWOGLRiwtic7ao1h6b9.X XGbTd50Nv_pXAjoAkAF1p4_cqTB3AabCo6RELweHMb2xS56i3wabplfsEl7v2W1bjmpJMU6svA4S 2fMt6DRk0sFs4AhtzsyDJqyBuUcz5Qx1p.piGAYQa7yXgtRwG4.xa6hxZs0wjg.j05h25WykXHrA 5NFhi X-Sonic-MF: X-Sonic-ID: 3c724c4f-2350-4318-a487-1b6003b4dfbc Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sat, 6 Dec 2025 19:20:01 +0000 Received: by hermes--production-gq1-54bf57fc64-8b88z (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 7b3ccd29d9743455f861e15529738722; Sat, 06 Dec 2025 19:19:58 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.700.81\)) Subject: Re: performance regressions in 15.0 Message-Id: Date: Sat, 6 Dec 2025 11:19:47 -0800 To: Konstantin Belousov , FreeBSD Current X-Mailer: Apple Mail (2.3826.700.81) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.979]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_FROM(0.00)[yahoo.com]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.206:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.206:from] X-Rspamd-Queue-Id: 4dNykJ74pBz3dWB Konstantin Belousov wrote on Date: Sat, 06 Dec 2025 17:42:57 UTC : > On Sat, Dec 06, 2025 at 06:34:01PM +0100, Mateusz Guzik wrote: > > On Sat, Dec 6, 2025 at 6:31=E2=80=AFPM Mateusz Guzik = wrote: > > > > > > On Sat, Dec 6, 2025 at 6:25=E2=80=AFPM Konstantin Belousov = wrote: > > > > > > > > On Sat, Dec 06, 2025 at 11:50:08AM +0100, Mateusz Guzik wrote: > > > > > II. compilation speed > > > > > > > > > > The the real and serious problem. Both versions of the system = ship the > > > > > same clang version: > > > > > FreeBSD clang version 19.1.7 = (https://github.com/llvm/llvm-project.git > > > > > llvmorg-19.1.7-0-gcd708029e0b2) > > > > > Target: x86_64-unknown-freebsd14.3 > > > > > Thread model: posix > > > > > InstalledDir: /usr/bin > > > > > > > > > > FreeBSD clang version 19.1.7 = (https://github.com/llvm/llvm-project.git > > > > > llvmorg-19.1.7-0-gcd708029e0b2) > > > > > Target: x86_64-unknown-freebsd15.0 > > > > > Thread model: posix > > > > > InstalledDir: /usr/bin > > > > > > > > > > I found that compiling the will-it-scale suite about doubles = in real > > > > > time needed, along with doubling time spent in userspace. > > > > > > > > > > will-it-scale needs a little bit of massaging to work, diff at = the end. > > > > > > > > > > check this out (repeabale): while true; do gmake -s clean && = time > > > > > gmake -s -j 8; done > > > > > > > > > > 14.3: > > > > > gmake -s -j 8 8.93s user 2.03s system 769% cpu 1.42s (1.424) = total > > > > > gmake -s -j 8 9.02s user 2.16s system 757% cpu 1.48s (1.475) = total > > > > > gmake -s -j 8 9.29s user 1.95s system 774% cpu 1.45s (1.450) = total > > > > > gmake -s -j 8 8.97s user 2.46s system 770% cpu 1.48s (1.484) = total > > > > > gmake -s -j 8 9.13s user 2.30s system 773% cpu 1.48s (1.477) = total > > > > 14.3 clang/lld are probably statically linked, but I am not = sure. > > > > Can you confirm this? > > > > > > > > > > They are dynamic, this was switched years ago. > > > > > > /usr/bin/clang: ELF 64-bit LSB executable, x86-64, version 1 > > > (FreeBSD), dynamically linked, interpreter /libexec/ld-elf.so.1, = for > > > FreeBSD 14.3, FreeBSD-style, stripped > > > > >=20 > > ... but I do see a change in used .sos: > >=20 > > /usr/bin/cc: > > libz.so.6 =3D> /lib/libz.so.6 (0x3d76fc831000) > > libprivatezstd.so.5 =3D> /usr/lib/libprivatezstd.so.5 = (0x3d76fcc0e000) > > libexecinfo.so.1 =3D> /usr/lib/libexecinfo.so.1 (0x3d76fe213000) > > libncursesw.so.9 =3D> /lib/libncursesw.so.9 (0x3d76fd1ef000) > > libthr.so.3 =3D> /lib/libthr.so.3 (0x3d76ff8e5000) > > libc++.so.1 =3D> /lib/libc++.so.1 (0x3d76ff002000) > > libcxxrt.so.1 =3D> /lib/libcxxrt.so.1 (0x3d770073c000) > > libm.so.5 =3D> /lib/libm.so.5 (0x3d7701d4c000) > > libc.so.7 =3D> /lib/libc.so.7 (0x3d770161d000) > > libelf.so.2 =3D> /lib/libelf.so.2 (0x3d7701e58000) > > libgcc_s.so.1 =3D> /lib/libgcc_s.so.1 (0x3d770314a000) > > libtinfow.so.9 =3D> /lib/libtinfow.so.9 (0x3d7702808000) > > [vdso] (0x3d76fc3cc000) > >=20 > > vs > >=20 > > /usr/bin/cc: > > libprivateclang.so.19 =3D> /usr/lib/libprivateclang.so.19 = (0x311e43c00000) > > libprivatellvm.so.19 =3D> /usr/lib/libprivatellvm.so.19 = (0x311e48000000) > > libz.so.6 =3D> /lib/libz.so.6 (0x311e4d1a9000) > > libprivatezstd.so.5 =3D> /usr/lib/libprivatezstd.so.5 = (0x311e430cf000) > > libexecinfo.so.1 =3D> /usr/lib/libexecinfo.so.1 (0x311e4e075000) > > libncursesw.so.9 =3D> /lib/libncursesw.so.9 (0x311e4e7b3000) > > libthr.so.3 =3D> /lib/libthr.so.3 (0x311e4f717000) > > libc++.so.1 =3D> /lib/libc++.so.1 (0x311e502e0000) > > libcxxrt.so.1 =3D> /lib/libcxxrt.so.1 (0x311e5107d000) > > libm.so.5 =3D> /lib/libm.so.5 (0x311e52294000) > > libc.so.7 =3D> /lib/libc.so.7 (0x311e532a7000) > > libgcc_s.so.1 =3D> /lib/libgcc_s.so.1 (0x311e5414b000) > > libelf.so.2 =3D> /lib/libelf.so.2 (0x311e514d0000) > > libtinfow.so.9 =3D> /lib/libtinfow.so.9 (0x311e54751000) > > libsys.so.7 =3D> /lib/libsys.so.7 (0x311e563ff000) > > [vdso] (0x311e419d5000) > >=20 > > as in the 14 binary does not link to libprivateclang nor = libprivatellm > Well, yes, I mean, the internal llvm libc were linked statically in > 14.3. This is where the count of relocations I posted comes from. FYI: JAILNAME VERSION OSVERSION ARCH METHOD = TIMESTAMP PATH official14-i386 14.3-STABLE 1403506 i386 freebsdci = 2025-11-28 15:52:21 /usr/local/poudriere/jails/official14-i386 ldd /usr/local/poudriere/jails/official14-i386/usr/bin/cc | grep so.19 libprivateclang.so.19 =3D> not found (0) libprivatellvm.so.19 =3D> not found (0) So the change was MFC'd to stable/14 . > >=20 > >=20 > >=20 > > > > > > > > > > 15.0: > > > > > gmake -s -j 8 19.90s user 3.02s system 773% cpu 2.96s (2.963) = total > > > > > gmake -s -j 8 19.90s user 3.18s system 774% cpu 2.98s (2.979) = total > > > > > gmake -s -j 8 20.24s user 2.90s system 770% cpu 3.00s (3.005) = total > > > > > gmake -s -j 8 19.92s user 3.25s system 771% cpu 3.00s (3.003) = total > > > > > gmake -s -j 8 20.25s user 2.95s system 772% cpu 3.01s (3.006) = total > > > > But 15.0 is definitely dynamically linked. > > > > > > > > clang is enormous C++ binary with enormous amount of relocs: > > > > $ ldd /usr/bin/cc > > > > /usr/bin/cc: > > > > libprivateclang.so.19 =3D> /usr/lib/libprivateclang.so.19 = (0x27417e200000) > > > > libprivatellvm.so.19 =3D> /usr/lib/libprivatellvm.so.19 = (0x274183e00000) > > > > > > > > $ objdump -R /usr/lib/libprivateclang.so.19 | wc -l > > > > 232977 > > > > $ objdump -R /usr/lib/libprivatellvm.so.19 | wc -l > > > > 140712 > > > > > > > > > > > > > > > > > > user time *skyrocketed* > > > > =3D=3D=3D Mark Millard marklmi at yahoo.com