From nobody Sat Apr 29 21:09:17 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q82Cy1RtKz48GHc for ; Sat, 29 Apr 2023 21:09:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q82Cw3QbPz3n81 for ; Sat, 29 Apr 2023 21:09:32 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=PCLmk6CF; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1682802570; bh=8YcqB/ws+4OyS94d2bsWpKaKQSMb40BWDad0bUhTw44=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=PCLmk6CFbDhKGFirdAJxz1mEJoaDBIb+5/T09kPj2fqrkAtq5GQMxinLrOyCCiH4KCdRbZegvAqA/9+li/wdeZ7lUd9K7DIaBzXRlIXf0RhdGtqKqdeXKhiSjz2XJuPPKMXxQUYFmquo3vWAKJpjnszUgWehOGCUg9nhVroAWg7AqB7GViCS/mpFF1wVVMrdsVffn6WPMCH2xuGEbEqJy0zNsoYzxB1u6J6jgBEi/TH8Lx8jDY2E4SH7t0m5ZNvrquyoB7XLV5aHq9NJ18e1+14B6FPiUMiTn7nhxXm5aKHYk+eP8x2T9K7g38Zw1vADevWxdAalVS3aurltpZsDWw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1682802570; bh=d7WS8dUBZeYB8BCHUqLCFfojSms0EaeIA/VXv4CUSpm=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=UxvdF07mxHFrjvXA9bsvARY2OyTy/7QXpDNPR/nMTRT4ltVFNoSU5BsE0mJwlFdMNYrhvgWic+CGU75VhF7tlMAuk3D2MPVEiumY+EtrKpJ6KaKFEkeTSaU5aoqwuc7fxI4MCwNo8prd1IZ6wZh395Jr+yxXhCuKYEX6NHk4KtUaYZE0cqk3N4Qi8ktFVRr+yxrGVl5Vt64Bjpo5Rn5vfNTXYDc5gBl9Qur03uykpLE86QXcTlXIbDSRz7+gb26KZ1giVQkxQnZ4TV9cN9+vMPwjjXs7/lQGuVOmCO5x2DDDYCeoEmYJBwGl/C8QYvAXjE1OtmijJtpVwPsckLnyFQ== X-YMail-OSG: vMyEWc8VM1likePTgbc6e9nv8fTHT.UXSE0J9dHqC_Rkxmm2FihNrBvogvdgbDH aYCUb8h74wXcO1A.ARNxbCzUwivUpY87s71dP.HkGzZOCwEbsfnF6H_Jd1byO1I6nE4aOBHKQVHD 48kUl6MFnsPyjyoCbDjpqopRbCHsHABaBix5gK5VJcX9ycvc.KintqHAuVKNryxA6VKWJYcBcmd7 4ptQgH97cbCH6jWCborrdfGdB_5E5JN97ZI3WXqdEHRmLCUUtlchJD4Cyu8NNsOaIhxXDRpGHkjL Y.0HrknkkdSSuWMjl3ob.GzRGL9LgPHiN9_xdZftbuceVFFJSkIgolpMayjt9Dzxj_po8zMnu03L 1ytwp2qr6ifule7qJLI9XOuO.yFLdfBWHyGRagA34O_quf8KZx.U.6gLL2fUqg70gGMUDmqcscbI aa1hD_QspEnsO9EOuDXQiKtMjjxyQyJT9_9nEoq0cztQHNyPq5J6ELy8GunUr2o4m.1N3Vh8zig1 1Hv2vJGWW1K4UlBveetvDqcX66KMVIYGcLn6JH_js3VDbvvuQURSTRxFoNxrgfkfmMx1cYJkCHPw X4lmvPYm827rfKsKGQRHTVHPFCzFMI7I3Wigq.VVeJ.aYYY0xBfdUu_ponMQdRZscojFrWecimCQ sAJ5neOWO1F1bKEuSG.XeZZ.nbziwA._zQ_5q1v4ylvUxIuOQibeJV1V5HzGCtc3we2pfAjdLqQM qUgh3yg.r6kw_be2kxnrmFBDgHRx8IYYRa5rl7N78w9TPKB0rCbKGQr_t9ODoCFXIY5nvjFQRUsp eYsExvCT5Y8D6TxWZWf4T1EfxTemHvX8lNJC_n4skad1GU1W33pKhqGXUmsVk0WNedFw4kQrMDTj L25NwC3WqETYj8fj1AjtOlrWevn9F07Tdk_sKMYfFhHK9kBC4SydrGfp4lAJIghJCRlAU.XIoQsO xNnUctwOFjKkDMtqhfFyf6UF.w4jTpPliPmoWvMib5SqGU._k9FBtmv06q9YZ5000Wm.8iS6Mtu2 PYPt3w4fT4Uyxv258pj5REh0XTr02wjN3C3_FiRardeaUpomKUPVZGwaS9Bwc8qnbub2tkb.DleX izR8m52KtOQa1S.eTWtWCTnpWu1CrORAh6_ED4Qwr2DJ2MWj_.e8j2BmpxN.4Z5N3LuCns7MsqDR TywC2JRQxXSvrqa7q5BCNbhuzQJsQvCoLhV41JQauaeNfnh8LVkp2F2Fm1Avh8KzrOvpbWM8KUhH OYmKZf56eEQL_SclIyGE0ERexpp16vp06kZcUuxpzGV5N.pvSyJGA3Q37YyzErnCHMyr7rsiV4gT D.2mUYS0J9_aBSItHl5.8OqH_an1hvWK3.bzWdeFjh_aNXgXVVzNigEWHG5VkSN2jNBo4HTUNqDO aZor7RvKwqJWXQSWBfChlQ65Pd5e7N.U.nA7qlbjJhd_ZzR084sAT_5XlPYYkANlDaXBf62Jmxyp UHD9nWaR7KsbxnHoVPLjCUl4azUh6qWx46snJjHUMjO71Jw7N5.BwV4tkorbQalxtTQ7Ai81ukmd LegF4CNKhvQ5i6CsjdEVxdyKbKBRZ_RCU31PpBdGj6frSynS7QT053ChvJpO5.URhCHJJgKQT6Mm 1fWstW77DzX5bAPXUkng7TF37.AR6DpXWovUieI0ix22WSZZ_wSIUD644L4sExD097EtrZeXC6dd I8USyuZe.2b3WAG9yAPG5mpxINdRv_nYIBld9bLjXq8jPGb6wIiVQcfn6ZauCImu0SNok1ZDoZB3 hs6IDj174XSMD_sBPrLhYzXG_UaF.IkS.s76DMWrx2zpNO5eMizS4UoL_MSxDOK3K0x3m5pQfF9a VEXwqxld2QZ5BBlxn4qtunbDKB.JzIvAr5RV_E5NBAsl7fOC2lDk9tODQFOYJhQQ8MDukKSm6XRt IAPDKX_d.qxOO17vqPjOmh5oSb5ts1RRxdAhzoUzr9_6GjhOrBAecmd42Q5l8zAvD.4s.r2C6VtO NpITJORNdLbeKoEFDf9TE86Ar6.yXn77GX_z.xGtNKNv43svQy02_CSpNg8dHkwhN3cX0FQaapCQ iTdnWWA5qj53W9WdYRiwm4nn609o0TqqbTR4MSNiZN5NN_tvjQCQ14EpEUuIgI4EQY7el4nPANX7 xPy9eaDYsOkSmzCP478CCWbDmtYxSQeSEzG9FrfjDDL5jEpLGJaXHJj0QGvl0ZZrLyS9T6Z8MN8L kxQgfOrBpqcfcgNNHMHXqz4sI2O.WDWebaG9ESc1GiCF4EqKgoqTV6Gj_8aimkyEndR7MbGoxBg5 lcgo- X-Sonic-MF: X-Sonic-ID: f0e58359-f89c-44f2-96c6-3247303c2dc6 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Sat, 29 Apr 2023 21:09:30 +0000 Received: by hermes--production-ne1-7dbd98dd99-qthmr (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f994fac8294747fd934df0c16472a593; Sat, 29 Apr 2023 21:09:29 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: armv8.2-A+ tuned FreeBSD kernels and buildworld buildkernel times: an example From: Mark Millard In-Reply-To: <177A2369-1751-4DB5-B316-E140ED156B6E@yahoo.com> Date: Sat, 29 Apr 2023 14:09:17 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <4E8BB159-38D1-4EF0-B486-DF6C8B49D7AB@yahoo.com> References: <177A2369-1751-4DB5-B316-E140ED156B6E@yahoo.com> To: FreeBSD Hackers X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spamd-Result: default: False [-2.39 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_SPAM_SHORT(0.11)[0.114]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.147:from]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org] X-Rspamd-Queue-Id: 4Q82Cw3QbPz3n81 X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N On Apr 29, 2023, at 12:16, Mark Millard wrote: > Context: all world's and kernel's involved/built are non-debug style. >=20 > Note: clang15 through LLVM main (so far) has errors in both directions > for the features for cortex-a78c. So I also used +flagm+nofp16fml . > (The cortex-x1c also has such problems, but the details are > different.) >=20 > Notation in table below: > CA72: matching world or kernel had been built using -mcpu=3Dcortex-a72 > CA78C: matching world or kernel had been built using = -mcpu=3Dcortex-a78C+flagm+nofp16fml >=20 > System: Windows Dev Kit 2023 (4 cortex-a78c's and 4 cortex-x1c's): > (both: armv8.2-A with a few more modern features) >=20 > Times to build system from scratch (buildworld buildkernel from same > sources) . . . >=20 > System running: World built in: kernel built in: > CA72 kernel, CA72 world 6601 sec 597 sec > CA78C kernel, CA78C world 4680 sec 413 sec > CA78C kernel, CA72 world (chroot) 4715 sec 422 sec >=20 > The CA72/CA72 is from before I'd built the CA78C world and kernel. > All builds used -j8 . None had competing activity on the machine. >=20 > What this suggests is having an explicitly armv8.2+ tuned kernel > makes a notable difference for -j8 buildworld buildkernel times > on aarch64. "Tuned" here includes newer-feature use, so incompatible with the likes of armv8.0-A hardware, for example. The FEAT_LSE atomics use would be an example. But I've done nothing to investigate subsetting the new-feature use to isolate what makes the biggest contributions to the elapsed-time decrease. > The Windows Dev Kit 2023 is the first (and only) armv8.1+ based > system that I've have access to. So testing such properties is > limited to the one context. >=20 > Also, I've not had access to the Windows Dev Kit 2023 for long: > first experiments. >=20 >=20 > Notes on my historically-usual aarch64 builds: >=20 > On cortex-a72 hardware, my context is -mcpu=3Dcortex-a72 based. This > once exposed a lack of sufficient synchronization in a palce in > the USB subsystem. (Running the same system on cortex-a53 hardware > did not fail. Running -mcpu=3Dcortex-a53 based world+kernel on a > cortex-a72 did not fail. A cortex-a53 hardware running the > -mcpu=3Dcortex-a53 based world+kernel did not fail.) >=20 > Until the hardware failed, there was a time when I also had > access to a cortex-a57 FreeBSD system. >=20 > I do not do such -mcpu=3D tailoring on the only FreeBSD amd64 that > I've access to, a ThreadRipper 1950X. I do such only for the lower > end systems that I have access to. My aarch64 access is all to > lower end, not upper end. I should have reported that my recent activity for this is based on: main-n262658-b347c2284603-dirty, b347c2284603 being from late Apr 28, 2023 UTC. (The "-dirty" is from some historical patches that I use.) Some of my activity has been from somewhat earlier but I wanted to pick up another openzfs fix nor 2 that had happened since then.) =3D=3D=3D Mark Millard marklmi at yahoo.com