From nobody Tue Feb 21 20:59:19 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PLs9N6Nc5z3tD9S for ; Tue, 21 Feb 2023 20:59:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4PLs9M1wyBz49Tv for ; Tue, 21 Feb 2023 20:59:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Gl3TFa3G; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1677013173; bh=hUpAqy6TpTEgt4uLCbkqF+GTX7ykSLmxX0qm7Ta8Jkg=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Gl3TFa3GAQYrlEfvIy3xpc9Y/D7n7S0y7VQlM36B7hQ1Aft5a+1nRCdQ0HkBIbRSsvWFysKALHY8Cx+9ut9dPzexI3iB6oLR9YsJfUUmp7GggBpOVASApG1OIDb+pB9N7fulItsV1EpoOQAKPa8X4kYjsiclocpqTdI5A1gQO0ecY+8YA7BBT2q8kgI0+xw6SpihLAwFbhEbxL1f00mMDeid2eZ4lg1oJBOCN2Do0NhuAHntmdJspYITihk6LWF3oC4xsOzzNGCZlVJeDo8v5/tB/t4Ans6ss0INm/W0TKRJUw728QePNtuw97vxI/cwH+rKRmGPanPgqr1BJPuppg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1677013173; bh=rhCo3fYLw4lrsqfPwlsygcWviIBNq1ApD8wuSF8rPv2=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=e5S6koOarJSj67I/f+uFhITtgLF+fMZnRoKdGbuzUuQk3p5MqcUxGQNaL6tHeuEK0+Rfs8aTnh/B7hwCJHL+fy4JOEurv800l+zAVDBURhlWdqYLe05K73sex1WsRCMQraCR97sXwEnQW3D9FxZAhP7sRkFNC7jUsZEeNRX0k5CJ0yY+d9Cf/CYM9w8E9ekajpXBVs2/VikePvhu2VguPLepg08Jt4D4u7Zj/MA4tCQ9vsvvPHwF5mDhhX6nWLM/+Jwf47G1AI0J7JKmr++4ftqrBoJ1fEScf+j/sF65scU1Nun8xv9s2bfHr58jRmU6ndKyJ/vCa18/CL96UmH6HQ== X-YMail-OSG: j4OvpKgVM1kKgpTzdW405K.wiKD_iDMjOcFHMTobAJoh0ydBly1oLWEp9SPfaa9 pdtCkWMIca5LuBPnb_ompuzzqr6MBX_T6jASPr.v6BnoL0bx0F53V7J5EsIoU4l04Y99YxiMU52J Ml6Teo3jNBY_1SVLB54BkS9ioUw8hnGt7UsfvgNn9BoWUiciVHHds0cIWFHbvEinRbNt4KGKdsFb CgMurZHBgEtoPUI5uHw9oy48kiDzomtB.lkAGarsOGp.4QuIqfsha1hW3ux2T84j6jNxXTMUO7xL 0kMhzsbKhSa0EkVK8d9Sf8SvIT9Kz.ToRQttxLPh1dAgZqGvXQ6pmqEz0NDfplEFjfHiCWLc65Sh C1thWaj7EMqFRLeoPumzXC.4EcJIzakWrsifTEFOkGjjLA1wB8khNf7U8TFEOeGPOl6uqCAI6hZ7 d87ETaTOORfDKEv9pkKltQdq2FOHJwREOJZM6rQJveAxNI0_p9js4gkn9U3hqR_s63uDB9_qrC7A XQEh__bawR8jfga_5U5k4YMQX8sUcbwDvRRhsgdQSlKVN_NUKjRIu9OoULm2KLM_N3Wu1c1nfOL9 dTzEkv14iAt0XhH7hvsY977eNH.ifbp858_P4VaCe7k8QJiQuhFqU9bjUI58vD0wsFeNXtkVcLSo DCZ3VxvcJ.IvfnngIftJEiZCvwc0b8srtdOe7dyzaflG7GgrHdymRP87IQxcWjgQuZr6UgafJ94L VRgjLPW9iMswJcwBcconnIISGGXkJrbp2urvz53QLewdGGGrqtOY.9jLwVdMCmcNOSuKD.8L_hHr NSG8LwNE6fP8URiCQTixfPCYtRh1wBIBTE31HBv3zlZi2WkErfbvydtKh9Q9nR5vqpskswUIWdOK dhkq2WMGMwXX8SLYtnV8LNiUtF8qtNB.SU49raA64HHQvPhCscNT5rNv1EN8dUO729dM.bXeXY0v aVd5a2VFV2TywaMyYL0mg5r2Ahel3xSoSteiDqaJko42S.5iHMFWxKvgFBGZs4tRVXOhvH0nTBZn yFhEUy9.FkLxvlTWlUH8sxGKKHG1hrZDdBjT7DrDQE7bzl_kKI79Fah18sGYVxPIxFuZV1GwiI_. XTqpIZxetU2SmBpcqejFy1vIwnt9WCEqeyaE4d0sU6IqpWapDs55qiLY7d2Ot9A1XWkk7NdI9MD5 k57MODNNuWwneIskbgE3453ooSV_UAKCiH4NqaNqFxzcy7yh75prcP5imj.DrK0gOpaG5gImuUzS GxSg1rK7o3LbwQJ8_EwDH0MgXmnAFz6fep_mosBB58TtyKwRqD4R5Um9VkB6DouPhWAZL4wi.xgL YLVv3TeAHO_dqCKGxEOy5RgEjj9w790zo0sq7gGsliS0whqGZEqEVqq4GYV.OyjAPfZooUltVLC5 d8paH0bMtHOmQWVrxfUwGYZKzvVQ2x7p_6zyG1a8DLiyfa_vC01Me6tqSix1rwgyChuWRYBUI9po 32KmIGc1JIfWQ82s2_TCjU4nWrtyP.K4UJDoRHj9qRLWaMSolWmgqf_d0OwDm9Y1thl64UYzvqye PmkNQ1Y1THir137SV8NxfVVVwkE.ZaR17Zi5_KlIt9tkKmDlFjmMT8hLDhgrwkdWoseDToUBTEcP mFtfJhLx4zpduKukU2Wswb2nDHhiiED_.zgddm4osg6mT.lz4Z09d4bZv5KiClvT9DjAP.B.Gz8j AkH8NlDnZ5xuWwtKbnDVj8LWR23mBhi2Dt.WImmKV2ERaRQC1xjqgJrrkdIJ2cHHZ8KuQ9e1vg6V N.YXanx9dGo3SdgnnA1pRn3.IEIASajSTMRiMdbnQAagPYXrx86wx2WtCIryCzp69OBIugQs2co6 cTKPuhXGVEbphq_OR8EnzVq9IYdw1BhIRT2.ZeGlA.RIbA1pWqhGMCPCf0Mpjko03hWoZrLvYDK7 OQFXT8QM2Cxcbslh6HKZCUP41vGc6BPWwUx_DIpkqA7OYeR60PqlyhftQZKCn_KFDHm3BFx4kYeo lBzeF7O.SAuG48U.wQ_oV9si4_g1lgmpWrVyiWAgD0U95mlehN0psrcUKHRALUbGgY4P52_NlKO1 kJjoVaSP7dQBQyqXrhga5.pZTQwdB1fmZOo9QSCrfnylcYsfzpLiCco6YcnZej2fRxrUoh0wZbA7 0POz5ki0SSQWsXuO1mmkhejZb8r6d9D7hWRyzKYK4OejPPDUWeqw7_FW3uMP1BuFmdbtvbOgfEoP WjEgSvvXY90t_Wo1IZ4DaU35YtthKOef3ecaYRjW7u6EIxkLJ.jFzqXVwvXgpGUK23dvQk56idYo 1 X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Tue, 21 Feb 2023 20:59:33 +0000 Received: by hermes--production-ne1-746bc6c6c4-8sf8l (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 6e1660b32034147e503ffa11b0414a66; Tue, 21 Feb 2023 20:59:31 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: 13.2 BETA2: how do debug META_MODE? From: Mark Millard In-Reply-To: Date: Tue, 21 Feb 2023 12:59:19 -0800 Cc: FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <0E25AC0B-3032-4F4A-9343-85F84C907AB5@yahoo.com> References: <41B536B0-DA66-449E-96BB-E11A8750471A.ref@yahoo.com> <41B536B0-DA66-449E-96BB-E11A8750471A@yahoo.com> To: Peter X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spamd-Result: default: False [-2.48 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.982]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org] X-Rspamd-Queue-Id: 4PLs9M1wyBz49Tv X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N On Feb 21, 2023, at 11:56, Mark Millard wrote: > On Feb 21, 2023, at 04:55, Peter wrote: >=20 >> On Mon, Feb 20, 2023 at 08:44:59PM -0800, Mark Millard wrote: >> ! Peter wrote on >> ! Date: Tue, 21 Feb 2023 03:45:12 UTC : >> !=20 >> ! > on /some/ of my nodes, META_MODE seems not being honored anymore: >> ! > I had to build them another time, and the lengthy lib/clang gets >> ! > built all over again (tried two times). >> ! > This is so since 13.2 (BETA2). It did work in 13.1 (RELENG), at = least >> ! > according to the timing from the logfiles.=20 >> ! >=20 >> ! > Now I'm trying to figure out the difference, because I have some >> ! > nodes where it appears to more-or-less work (have seen buildworld >> ! > take 5 minutes), and others where it doesn't (take an hour to = build). >> ! > The thing is scripted, so it is not so very likely an operator = error >> ! > (while not impossible either). >> ! >=20 >> ! > But it seems difficult to figure out details: "make -n" seems to = not >> ! > care about META_MODE, while META_MODE suppresses all useful = output from >> ! > make. And the docs say there are *.meta files (yes there are), = but no >> ! > info about how to verify their content, or how to get make tell = what >> ! > it is going to do and why (and the buildworld is not the most = easy >> ! > to understand target)... >> ! >=20 >> ! > So, some inspiration would be welcome... >> !=20 >> ! On thing to check on is if filemon.ko is loaded and operational. >> ! META_MODE greatly depends on it. >>=20 >> That should be the case - 'kldstat' shows it (and I've seen warnings >> where it didn't). >>=20 >> ! Another thing to know is that the following are very different >> ! for what all is built for the "(again #0)" line vs. the other >> ! two "again" lines, using buildworld as an example context. >> ! Imagine here the the first buildworld rebuilds llvm/clang >> ! materials. >> !=20 >> ! # cd /usr/src/ >> ! # env WITH_META_MODE=3Dyes make buildworld >> ! # env WITH_META_MODE=3Dyes make installworld >> ! # env WITH_META_MODE=3Dyes make buildworld (again #0) >> ! ## no more rebuilds below? >> ! # env WITH_META_MODE=3Dyes make buildworld (again #1) >> ! # env WITH_META_MODE=3Dyes make buildworld (again #2) >>=20 >> But what is the difference between #0 and #1? >=20 > awk, cp, ln, rm, sed, and many more from > . . ./tmp/legacy/usr/sbin/have new dates > for rebuilds after installworld (that targets > the running system). Not true for #1 and #2. >=20 > The dates on these tools being more recent than > the files that they were involved in producing > leads to rebuilding those files. That in turn > leads to other files being rebuilt. >=20 > make with -dM reports the likes of: >=20 > file '. . ./tmp/legacy/usr/sbin/awk' is newer than the target... >=20 > explicitly as it goes. As I remember tmp/legacy/usr/sbin/ > was always part of the path for what I found. >=20 > One still has to trace back to were rebuild a rebuild > is not due to something rebuilt in earlier in the same > build. Noting that tmp/legacy/usr/sbin/awk is reported > as newer than its target, leaves the question of how > it ended up being newer: earlier in same build vs. > before build activity? It too must be traced back > to something based on just material from prior to > the build in question. >=20 > Note that the above make sequence was only intended > for showing the dependency, not as instructions for a > normal update sequence. >=20 >> . . . >>=20 >> ! See: >> !=20 >> ! = https://lists.freebsd.org/pipermail/freebsd-current/2021-January/078488.ht= ml >=20 > This (and later messages in the thread) are about the > "awk, cp, ln, rm, sed, and many more" that make with -dM > explicitly reports (likely from tmp/legacy/usr/sbin/ ). > If you trust the make date comparisons, it is the easiest > way to find out what has "is newer than the target" status > that leads to starting a rebuild sequence. (Other dependent > things then rebuild based on this rebuild. One still has > to trace back to where things start.) >=20 > I did not do the analysis of how (e.g.) tmp/legacy/usr/sbin/awk > ended up being newer than such a target and, so, causing a > rebuild of that target. I was going the direction: that > it is newer really is unlikely to justify the rebuild for > the target(s) in question. The other direction about how > it got to be newer is also relevant. >=20 >> !=20 >> ! and: >> !=20 >> ! https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D257616 . >>=20 >> Thank You, that's exactly the inspiration I was looking for! >> Diving back in... >=20 I had forgotten about Simon J. Gerraty's notes in his reply: = https://lists.freebsd.org/pipermail/freebsd-current/2021-January/078628.ht= ml It is about telling META_MODE ignore things that would otherwise cause rebuild activity. Had I remembered, I would have also listed it explicitly, not just listing the start of the thread. =3D=3D=3D Mark Millard marklmi at yahoo.com