From nobody Wed Mar 22 22:39:24 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Phk1V2Q8jz41PH1 for ; Wed, 22 Mar 2023 22:39:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Phk1S5XhPz3q0J for ; Wed, 22 Mar 2023 22:39:40 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ZvvRfsjF; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679524778; bh=gZI3kwFTWGc2+LFnyqWLmUnRd2wyIaxpVmuT7fsjqNc=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ZvvRfsjFQ0/UKtjGz8SEsuGcCquc6P/Sakfo0UMPyjMIKlxxcSdWxvSnXA9fJYYQUw5K2u3JW4FuwHC6Xgz9V7CUjFZwMywjKvg3JK86JfM9ivL/LwgNHDfLzM16kI04W1B0uW+Wk2fWK7eTTjLr/Vd1nRyt2pwcY0XrhNtyjYF6iD8tAUQSEyRBQbJpJ4SSn9OkU6L7fmc7rNVPD0tjnl/3G4GEgPowbebTpd/QbgUMKN5N9KyKrSlSwQEjQsnqB+x6rW34uZdh8inO7z2up/WseH2SD/Mm0e9H/IIxuv7xfyslAt0DrSfu4UvzbuniDxcL5qpxiJTDDeCcBTKNig== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1679524778; bh=yBn1FqytqSk0EAYTJM4O/zr7vKc1oLGp1aoPCPIEiTV=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=VFka3VPFclJLiel5LoPYWE8UJIDA0UWSJdSFhcs5XDRNmbrgpF01PtcwyR1AIXeqybCbVVG3Qb2zYr7rkfy574Nj33ke/pbxNItfNIz2kZUGFsDWhhF3CHBwVrzMjWa8Eof1S3AO9fOeBhZQp9HyrIO/ix9RMDlmi0kTUQMAE+oiF/7uUn9BlJ2HFTXGWH/gGoQ1ra6QO78qg2+jSNwptw1CLZAlWbQwHwN/S/PEeiPQA4dWKT2jZBRMynlM4CEfH3JorscJrzN3adzBH8s4vJonYi1QJyArkB+K87yoj0nEOk3MGLDotpLee3RnQw7DHrUuun8ccR1WpmEzbZd64g== X-YMail-OSG: rT1Ve3gVM1lOVDtp3dLy4BW5pz2_Vv7M9FEWsCHdrYiOe9fgEcTTSTBByIdyPf0 gSXVKYNPzn6W69dPGrLqla.zxvO2lsebEt81tc_S8z04Z0Y3ey9rQSytyVc23IMGCzZmvpfdj3O5 2.o1Xw7McSzMNbyIgN99oeBqCbQoMtpRtors9p_qEv_.r6WzP.Cf1KyYAiaEVOg5o3iggRCkl9xp xQeo0HOqfTpUemNsAACfpwpqapQaDnIabvHcZg__PnAcjwsqL02x2jUTvEy67iUJBBrjWlHx90h9 pF11zTX80e1lDbKPa015iLesXJZ5ssjwDIb2_bRV5PHtkA2CpO0nJ9mnZnLpJlkfSj_3qWX32VRu 6NtZmlkYYLNUZDUfJ1oYVrICw6EIbT8UcD86toYoMn7ry2XHS7yv6W8K1j8IkTVEKgbsAIXseIIb wRgvAM_wcZYTX8GICO8FiTZoRqNd5tVPIaenvM2ptnJYHTtc94zDGxu1fRS8zR0HJXN4sq_jGowy zHcisEay20JaTHL1AfiEihvpWUnGoCkF6yzi70B1YS9KlPWzXKzpOnSDnOS6HL.rPKLZ76lsI4Lk uQcybc5eLQPvgHDqOgWNwsaKnwnIoKiF1reMwaA74i.kDv8yDJC2tyfVaR9CgEUrKksRliA3F1Xl g4xF2jbeMKQofl9Y_ZJUoVbajiuMyTHz_6W67Iu1X1nNkfJdVC3hK2utuHc_I_QJOkg5vLQXoQZF Rtd3f00GnXQeaFpB2L8QLoEdcXnMhg_wxWUA.hVrdc6sdVOW.HLBQxzsmVjGbFFNTmlj1Nqs7orM tBWhTHhIyYrzYURyKGmclYzifi70RaSphUa3YUTNKo5sIa5FKTW9LVhFHvhejvK5HsW2oZZQeB9Z Dc1oL133TMqDuqhKLEjowt.wQUpp33PsEiEAECgQ9mreZahPtLyDtKfQ2IUxsWIUJSgenhzUv_p9 YAf2xfH5u73_Ut2T8Kjj_75hoXN9PUy80SqaF1rxUTk976CZ7P0fKZi3vHoImaDr0qn0St_fY0.x AAevRMusIlzN37WSIsZ7bO3GjUsYBR35Sa_xNl2qKmMqVBdojR4VSIlic.u1kZLrthdpmYPyK8gQ xfBsxkceS86rrTSAmWoX.AeQ7ds7665Ci.iSzt.qzpehG1WWpxCtIevyX5M.Zgat_lCPs47gS8xO 9CEPM746S73B9VzvPfIDBiUGykGWWogqWpj8qoHge.8ftCKK4rh_W3rOpMOY77cToodXyVJjcJ6i 78AghTC0JVtkyoL.MgrqGXuvDsTkud3.qAIPmo7UuTcX5HXV8QRbdglyt9pzxOvBy11LIduR2krd 6MoRA1CqyHPWvGwVspIAdt_NhSHbPL.BjcEq693YFNrGNApYKe81BXUrpdfnEbUHioFqHM3D5fSy neIoZkm2ut3ie_O9YLcz29hIyBAEckrd0qyXCQCY5nyHHWJGSfAvR6j.rLqa.3NRy2iRzxTn.KNR cBny9H4.KOcRXD14Zyrsbjlusg6JfFdj2U18FIGUv6z6TyQCeWLfWcAur1NvB6itGr6ZUzkRf9H4 BxJeK9q81gzc3F36FiqxYlSS4enOfvJfRO9Lax947vzN.JgEaANWCImGYHpuFVA_mMh5wVkZi9ib GxwtMjdHs7rlmuPEGhHhOIH3GcgPVMNAbDs1I2mKkLVtodGioat2p8rxB_kusnqC7avkeiOIOEHL .zykVLSquu8F3Dne3oCTEqwf64iaz0kAS14lq.ktu06LcloUQzhKVElaO3pNXZDpMoYHnagiL9Ld dCK7tQWYTwxpKqSXB.8A3JruhXIHaMmZ2cdSowS33ISI8_j8v1YAsSr3LcADpjoBUq9AhwxpzgXE aEbney94pnWB7stvEIQFTD1RqJ.Nk3CyNxaq4apMo54DSh2Uuh83EFgebELCT7ymMikoAl6XiDuV Weflt2kZWD__UObRhaystWQiW1T5v170EmqtwruBBQWtLIkiNMj65LYO8O_Ebzml7Jh3qDHbhmyl GdSIMQb.EU7YrwLCrd6mlcYPgvhno_11CgJiqF8djwiAmD._Ykb6eAvycFerP._.XfioN1PQwbcY eQF5I3goTJrh4I1y.AaXjnxSf3U_R4H6NEEAZHE3fW75PWUflwC3BR0MkzeIwO6yyWmr1nW8x7LK Qd0vFWlOo40I.kXoVXfHuM8MOLLbRwe.2ikJAx6pEgaU82k5fchZbdzv3qSW4195nMRribxm.YvF RLiM_qc6GD_oqYehcMln28fzPAOpK9NboBXAug.f.OEq8lje8h5Xyotu0TMdfaMnijIfkZoez3cA BHA8- X-Sonic-MF: X-Sonic-ID: eccea552-2096-4c8b-a6a4-d47d63371bc7 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Wed, 22 Mar 2023 22:39:38 +0000 Received: by hermes--production-ne1-759c9b8c64-2s6ww (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 7c3ec5be265e86b0e2f7c9ed089cd386; Wed, 22 Mar 2023 22:39:35 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Periodic rant about SCHED_ULE From: Mark Millard In-Reply-To: Date: Wed, 22 Mar 2023 15:39:24 -0700 Cc: FreeBSD Hackers Content-Transfer-Encoding: quoted-printable Message-Id: <78EF511D-BAF1-495F-BAC9-03AC1B8FD56A@yahoo.com> References: <6BD317F2-7EDD-45C0-9DC9-5B94C1BBB8E1.ref@yahoo.com> <6BD317F2-7EDD-45C0-9DC9-5B94C1BBB8E1@yahoo.com> <952d9795-19dc-8ad1-bb75-5c556ca6795a@m5p.com> To: George Mitchell X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TAGGED_RCPT(0.00)[freebsd]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from] X-Rspamd-Queue-Id: 4Phk1S5XhPz3q0J X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On Mar 22, 2023, at 13:34, Mark Millard wrote: > On Mar 22, 2023, at 12:40, George Mitchell = wrote: >=20 >> On 3/22/23 15:21, Mark Millard wrote: >>> George Mitchell wrote on >>> Date: Wed, 22 Mar 2023 17:36:39 UTC : >>> [...] >>>> Here are the very complicated instructions for reproducing the = problem: >>>> 1. Install and start misc/dnetc from ports. >>> Installing is likely easy, as likely would be building >>> with default options (if any). I know nothing about >>> starting misc/dnetc so that is research. (Possibly >>> trivial, although if it has alternatives to control >>> then I'd need to match that context too.) >>=20 >> service dnetc start >=20 > I built and installed misc/dnetc and got a binary > blob that clearly was not built in my environment: >=20 > # file /usr/local/distributed.net/dnetc > /usr/local/distributed.net/dnetc: ELF 64-bit LSB executable, x86-64, = version 1 (FreeBSD), statically linked, for FreeBSD 10.1 (1001515), = FreeBSD-style, stripped >=20 > Way older FreeBSD vintage than the locally available toolchains > would normally build. Some might be cautious about such a thing. >=20 > The man page reported that: >=20 > QUOTE > If you have never run the client before, it will initiate the = menu-driven > configuration. Save and quit when done, the configuration file = will be > saved in the same directory as the client. Now, simply restart the > client. =46rom that point on it will use the saved configuration. > END QUOTE >=20 > I've not seen what the configuration asks about yet. I went through the configuration, basically just looking at it, other than providing an E-mail address. Then . . . $ sudo service dnetc start Password: Cannot 'start' dnetc. Set dnetc_enable to YES in /etc/rc.conf or use = 'onestart' instead of 'start'. $ sudo service dnetc onestart I just let it run without any extra competing activity, other than I had my patched version of top running. It records and reports various maximum-observed (MaxObs) figures, here the load averages being relevant. Top showed that dnetc started 32 processes, one per hardware thread. Mostly I saw: 100% nice and 0% idle. Letting it run and then looking at the load averages (and their matching MaxObs figures) after something like 60+ min (not carefully timed: was doing other things) showed: load averages: 31.97, 31.88, 31.66 MaxObs: 32.12, 31.97, 31.66 (Note: The machine had been up for over 2.75 days before starting this and had not been building much of anything during that time.) I've not yet experimented with having other, significant competing activity. >>>> 2. Run "make buildworld". >>> So on the 32 hardware-thread (16 cores) amd64 machine that >>> I have access to, the test is to only have buildworld use >>> about one hardware thread, no matter what else is going on. >>> I never would have guessed that the steps would not involve >>> more like -j$(sysctl -n hw.ncpu) (so around -j32 in this >>> context). So it is good that you provided your note or >>> I'd not know if I'd done similarly or not when trying such. >>> [Note: -j1 and lack of -j are not strictly equivalent in >>> how make operates. As I remember, the distinction makes >>> a notable difference in the number of subprocesses created >>> directly by make (one per action "line" vs. one for the >>> whole block?). So even using -j1 might make a difference >>> vs. what you specified. I'd have to test to see.] >>=20 >> I am literally running "make buildworld" with no additional options. >=20 > So required for repeating your results, but likely making > such results not be interesting relative to how I normally > deal with buildworld buildkernel and the likel, no matter > if there is other activity in an overlapping time frame or > not: my time preferences are too strong to wait for a single > hardware thread to do my normal builds, even with no > competing activity on the builder. >=20 >>>> Standard out conveniently reports how long it took (wall clock). >>> But nothing in your instructions indicate about how >>> to get an idea much progress dnetc made during the >>> various tests? [...] >>=20 >> Honestly, I've never worried about this part. But dnetc logs its >> progress in /usr/local/distributed.net/dnetc.txt, though not in terms >> that are easy to relate to real-world progress. Oddly, when I run >> "make buildworld," I'm primarily interested in getting the world = built. >> Perhaps others feel differently. >=20 > Off topic for the specifics of the actual benchmark > that you run: >=20 > Then why not use of -jN ? In my context, any buildworld > using -j1 or no -j at all takes a huge amount of time > longer than letting it use all the hardware threads (or > so). (I've avoided having any I/O bound contexts for > such.) It does not take additional load on the system > for that to be true --including on the 4-core small arm > boards when I happen to buildworld on such (rare). >=20 >=20 >>> [...] >>> FYI: I've never built with and run the alternate >>> scheduler so if there is any appropriate background >>> for that that would not be obvious on finding basic >>> instructions, it would be appropriate to provide >>> such notes. >>> [...] >>=20 >> You have to build a new kernel, using a config file in which you have >> replaced "options SCHED_ULE" with "options SCHED_4BSD". -- George >=20 > Thanks for the notes. >=20 > I've not decided if I'll do anything with the binary > blob or not. =3D=3D=3D Mark Millard marklmi at yahoo.com