From nobody Sat Aug 07 00:39:17 2021 X-Original-To: freebsd-toolchain@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0A5161375209 for ; Sat, 7 Aug 2021 00:39:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GhNlQ5FvMz3rHF for ; Sat, 7 Aug 2021 00:39:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1628296763; bh=1FX9C9T9rlUrJB7bS50qcE8dcNN2jOegkbhkFGZEdMc=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=eVbEX4E0yoEQD5gyLCcSZSllLwW53NsTMI5AknEDG7bfJzm/kA0+xr3uXmKfYp+L7HauVpQkQQrlcm+i8Ltlop4ouZKerbkXiZL+Evu9begqGHXF3A1QYNKFVR8uQy3cHJGdgA6Io4AshoaKxY+siDlLahzS12eXXGZhqRpgN7jVjKjOVb1hFKWLCzYoD9XOymiArQJZDau3vU/au+GAiG056iIM6d3xzsUiMme8wGta6pOb1EkWRbsomuVWxR/f+E82VP7xRpSCFxxli3KmNwqsTcNAuEBicfILovDhDTe0IaCZjuKigwOK6msOyxqqMRunGQjOp6c4viV5czMQVQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1628296763; bh=bFlScOpFev+tPvtraBO2STGRYhxHesw38aQWB6UObfn=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=mp0OaH7ZG0uyzP8bJCKw3VGEp/YyN4DmN21iAvE0Q9d3TP0tRCYccE0Y7YImhMARy9jfsdZoHjYBndVWnF9/xWGXInXs1/mvruT5UpC+xTI8bvtSk4BNeVRU4K9FHQA+uevL0uerwrYc4KzQMvu0KbkXUzyCOJ4GlMLvEXe85pwE5SJJISfROmhRI+tVmDtD8wV4uqtgDDJF8hpxEnR4h3KUdaT0f3xdEyCiZVAnBJj0JIzN758n9XXiwNxkskxG4hZU9AxpmGv4EEWE5BN+vZiTXMzNSqCcyBqYElFpnlBGWhpvXWWGnoZRjUH1HyZJdyd79hEMiaI2kzbBHwwOyg== X-YMail-OSG: 3Z4drMwVM1muUjHcobeZmpWDE.xrvGYiwtxY67Pzn_2teJq2JKR1txdcIHiUFpF L.yvi527aftX9A13qlJa6UzKo7dPgMWpe9uvuRsWlOC6NOheAtYjnUWRz1G4Qt8.msAa6S1_t_Ae MNHRnkJEv6Ic6J8nheNTAGG5hO27149KrMHlb4KwRKXfj.nLJU56Zw4uNSoIyQw2OybBR12QN9it osgvyaNeBfbckXyaJY01AEm_fuQKy_ApAXFlYKo.HbZVnSDBZ8cdotz9HdS3R5Kp9UCylObyEZX1 jWU60FUVtq0o27xbTPNWI3YMP_aMzpHkccqste78ueawCi.sHnekGbCij3qA5V_P0NLSa9ctRBA1 RB9XlYjxag.r1oZAx7IZTF68O0tP.AWPEjijGHKeCV7K20jCYQZ49mq9xIv5gHaN4yJ3Ejt4Q2er EGcN92Ul43DFahRVECpaAnfjmTtC5rLqaGz9JGeWz2RkmnbM_Wks0EKjxQsSCaD_b6DhRwpovF5Z WveoX2adfb40ASBqj7ZR9TxGNBp8_1GbMvCyhcRc3b9.uW61xcDsZJWMm7rITepjozj6_FRWWbZL pfxhWO8dwz3goWbTNuUyZtxPqPkPy9obhMWJjXg4givw2L0ZbD2H4GF3NPtG_ixxr_Fk8azY.kTv 9M2OoNraVDPPGh0A5s9cGs0oXiaUcJzYxMacZFirUdxQL178xwH38TABzPwUEkW2PhWSmFnJeIOw kSMZeaSIEQjzFLtpvpXXqThEk4qZmPfeBsds85cdYe2SMMSLjaVyupzSu40l7lfE9z2W06A6VP0V MOkUJDarmpz5c_Euj3qGDg7PlNpHf1ZqWBbBu63vt4svAQl8iq9_OeWfqdgzZ4Fn2DtpdsqMNHWr AJCArrov.PsIHSpZMFjos3_FIBgLx.0EIIyKA8AB_3HjT55hUvi11F7o0LwtIu3zkDwIo9NapdBw WIuCLgNIc8SnDbnaSwm6eLk7hs02qbn0g9npxL3X13qXylcZsll2TAEAUXOl5l6_ifqU9MCmRSdr bf3EHIwDSVXd_VXHvmts47KLxU.gYNZnvxSWEaUvYBkN551VyX8i1ZZDMWYn65ef7Tr.6mwMwnE9 XF_xJkeQ31trPQTWPXdTvj_u2yg7DqPDvlIOav5Ta4em1OYxNRUFYK2fnrzAgsjdpcaLh8iS6itr w2ZsVyF0jDGUjr3uAIt_2Vzf.yb0041DCLyKceVa0tmxGIoJUvZoES1hDYgrm_Cl.6xz6za542Mc Txsxe2iPcOeNq4aiT2wPEMo3HysdKlwahxRekDWPp7YbzzqTMRfgW3f8PguTmEQOMVBEE_v7MHvb rQdZfu8lgpgsfFw_wv6i31_IYSRiyUY3vb2NwaBOdszrDVq02cRpkWT0vLHS9ZUnd9MESFBBlUxv jX9UwuUcZE43RfjemUPRN_AF6Z8A2LTkj5eKdWSpvBcmOLSaV9IMr_fbV4HvETQhMtX1Q9y6YH9X Ap9H1Yzm4qxCuZ8jLTWPuq2w27pWXPlzEx3hshCWIzTFPMrAvWp02y8753XY3WKAbMW9KGcNjWO7 QSICf.XnUGXkgSOy.aAmi4h9bTj7gjNmM_mrnM_.tQW2z3kGvU1jGZt4lB5mWOY.512cKmAVqA3e 1LoDzexOR9x6hZH8rH4xBlb8PlbiIHOEbxnx79JmiXGrLQ6r3MqBUGLs4g0vtsupZRH4uhNnUXcR pGf7Jgbj9Iin6gLTTcoCSOssUVCh1YL9_4863.8fqIfu5HZQ17KJrLz6VKZiiDivX1XODRVIxLbM edcGprJp36JK7Pfp1vPSsw2PuRDyMAaUydhuN7UrxQ08nBHPlIa3q02jzCIhYBO4prthvkIpVmDg 1e015Y23eElszkJsX6yiaGsCyv9lYHm7KBOPgm0yVFjv71EZwK3.Y60rMNUcyJkyfk123IjyrSaY kzrL90_zqSye0zeEEv.2zYej_DAHHbqQ5saWdtYmmaxyW1d...Z6wj517S8w7dLnaQSm1Dl_dYdj U.RmErfVAyQJam4ntNBE8uhAR3t4YBwO73iFA.xMAw.17SzASebhwCBNHe1PncgGK8lpDWMC6xLp gWCoLFwthn4QT2C.jVlLmeusdxZmM0.H8GfQKCc5g65kL8HJ6kcqr2VQxx_PBQqUn9rD2zSTUJ4C bjtUqkJINDw9p.nqhnYAc6QVhG.Xk8Y.2Z7gCA9k3K4A7nRtkXUsKmAb1_K1WL7tZCebJC4sLY9q NWL911PVLPDQNmcy9sMOb2X.2vgS6o2HWDQUJ7GcviBMtIt2IlwyCUseT.qV6aH50miVMorB.ZqY _qIj5iw719HcovJuLMktUARQ6zZLMeK6N3LF.q1ZGiKBnBOMo3cqn1DxHVCqca0hDcXIRrbSL0Km hsySvqmLxu.uMtzZdSIzHi.5lpb2bD.h37n1gYoWpzIh1vx5f4K8oBWR0CCgvH78juNIrpZlrZN_ Rg0Wh7Pf6i2dFo.U3g41ero9COMoWhnTvWZ5e2O8i.eI9R9OE3hMw8hJxeQ8WfJ1ajxWb3RUOXqp ec3YTp5_myFuKlWT5l9PvO4ENyRXuFwz_9gtuiSzLnPBPHF8wJHitSdGpeg6efSA6uglEtL4hz4n ZWoel3xTb8UhlJWuQpM9wByw_hPe7LVjbGKrSksF.j69dlYIAxHUeJHRinYXHMk6Y5c00lURwLk. zMK7agc0aTw421.e3mkYgVTLvXefxH1aYK8FEHVPVUbXMzTaQ5g-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Sat, 7 Aug 2021 00:39:23 +0000 Received: by kubenode551.mail-prod1.omega.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID c83b367b9e23933b545e4285adf72692; Sat, 07 Aug 2021 00:39:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Maintenance of FreeBSD s integrated toolchain List-Archive: https://lists.freebsd.org/archives/freebsd-toolchain List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-toolchain@freebsd.org X-BeenThere: freebsd-toolchain@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: FYI: Over 2 hours spent (so far) in /usr/local/share/poudriere/processonelog.sh executing bzgrep commands for www/chromium failure X-Priority: 3 In-Reply-To: <270299435.875261.1628285088620@privateemail.com> Date: Fri, 6 Aug 2021 17:39:17 -0700 Cc: FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: References: <00FAF070-71DE-40B6-8D63-C1E74FFCD08C.ref@yahoo.com> <00FAF070-71DE-40B6-8D63-C1E74FFCD08C@yahoo.com> <270299435.875261.1628285088620@privateemail.com> To: "linimon@portsmon.org linimon@portsmon.org" X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4GhNlQ5FvMz3rHF X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-toolchain X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N On 2021-Aug-6, at 14:24, linimon@portsmon.org linimon@portsmon.org = wrote: >=20 >> On 08/04/2021 4:43 PM Mark Millard via freebsd-toolchain = wrote: >> it has spent over 2 hours (so far) doing: >>=20 >> /usr/local/share/poudriere/processonelog.sh activity ( = /usr/bin/bzgrep 's ) of/for: >=20 > fwiw processonelog.sh is not part of the toolchain per se. It is a = script that is part > of poudriere. poudriere clearly is not part of the buildworld buildkernel support. Since poudriere is used as infrastructure for building ports into packages, including use on one or more aarch64 systems for such, I took a guess that toolchain was more appropriate than ports for what list to use. Sorry if I guessed wrong. > I have maintained it in various incarnations over the years. > One of the things that I have tried to do is minimize the time the = script takes in a run > over the errorlogs for an entire build. These generally complete in = around a minute or so. Until attempting www/chromium builds, I'd never noticed the time frame but in this case I was monitoring with top, as well as waiting for pouriere's next output after it reported having saved the wrkdir. In the end it was about 2 hr 50 min. Part of this is likely just the size of a log file from a www/chromium build attempt that gets near the end. The actual log file is not compressed and can be looked at with just less or more or the like. Such is how I normally take a preliminary look at build failures. > You will need to figure out how big your logfile is, and compare it to = the size of a > successful logfile, to figure out what is going on. >=20 Unfortunately the system involved is down/not-accessible for about a day or two. So I'll not be able to check details for a while. The www/chromium build is huge and my original report lists the size of the log file in the "ls -LTld" output: 153683812 . So, between 146 MiByte and 147 MiByte. A successful build's log file would be larger. The build only made it into the 94% range for what ninja reports about steps executed. (Unfortunately, rebuilds use different alternative orderings that satisfy the partial ordering criteria. So build to build varies. I've also seen 77% for the same failure on the same file.) For reference: the (root) file system is on an Optane 480 GiByte in the PCIe 3 slot and is a ZFS file system. The system has 64 GiByte of RAM. The swap partitioning is on the same media. For reference: Using USE_TMPFS=3D"yes" lead to the tmpfs for the wrkdir involved being over 99000 MiByte (so somewhat under 100 GiByte). The system configuration was sufficient to not run out of swap/paging space, 64 GiByte of RAM + 120 GiByte of swap-space. I've since adjusted to just have USE_TMPFS=3D"data" now that I know of an example of such a huge wrkdir. (lang/rust ends up with a small wrkdir peak size, by comparison to www/chromium anyway.) Until I again get access to the system, that is about all I can report. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)