From nobody Wed Jul 12 04:14:50 2023 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4R14CG67v4z4mfkX for ; Wed, 12 Jul 2023 04:15:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-8.consmr.mail.gq1.yahoo.com (sonic308-8.consmr.mail.gq1.yahoo.com [98.137.68.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4R14CG2pxwz3Dfc for ; Wed, 12 Jul 2023 04:15:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1689135303; bh=TCz2jaqyqsi7dg9cwSM2Vw5llIUzIjdYQsq2haohpXI=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=X4PBwPF2CTkSITGy1W3qegOjzzhemuMMpuCNyoGaMo8Gv5T/ysWmSXEEeLFAjrvLz/XHJ6QnuIcnTRKDM+6TtNfu/xetdF0Co+7DGy7rl50hx4nARwOP5wYWgNiFO9skeCMfQwfgkwYLiDFd23m+qOxK9sFHooxU3UIxjHOPAMZBqLtMcDQ4NzwRLHUt2g+kl6/KY4ke5qF9Iy70LXyOm7timWmX4jPPs0bF7Y7jmY7LU3x5QRU8qMlAbUSTBzQfTBwmRRDrG8WQiEwNAvw12Lm6VYuFaV7LAkVu/UXm/bL5uqNg3Hvr1h01MVkUGjhD9tZrle5/lP2VDrRCZMDyzA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1689135303; bh=EIHyRVyctjj5LyImcFUHwBQiqfRwkFeYBcLgpZIrwAx=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=AY60wm/bD9yhTajA7gp/28uz14JNFXtLgwQyruaT+z3XTOj9xhxdwb+JF1i33hDNlCrSg5b/q3s7uFbAPhHqWAY0i8r9rGUFX/DEebfJtFJXJD2y1NR69ZBSCS7LSvuW9k2EhoPgMWlN5IyHuEi4OAeg2S0N0qYrQRn8e0OfUCMEa2Ig4lwHdmDybuWbDiPsq+E3vjPfGf8126HmQ+Rp0Qwkf9sIP1ruXQpbSzQg1f5rlen1J27z7vyRkbY9dtJ4qN9EXi5M9qbGzGIp7carS96KbtOSQ2nzXLes1KYV+rabW9Z2N5GFLkDsKDM96f5Ntm8MxEn7sLUVOhpqG+RRUw== X-YMail-OSG: 2gtta.YVM1kLWhvA6jqq4KkDvB1mVMwF39LEmT2E7eo9_E1uQBkwXk_iI4lCE9r D7OkeNIRVsRBnQtByvcvMTtsrvL..uIZDF3ro59_SiuODJTyyBVdx6jzGAzRs3bhpshEbTaPIHD_ WeK7LKEiuota0xJxG866d2bItsk82N9hDkt7UYSlIt5XU5WkAngDlSpYPUsQAFxjAQWqm0Pkt6lZ 0oTZDaTpSS4zAcQUvg00HRWyujNDfxXL6UWHwrJqTayKkuNaYwdgUX9o.PGRb4SsfgefnhEEzIjQ _jMA.54QLAg370k3M3earIU.AZMPQcZkw8RUapC1hE0nmt2kOwLjg58LFdYHnKH0wljbNPnga0QP YT.qiWLhKIRR3QMpzKXfa2QwnU0ufmXr_TaZ5fRqTzWyG9CAt5l70PIAbpyb7k3aKboQ7ZmKqELk _GcnW3YcO_nqMNmvkzy12HecdRwf0YxndVusErOSZCDHCYkN.uo3rnIiFmede6kPappmnFO4EElK 1TuWdadZI00RoAtlNoSSWpRqwu1kOHHiOeon7Q2UU8LImBNQd36XMG.50WSbrZ6wk0Bvq6qG8vTw IAeolfVe9QqZJkLeFN78STzNT99ff8LyP6wNy5pQo21CsF1X6tnXzatzJefuE.o1TAX6.wv2qDWu uLPT4QJ4GH0x_93oDCgR0p3oSeKwCN_XpcrCP5PD8iTU4Z1398A3v0vqb1vsCzloHeOAjzqTQSMN BBC72G.IaLKCv6OQeoyQe0LKUlV5plsYU4pDnBPj_KDMH1bkpDYqaiuRE473juiGUGUmBXFJpf94 6s.XOuM12Ev.L.NNblqgtfiD5UuBILMSdS9Go9suDoaVAKAlH2G4SkjfSrtCiBhlvS216Z1t5Oku SuPgWhVZdptqMpDCs21jHMF1V9nk59rpquWjmoeRsUEyVpN183CvBsDCVy9Z24Pdkg9AnVDT.FsV A9FhcgmD6J_Jw4YsP3PtC6wmWSY3jnm2e012mD9eapTVM7HtEq80l3c3mR5NdQF6Na9gZF1n3dXl mN_hvYQ48Titx4qALBDq2eSQnIHq1yywnEQCpDgUgQwCe5wFC_STEkji1y20bVriFdu1FvTcHFe. LhTP8ITGozWJkUFE4r4Lwa0r4i5p2XsuBS.XXPofbC3FU4lRKVWuHOMPLaw98SfBntHe9RrhNogK 9GG7vZ3p4xb8Obf1A8_cYdwwq1tlx8lXhM7SI_m5b8H.w5pB8vve.KP3190.pTTb2whOXE9yp7sr N8Gfz9KpShy26lr5OqZMTjRIF7OzcBJs9WtSMDIFiGJRB2KU4SICDDy__7TGRwKpVnzFtvwgwwYJ QtMAj78NVGGZxAEcEyaEMPxW.QoUP9gh29oANZvy1G3l0EJ1SoghgsALUGygTcxVi3ziUi7PAAfd NE7WbGPOBFOHgIc.g5cBYMHkC6IIejlOnqiErgnzzoRQ86QUPPRaugFwTs5VqjszINTREjtDVnAq 5smjQ85CSlllkNzIfqOlKGF5bp52Oce8mwKwFGNo5Ho3_C3vjeexnbblTpc0fG1aWDMtGN40JW3d IHTStgNiOLcximaLtb6dOTBJLVuXSbhohBl0ZMXg83kz6G.EizhskTM5G_T4YvgfB9918KoMFenZ EKpFYMPCrX0P16Fy2LcujdhwwofMOMShfNhISv5IPyE.qdv4HWVMWKWkahekQwa9fjTL2IMIejBq 9XAkWQhjWYT7EmyeVC7dXIbHMLFsHaQSD8Doz3_Log869jj2kSx5UYDSf2jHTkABJomYsq8Rh4qS E43_VpPHou4g0HuRBNRlaM92upbZWoeiUECcxPFENa4q7EfaOajaU0EFII53zzZGv1ydbBtiTIFW WevjupF5xqN1WUQ758GzZxHX.5ImohYFwjzlhrx6mIuB8grMRDlfNCs9FP.iue_VkvMn57RykG8P lADjqUBQXx0F_q4R1.XezBLRC8zVXpruOXYyCzM3cK_BdKRxBv1Xy1jDOyJzfueIlJq5kur3Vuub SZuJyde3ilHDPcIZaM2uqRJosRosS5w5ymXr7mmZSYbRh6W45oVxD9.oYBsUCzilD7yZfLTEIUID MJVgvwiqsxV4zcJ3np.4Qe9erAm4Nm9ItJmnBTqiyv.Es7nbPIAUIZRithW3H3gixwEvn2qUBRWu XmlWhdaTz4.7kebbU1b4G2TYrjTkhJC.J9yLFJ2X9hEQMvgl0tW4HEloidzjrMsxa7OATwVblVeH 0Mw4OwWGJHkWoQ.RziOvwasiFTs0OasdmYYreaZM3l1yoCvM41Ezl5X3DxEOK4MuytED4H.z89oS EXA-- X-Sonic-MF: X-Sonic-ID: 2faae285-0ddb-41a2-ba35-d66ae31d1d16 Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Wed, 12 Jul 2023 04:15:03 +0000 Received: by hermes--production-ne1-6d679867d5-nhrqn (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d3e9cf45dd2baba712788d2402f72bd4; Wed, 12 Jul 2023 04:15:01 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.600.7\)) Subject: Re: Problem with the package builds From: Mark Millard In-Reply-To: Date: Tue, 11 Jul 2023 21:14:50 -0700 Cc: "Hurling, Rainer" , FreeBSD Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <3670BA04-D165-44C3-B5DF-5B5AFD4CFD30@yahoo.com> References: <2DCC0132-0307-4A73-A473-B749ABF87367.ref@yahoo.com> <2DCC0132-0307-4A73-A473-B749ABF87367@yahoo.com> <1aaeafcc-9812-64bd-a369-bae7b9fc0e5f@gwdg.de> <422DBC3B-D85F-4AFB-ABDE-842A08482EC8@yahoo.com> <58250d08-ce0a-c1ac-ed15-7d55d517218e@gwdg.de> <2ea168aa-3e0e-ee31-d4a3-82b4ce46b330@gwdg.de> <78c1497b-1ec7-08b6-a407-d671e3c4f9dd@gwdg.de> <44201182-73C9-46BC-A846-7DC765F5B81F@yahoo.com> To: Kevin Oberman X-Mailer: Apple Mail (2.3731.600.7) X-Rspamd-Queue-Id: 4R14CG2pxwz3Dfc X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Jul 11, 2023, at 21:05, Kevin Oberman wrote: > On Tue, Jul 11, 2023 at 1:10=E2=80=AFPM Mark Millard = wrote: > On Jul 11, 2023, at 12:57, Kevin Oberman wrote: >=20 > > On Mon, Jul 10, 2023 at 9:42=E2=80=AFPM Mark Millard = wrote: > > On Jul 10, 2023, at 21:27, Rainer Hurling wrote: > >=20 > > > As I understand it, the ports-mgmt/pkg of the system running = Poudriere must be updated beforehand? > > >=20 > > > At least on my side, this seems to work as expected :) > > >=20 > >=20 > > poudriere builds pkg updates first (if needed) and then uses the pkg = it > > built for building the later ports into packages. > >=20 > > But, after the restarts of main-* builds, the FreeBSD build servers = are > > still showing examples were, after an 1hr, some builds are still in > > build-depends. Also there was an example I saw were after 1.5 hr it = was > > still in run-depends. > >=20 > > It may be that things are improved but not fully fixed relative to > > some performance issues. > >=20 > > =3D=3D=3D > > Mark Millard > > marklmi at yahoo.com > > A new build started this morning at 1:06 UTC and, with pkg-1.20.2, = it's better, but not much. It's running at 21 packages/hour, a 100% = improvement on the last attempt which appears to have been killed last = night. The logs indicate the installation of dependencies, but I don't = see any sign of caching. It's a re-install every time. (I may not = understand how poudriere does things, but I am pretty sure that caching = is done.) >=20 > Just about "caching" relative to "poudriere bulk" builds . . . >=20 > Nope. At the end of a builder run of a port build the context is = destroyed. > At the start of the builder building its next port the context is = recreated > from scratch. The only ports installed are exactly the declared = dependencies, > no more, no less, for the new port to be built. >=20 > Caching installed state would imply access to ports from prior build > activity that do not apply: It would make the build environment = polluted with > irrelevant history. poudriere's purpose is to have a "clean-room" = context for > each port build. Thus its construction of such a context for each port = build. >=20 > Caching vs. not is not the source of the large increase in how long = things > take to build. >=20 > =3D=3D=3D > Mark Millard > marklmi at yahoo.com > OK. I knew it started in a clean jail. I just thought that it might = use some caching technique to speed repeated installs of a single = port... not that I have any idea of how this might be done. >=20 > I think I'll monitor the speed of installs. I iish build logs included = timestamps FYI: Freshports now shows a pkg 1.20.3 described with: pkg*: new regression fixes release Changes: - speed up pkg add again, and greatly reduce its memory footprint - more compatibility with libfetch (SSL_* variables) - fixed FETCH_TIMEOUT adaptation to libcurl Looks to have been committed about 16 hr ago. Last I looked the official package builders had not been stopped and restarted with a newer ports tree yet. =3D=3D=3D Mark Millard marklmi at yahoo.com