From nobody Tue Apr 08 19:06:22 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZXFtX1Rjpz5snTh for ; Tue, 08 Apr 2025 19:06:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic312-24.consmr.mail.gq1.yahoo.com (sonic312-24.consmr.mail.gq1.yahoo.com [98.137.69.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZXFtV6fW4z3m1T for ; Tue, 08 Apr 2025 19:06:42 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=QrhEsOUy; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.205 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1744139196; bh=sLZ/IXobYuU2CcBNUywl0D/OZorR/q0GcgQ1KV1V1w0=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=QrhEsOUybxJLp6XvLwAH0FyJicFccMM+1UPT9xylmipsN9WJLVBcCTB5V1qt+bPYmPllqxrWTCXXxjy4DBPASNA75FnX1AuyiSCGaKz9L+eLDQDUOJeQphvLE+CY7Uz/w7xDDLWF7aMUH3j+m8rvm0eoxM9kHhzycce5D/fIKwibxr+zpfA8om9mmguqXEFmHyJzdXBKJj3F6H8HIPpYA294wV02Q9zgUxguQ4DZWzT1x1WSalfxOm0eC15UxuVW63Azia1B5MmEkivXScwQcOPvF7LmelLdHFIPI/bVZeorYAJvDRkqA4gJimWcynPGzjV9c8lP4KHgVnZR2yqVhA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1744139196; bh=tRzKWydn7undFAPjrOSEiSj2Feoq/5dMQktRFrNkzkX=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=e4O1Yn/IsLV0Hj2njX+z6tKdHP4kXUSqqv3jpp61YoeRBRURFuRUYp7Kn3C9KwNXhIh43K7Yq+uNAxLYItj5US3SxKA1XjSgaTD0qE22iaQHo64LND9h23aft92qGSOrJWtPPUs0it70mNGqdbkhFJo2ydqpXSACCFY8DWN7Ora3i7iGkPYizlh+G51S0mOXGUyQQX/ByP/aFC1TvAMPnpG/K08lkBz8fYdNm0f3wPSELgAwHg2yyFzjzoYGjyQK5Ylfwr1N/m4h3X9EwdhcfFevPErOaE+3q5J+i4gl3mU5V4gRFBQeSuT2ZFTsXgLGkMqQYicGyOA7BFTns8cLGg== X-YMail-OSG: NUTwzUMVM1mhCpTvI8zez6V5325SIBfUysf86I7qQef73VkMSAymvOhJC2kxZg8 aNQ1vkSYbV48Q86NiHM_SX_ppLzDEGMIgijQXYfDrvtMUKBQzKh1BMZpa4BpZRuDntm_LzF5ErAL j0IdeMAlbG04NVv_xvImuIBnQoJ5zS6fKcfnhsoZ9EcbXrN9SvD27OYPVhX2YbCJIJnaSQiLVj5q 1bW1icW6gUrAjKoa4u0SAzxW3ioibhbNnZvBqMfcbkCqqICfETw.CZrvV42qdbk539JA_XBGbaHL 5gxvsuiU3r2z9sxDiwrOMXg0cgm7IanGylFpT2_6S8vI5iQM7IqpA9hJgfr1TzO8m5PZQybbTaOW tEEd18v1QDEBVj.x3mV_likngDLIuA03boGiqYSEkZVG1GjSSWsfEvcda.uucfNw99.z6j3Q50Q8 6rtiB2LSl.S.0NZ6JeF5jSr0eQJ8VoFcSR_.SK8ODf6JF1ujeJhPb8u9zV4gxhzKq7ln3uSTuAUV 892sgNVvlZDbGqSIMvofx0Vu06VlRddtpT3EUzn9kvd.Wrt2U_XvLbZlqxj6AwVP.0wRdQKz_ubu gTtJzNJl6JMw.9CTQ3VYl_cGDRroxU8WqDqI1TLB5w1uSQThRRzB6H6gNcEudg7KFSy6Yel58YsS d5XmzrZzKYobMuYKFjySor1p7oUEeyTdgY2nCF6tgT3YuNgz6u7c4ub652qsZgMq.BjVLQyMssYS XRiQDQ7V4vgi24VAhKle8wdnjskt3IMVr_TcL9p822Ql5GLGaqYgZEEREhUnb_zgnCi_lE8PZkAn ..lOZxgB.ynE8_V68o5xtXKsCqLysxZwRpoTQn_BBLW3LEkUnRaZ9d4t4AVziCk1qrgrSUUlSEAU EPKC82I2Tfr61M.Y0V1xMYEJaF5XG7I7Xfaub2ArKp_wfeI70TU5aYzcewR2TQlZlt7oIn0Va0vY JcOyKIm9UZDgTVJWtAPwX1g5mcioPMa4mhm4__EooyVJ21qm4yZlI9qeuE7SimRrYXOgeWgoPXlj jLxKzRN6tfUZCr04jpcUGuyxwvKtHAYkh5ksaEH1LvbycEG8XuY1JBunNfGkqPeRmG_Qs6AqFctJ 6mj9WI8kf2HK_Q_WvJy3J7sIi0oTZbf47X5n9lSKeYn56s4gy3hv.v1E5yA3nRUxkNjbZeKR3ne3 0roLgp._cW8l1KMAucdi7lzlqC6tK8H0e5UEug_uPjqVfZTOChrjg1RmVMo.nwbLrSfNO.a3wx0C USr.8IovVBxgB6.VphHTP0SqVy79aroR7e6LbzVR22Vuwaa7eKF1xTpptl8WOUY3JJAeHCZhWwrv .6JLKlqB1GCXNaLGbBDJ3XbNq3L6Hs_Ox5Hgzie9l0mET28DbIY.JqP07ZUNHIF2dT8a.yEUQyY8 UJme.L5PNPQIMogEMq.Cbu8XGeYMw7vknE_oqrcn7euaErK9fx8zLyPw7YGhDhJJURM80jTDwY3Q 1GxnHbK8mDfQV8bjRvebpq8eZ414ZjnsjBg8SEXWzk0PQCdidsfC0SyK5vIghG5CAqKvOCvH6T7Q B6MZcC2Dir7pxB3zlbfLEXmKr2Y6ck8IEB2oLsbWsxSoZr7mb1qVDyVb.rjs2cY3UJD5ngf8I1QQ 2RFOK83Zj8vE8362PvSnnp9jRy9_q7MSk5EbsI0gU04x.Lx0LH2umIOV29Zg3Upms.k2gkdmFuor vw0YCY819sP38Dget.LWFRAlQq.U9sZ4cx75IEjHe.2zXQ907rM1I2Nw2MIg99LGw7lYLVJFwlTP bP9UDEPEay.2ay28me32yVJf5pIgjMpNKpTlym3pgGbNTXc8kg19ZF9lIISBvtpbuJstAE9CWcd4 Y_tNCq_MCsSYeJbXxCNtycGpHvxEfdJYxlTGd7WRgz.G80aS5EHjLCWkH3RWvxw.sXxzuohSPA4f DOJ5ahnyHjhOCvt40l6G2_n6GJawqieg2F4E1TgmPfOfFQ_gRUem3G2bbGkvYMZ6daBIpMf4DXaC eNAUpDMOY01B6.BLc_.QSAOlvYG_dH9iC33h.Tq4_UiaPUa.mspXcw2EjmUpMW5RXhOwXdvOvUHp atQSKnxK1LS_5iWrG63FVpAkzTaH_SwENEIVfB.vmNTnZ8Cf8UJVO9iQ84Gzd57sjrCjxb8IEckh qBYbFPdT.hhXETvSW5faSUp_sRFjTq3.gdjA73RxgutVI3P6azki4Xp4RO0YOFtNEHaBT5HjCIBp 0rcSyFQ3sQgciHkOCZZYOs3BY1LFSTTffkcEFf19vCQ2bqx2pB1rqJA0bZ_At.E1OFOc9t2o979A X_Z7Wy__J X-Sonic-MF: X-Sonic-ID: a1fb684f-d8ed-4b66-be26-d2232d8a8650 Received: from sonic.gate.mail.ne1.yahoo.com by sonic312.consmr.mail.gq1.yahoo.com with HTTP; Tue, 8 Apr 2025 19:06:36 +0000 Received: by hermes--production-gq1-6f8bfcd964-2cf6n (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID dd30d9c380f444576be1fd3cd50a1003; Tue, 08 Apr 2025 19:06:33 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3826.500.181.1.5\)) Subject: Re: UPDATE: pkg 2.1.0 looks to be making official bulk builds of packages take much longer [Just notes based on various official www/gitlab@ee and @ce build times] From: Mark Millard In-Reply-To: <178AD8CD-57F2-4ADB-AE82-6B0C7A4D2C01@yahoo.com> Date: Tue, 8 Apr 2025 12:06:22 -0700 Cc: Gleb Popov <6yearold@gmail.com>, FreeBSD Current , FreeBSD Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: References: <8E2FBAD3-EF6F-4D99-A340-21F8FD19AE0F@yahoo.com> <84FBBAF8-025E-4B9D-9797-51735567A8DB@yahoo.com> <366E27FD-FA5B-4BF8-B6C4-6C495DB289C5@yahoo.com> <7ziazrj7szuqhov3oppjbh3jyu3f2p2owntv4oxprelrdjzc6u@hkuf5szf3zwy> <0414EBFB-B63A-4738-ADB0-38B6CF3725DA@yahoo.com> <05128806-8F20-43A6-946B-A3780259F61A@yahoo.com> <178AD8CD-57F2-4ADB-AE82-6B0C7A4D2C01@yahoo.com> To: Baptiste Daroussin , Konstantin Belousov X-Mailer: Apple Mail (2.3826.500.181.1.5) X-Spamd-Result: default: False [-4.06 / 15.00]; RBL_SENDERSCORE_REPUT_9(-1.00)[98.137.69.205:from]; NEURAL_HAM_LONG(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.95)[-0.954]; NEURAL_HAM_SHORT(-0.61)[-0.606]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_FROM(0.00)[yahoo.com]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.205:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.205:from]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_FIVE(0.00)[5] X-Rspamd-Queue-Id: 4ZXFtV6fW4z3m1T X-Spamd-Bar: ---- The below indicates that whatever is taking the extra time is not strongly tied to processor performance. www/gitlab@ee and www/gitlab@ce turn out to be good for seeing larger scale elapsed time multiplication factors. That allows seeing this. I'll note that when, for example, www/gitlab@ee is built with no other builders active, the large multiplication factor has not happened in my experiments. Based on pkg 2.1.0 use on official package builder machines (so longer than normal times but noting pre-2.1.0 example times as well): ....... @ee @ce @ee @ce beefy13: 01:54:17 01:26:19 (pre: 00:07:36 00:06:24) beefy14: 02:01:45 01:17:36 (pre: 00:07:59 00:06:48) beefy15: ??:??:?? 02:00:48 beefy15: 02:28:31 02:18:46 (pre: 00:09:23 00:07:43) (yes: 2nd 2.1.0 run = on 15) beefy16: 02:35:53 03:00:42 (pre: 00:08:49 00:06:55) beefy17: 05:35:01 03:32:05 (pre: 00:09:40 00:07:24) beefy18: 04:18:07 02:33:34 (pre: 00:08:01 00:06:48) beefy19: 01:02:46 00:38:10 (pre: 00:08:21 00:05:53) New, much faster machines: beefy20: ??:??:?? ??:??:?? (pre: 00:04:52 00:04:19) beefy21: 01:56:01 01:31:49 beefy21: 01:39:27 00:38:49 beefy21: 02:02:59 01:50:03 (pre: 00:08:27 00:06:43) (yes: 3rd 2.1.0 run = on 21) beefy22: 02:15:04 02:14:47 (pre: 00:06:47 00:05:38) aarch64, slower machines (Also: no armv7 examples): ampere1: ??:??:?? ??:??:?? (pre: 00:13:38 00:12:24) ampere2: ??:??:?? ??:??:?? (pre: 00:13:47 00:16:49) ampere3: ??:??:?? 03:34:43 (pre: 00:23:32 00:09:41) Some beefy21 examples are rather similar to some for beefy13 and beefy19 examples. But there is also wide variability in how large the large timings are, even for more more similar machines --or so I would guess since I do not have information about the machines beyond beefy20 and beefy21 and beefy22 being rather new and much faster. That also points to something not tracking processor performance or the like. It also does not track the number of cpus: beefy20, beefy21, and beefy22 having far more. Near live-lock conditions or contention issues? Something else? I do not know which official build machines run debug kernels vs. non-debug ones (15000??). Any idea how someone with access could find out what the issue is during official builds? =3D=3D=3D Mark Millard marklmi at yahoo.com