From nobody Tue Jan 02 15:46:26 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T4HK45KJPz55h03 for ; Tue, 2 Jan 2024 15:46:48 +0000 (UTC) (envelope-from dan@langille.org) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T4HK44s4zz3Nx8; Tue, 2 Jan 2024 15:46:48 +0000 (UTC) (envelope-from dan@langille.org) Authentication-Results: mx1.freebsd.org; none Received: from compute7.internal (compute7.nyi.internal [10.202.2.48]) by mailout.nyi.internal (Postfix) with ESMTP id 033955C01D2; Tue, 2 Jan 2024 10:46:48 -0500 (EST) Received: from imap42 ([10.202.2.92]) by compute7.internal (MEProxy); Tue, 02 Jan 2024 10:46:48 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm2; t=1704210407; x=1704296807; bh=7zLV0ITdZ2V1NahXzash1AOfTJOlvdMEIY3XkP0seYE=; b= GMMgTmtj2OU7FPeDK/wl8f9mtKg2hYkYeaOHC5eFRvb18uSWpwInFF2++Y/Wkcw4 XgVQ9hVDC9GLpFWkM+5Dfhen/1GJ1IJmqaA2U5LcOEKaE5cZ2JNG8na67YDVRh8s hO7GPbUe/ZeLNfOuCbFXoxs6nXZOaHcn7ptD3XXTxhGD3vi0rwrhzWgYBlZK5avE ibnuzaUzNHd84GLafaj81JD6hGdzb7fuphuqrBYFbAEHyzYNL9oaYzyt0wb0DTJI BpGONOY3QlzM+Sh63VyvSmo2ilRNXFD3pvVKmst39c9Tgxgopnjkmzx73wHURnJ4 Z42TVtJphLbwMcwCSvXHOQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1704210407; x= 1704296807; bh=7zLV0ITdZ2V1NahXzash1AOfTJOlvdMEIY3XkP0seYE=; b=g 5fYdp4Of80wEDhVgJaRgsPWcGN60DlMDtOs6Sdy3HMyCEeLrMxyjos48K/oy/v7t M9rWASoBiySgDok1Mmot2sGcPqHj+MepzwSPvuQRQrx0FJ0faFDRbnVDZXuTNbJt 9sOPJ1rO1QiVfBi12fn/4PAnFajzP+eYaoSG0ejB+3ueHlS8kvHIoWFVuYHGa1Ie iGuprVcGKMy8JmC915LywWz7NrLXfttXUVNlDoaVf3Rsx1Z3WNvI0tzeU5XVJi0X 7f6WFyKRwhHxg4VbSYuV7eHb1MslchC13vu3OWil/7egPb2ytbqvL03sWCB+tkJa kLeSsxXcaDeR54U89ax+w== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrvdegfedgudduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhepofgfggfkjghffffhvfevufgtgfesthhqredtreerjeenucfhrhhomhepfdff rghnucfnrghnghhilhhlvgdfuceouggrnheslhgrnhhgihhllhgvrdhorhhgqeenucggtf frrghtthgvrhhnpedvieeuhfdujeeigedtfedvgfelieefuedvjedtgfelheeileduteek tdevfefhveenucffohhmrghinhepuggrnhgprghtpghlrghnghhilhhlvgdrohhrghdpfh hrvggvsghsugdrohhrghdpghhithhhuhgsrdgtohhmnecuvehluhhsthgvrhfuihiivgep tdenucfrrghrrghmpehmrghilhhfrhhomhepuggrnheslhgrnhhgihhllhgvrdhorhhg X-ME-Proxy: Feedback-ID: ifbf9424e:Fastmail Received: by mailuser.nyi.internal (Postfix, from userid 501) id B5C95BC007E; Tue, 2 Jan 2024 10:46:47 -0500 (EST) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.9.0-alpha0-1364-ga51d5fd3b7-fm-20231219.001-ga51d5fd3 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 Message-Id: In-Reply-To: References: Date: Tue, 02 Jan 2024 10:46:26 -0500 From: "Dan Langille" To: "Philip Paeps" , "Mark Millard" Cc: "FreeBSD Hackers" Subject: Re: list of valid ABI combinations Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4T4HK44s4zz3Nx8 On Tue, Jan 2, 2024, at 12:45 AM, Philip Paeps wrote: > On 2024-01-02 12:38:47 (+0800), Mark Millard wrote: >> [FYI: My internet access is limited to a cellphone for some number of=20 >> days.] >> >>> On Jan 1, 2024, at 19:26, Philip Paeps wrote: >>> >>> =EF=BB=BFOn 2023-12-07 23:03:33 (+0800), Mark Millard wrote: >>>> Dan Langille wrote: >>>>> My goal is to automatically maintain this table, from which=20 >>>>> FreshPorts fetches package information: >>>>> >>>>> freshports.dev=3D# select * from abi order by name; >>>>> id | name | active >>>>> ----+----------------------+-------- >>>>> 9 | FreeBSD:12:aarch64 | t >>>>> [...] >>>>> 53 | FreeBSD:15:riscv64 | t >>>>> (31 rows) >>>> >>>> The name list in the middle (/bin/sh context): >>>> >>>> # fetch https://pkg.freebsd.org/index.html >>>> index.html 3606 B 103=20 >>>> MBps 00s >>>> >>>> # grep FreeBSD: index.html | sed -e 's@.*\(FreeBSD:[^ <]*\).*@\1@' = |=20 >>>> sort >>>> FreeBSD:12:aarch64 >>>> [...] >>>> FreeBSD:15:powerpc64le >>>> >>>> There might be issues at times with=20 >>>> https://pkg.freebsd.org/index.html not >>>> being in sync. As far as I can tell, that page is manually=20 >>>> maintained. >>> >>> clusteradm updates that page to match what we're actually=20 >>> distributing. If it doesn't reflect reality, that's a bug, and we'd=20 >>> like to know please. :-) >> >> Does that include the =E2=80=9Conly ??? Is updated=E2=80=9D sorts of = notes? > > Yes. Please let clusteradm know if the notes don't appear to reflect=20 > reality. > > clusteradm maintains the pkgsync infrastructure, which includes the=20 > index page on the mirrors. pkgmgr is responsible for scheduling the=20 > builds. (And ports committers are responsible for making sure package= s=20 > are even buildable). > >> For example, FreeBSD:13:armv6 Latest dates back to 2021-Jan-25 but=20 >> there is no note about quarterly only. Various FreeBSD:15:* do not=20 >> have notes about Latest only, despite having no quarterly at all. Som= e=20 >> other cases have notable but shorter differences in the Latest vs.=20 >> Quarterly time frames, suggesting only one is being updated but no=20 >> fixed difference is definitive for that status. > > The pkgsync infrastructure doesn't really care how often packages are=20 > updated. If memory serves, we first added a "quarterly only" note whe= n=20 > the thunderxX generation of aarch64 builders broke with distressing=20 > regularity. The ampereX builders are much more reliable. > > I think the current situation for armv6 is "updated irregularly". =20 > PowerPC is in the same boat as aarch64 in the ThunderX era: when the=20 > hardware works, packages are updated. > >> Dan=E2=80=99s activities with the page do not use such notes as far a= s I=20 >> know. > > Would it help if we added an easy to parse text file listing the ABIs=20 > we're currently distributing? That won't tell you anything about the=20 > build schedule, but it'll at least tell you what's live, without havin= g=20 > to parse HTML and hope we don't break it. I think this threads provides sufficient information for 'automatically = know the list of valid ABI' to proceed: https://github.com/FreshPorts/freshports/issues/508 Also, the (much appreciated-here) script provided by Mark on 2023-12-07 = still runs true after the removal of 12.4 from the build page. [15:42 empty dan ~/tmp] % fetch https://pkg.freebsd.org/index.html index.html 3068 B 37 MBps = 00s [15:42 empty dan ~/tmp] % grep FreeBSD: index.html | sed -e 's@.*\(FreeB= SD:[^ <]*\).*@\1@' | sort FreeBSD:13:aarch64 FreeBSD:13:amd64 FreeBSD:13:armv6 FreeBSD:13:armv7 FreeBSD:13:i386 FreeBSD:13:powerpc FreeBSD:13:powerpc64 FreeBSD:13:powerpc64le FreeBSD:14:aarch64 FreeBSD:14:amd64 FreeBSD:14:armv6 FreeBSD:14:armv7 FreeBSD:14:i386 FreeBSD:14:powerpc FreeBSD:14:powerpc64 FreeBSD:14:powerpc64le FreeBSD:15:aarch64 FreeBSD:15:amd64 FreeBSD:15:armv7 FreeBSD:15:powerpc FreeBSD:15:powerpc64 FreeBSD:15:powerpc64le [15:42 empty dan ~/tmp] %=20 FYI, the goal is for FreshPorts to fetch and display package information= only for the ABI listed by this script. Thank you --=20 Dan Langille dan@langille.org