From nobody Tue Dec 12 09:15:23 2023 X-Original-To: freebsd-pkg@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SqCdB2TPSz53gcH; Tue, 12 Dec 2023 09:15:26 +0000 (UTC) (envelope-from bapt@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SqCdB20kvz3CPs; Tue, 12 Dec 2023 09:15:26 +0000 (UTC) (envelope-from bapt@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702372526; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=CPEYHylTGb+ZAHROVX0a78WnC/FIRuOZ6Qpg3Ze4ckE=; b=a4NKo2V71SkQ+Pysa21yOVs3KjuobFcn0ywVIw1TEZmo2A9YH14wLGCHA8N7seiwivcY5p 1SblUPgVJDP1Kjpg/8jays2OclYtZo6L0OGZHLWBajymZAOApgrn/ue7Wi2YhZyGUbP5yG g5vfocAlMDFmZ41ZoM7FTQes0FE3LBlDiSCdVl0LtVcMCJmxhpqX4dR3X4WroJDdhKoTm3 YnWbnK+6rmTaxEbY+GdGcqAIkdXnPzhc6JJwHbq+nTax/rC79y4LayY4cspp4n04ESo73F eUVca0/8x+PbaxdMseyltevs006EpodWwQ10WoDDAXaQFPQzzU9ftYapp8/7jQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702372526; a=rsa-sha256; cv=none; b=v2xnwIXDMFdUEMhq5ChIPiFYcQW4rYp7jrkwJnHzrRphDpFbSE/g+WhwUtcispHWtyVjSe 2FUmeo2VdrKGYM5HNZo8qeCOggwacDG7dMEs6itwRt08Po4DQpxRMyP6nfzic+g4ufAqFn k4YgpXK6Lo8xwtdCQqCG80PAdyHNdr0vwVSBdwghT68IkzxLh7b7hsQvrwXpDSFTgEM+Ux aB1vlFwaqJeiG7xFBZJyzw5mN9e2Qp/SWefR9HPWhR4h1xJ40sfjou0w7ocbPb0RO38410 PQmA916OZnNzEOlqGt6pdYmMWfW7yce+gZCajS2XYjaue4MRDNaMPjVckG451Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702372526; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=CPEYHylTGb+ZAHROVX0a78WnC/FIRuOZ6Qpg3Ze4ckE=; b=nU5ZAWbTwysBjtpMzZ6zMnsfv7jrGHS284w6jjgcWEBVPUTR3HbKJ6+YEFbWGz6hlaAwSt BQqdIKVY8UC+23oobqa6DDpgjOyGlHh5vn8E1XNhaVr7hjLq73GS5mbA1W0HDujOF16g0d ZxNjw0SAXBneNCkj8cE1N0LNRRgtRcYf3bf1qSRJ0xavPxqCbzQNeaXnbw3b34sXyjAVvn d68HJbqKQZUlcfW83cHwH9DoSCRGpM7Yj5BA0i2PcdYrBLWSVI9pmxDZBDkU6cP5JzF3g4 wRcHQAKftBMLSRTDonjGkXOdEY8ItZd5doU8nZWmlIqluKVa9e+91eE9wtY3PQ== Received: from aniel.nours.eu (nours.eu [176.31.115.77]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: bapt) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SqCdB0G60zD5g; Tue, 12 Dec 2023 09:15:26 +0000 (UTC) (envelope-from bapt@freebsd.org) Received: by aniel.nours.eu (Postfix, from userid 1001) id 42355FE666; Tue, 12 Dec 2023 10:15:23 +0100 (CET) Date: Tue, 12 Dec 2023 10:15:23 +0100 From: Baptiste Daroussin To: Pat Maddox Cc: freebsd-pkg@freebsd.org, User Questions Subject: Re: poudriere: Any way to re-use built packages across sets? Message-ID: <6hfy5n2adgcmzstqktwbmv56xvkrc5w7skoog3tcexvivdwnvz@whyo4fyw3p3u> References: <0ee5ccf5-31af-4f7a-95da-0f27d59f2259@app.fastmail.com> List-Id: Binary package management and package tools discussion List-Archive: https://lists.freebsd.org/archives/freebsd-pkg List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkg@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <0ee5ccf5-31af-4f7a-95da-0f27d59f2259@app.fastmail.com> On Tue, Dec 12, 2023 at 01:00:33AM -0800, Pat Maddox wrote: > I want to build two package repos: 1) the vanilla ports tree 2) ports tree + my overlay > > The commands I use are: > > poudriere bulk -p main -j 132amd64 -b latest > > and > > poudriere bulk -z maintain -j 132amd64 -p main -O maintain -b latest > > Which produces /usr/local/poudriere/data/packages/132amd64-main and /usr/local/poudriere/data/packages/132amd64-main-maintain. > > The problem is, the second command spends a lot of time re-building the same things (gcc, llvm, rust, etc) as the first. `-b` isn't particularly useful because I'm using a current ports tree, so I need to build a lot of packages at least once. > > I'd like to have the second command re-use the packages built by the first command where possible. > > Here are some things I tried: > > 1. -b file:///usr/local/.../132amd64-main - doesn't work because the jail can't access that path, which makes sense > 2. serving packages via nginx, and passing the url as -b - doesn't work because FreeBSD.conf sets mirror_type=srv and signature_type=fingerprints > 3. modifying the jail's FreeBSD.conf file directly - fails with "pkg: Error fetching http://localhost:8181/132amd64-main/Latest/pkg.pkg.sig: Not Found A pre-built version of pkg could not be found for your system." > > Is there a way to have poudriere build two separate package repos (one named with the set) where one uses pre-built packages from the first repo if possible? > No it is not possible, yes this would be really great, this is a good feature request for poudriere, the TOTO is long, in poudriere! I will try to not forget about this proposal. Bapt