parallel builds revisited
rnoland at 2hip.net
Thu Apr 12 15:46:54 UTC 2007
On Thu, 2007-04-12 at 05:43 +0200, Benjamin Lutz wrote:
> Hello Pav,
> On Tuesday 10 April 2007 19:44, Pav Lucistnik wrote:
> > Benjamin Lutz píše v út 10. 04. 2007 v 04:52 +0200:
> > > Some time ago, after buying a Core 2 Duo system, I've become
> > > interested in doing something about the inherent
> > > single-threadedness of the ports. Even though I have a dualcore
> > > machine, ports builds only ever use one core. I started thinking
> > > about various approaches to introduce parallelism to ports builds
> > > and wrote down my thoughts here:
> > > http://marc.info/?l=freebsd-ports&m=116124997126657&w=2
> > I have same thoughts, and I wrote about it on Project Ideas page.
> > That text materialized into a Summer of Code proposal, which is most
> > probably going to get funded. So stay tuned. However, the proposal
> > concentrates mainly on allowing several ports to build in parallel.
Have any of you looked at sysutils/bsdadminscripts, it's buildflags
options allow for parallel builds as well as ccache / distcc use. I
have a reasonable list of ports that must have some or all of these
options disabled as well.
> Is there any detailed information available on what's planned here that
> isn't in your description on SoC page?
> > Yes, a whitelist approach looks best.
> > > 3) Save this to /usr/local/etc/parallel_builds.conf:
> > > http://www.maxlor.com/temp/parallel_builds.conf .
> > > This is a list of ports as stored in PKGORIGIN, or as
> > > pkg_info -o reports them.
> > I was thinking about having it embedded in every port's Makefile
> > directly, instead. Something like
> > USE_MAKE_JOBS= 2
> Yes, that's what I had in mind as a final goal too. Having a single file
> whitelist is useful though, since you don't have to patch hundreds of
> makefiles while the whole thing is being tested and developed.
> > I have great interest in this development. This is a highly desirable
> > feature to have.
> Me too. Could you keep me in the loop on how the SoC project progresses?
> Seeing how that's concentrating on inter-port-parallelism, I think I'll
> continue to work on intra-port-parallelism for a bit.
More information about the freebsd-ports