MASTER_SITE quality of emulation@, freebsd-emulation@ ports

Emanuel Haupt ehaupt at FreeBSD.org
Mon Feb 28 09:15:44 UTC 2011


Alexander Leidinger <Alexander at leidinger.net> wrote:
> Quoting Emanuel Haupt <ehaupt at FreeBSD.org> (from Sat, 26 Feb 2011  
> 12:58:14 +0100):
> 
> > The distilator [1] shows that roughly 97% by a total of109969 all
> > referenced distfiles fail to download. Resulting in countless
> > timeouts.
> >
> > Excerpt from the most recent run:
> >
> > Maintainer                      ok      bad     % bad
> > emulation at FreeBSD.org           1005    45696   97.85%
> > freebsd-emulation at FreeBSD.org   1691    61577   97.33%
> 
> > Ideas?
> 
> Would it help to change the order of the master site list? I assume  
> that there are some which have everything.

Unfortunately that wouldn't be much help to people who use MASTER_SORT.
I believe the best way would be to cleanup Mk/bsd.sites.mk. In
particular MASTER_SITE_FEDORA_LINUX.

ports-mgmt/distilator can help identifying those sites. For instance:

$ distilator /usr/ports/emulators/linux_base-f10/

Result:
http://people.freebsd.org/~ehaupt/misc/linux_base-f10-distilator.log.gz

A quick check would suggests to only keep:
$ zcat linux_base-f10-distilator.log.gz  | grep ^200 | awk '{print $3}' \
	| perl -e 'use URI; while(<>) { chomp(); $u=URI->new($_); print $u->host . "\n"; }' \
	| sort | uniq

archives.fedoraproject.org
ftp.quicknet.nl
ftp.rhd.ru
ftp.udl.es
mirror.steadfast.net

...but reducing MASTER_SITE_FEDORA_LINUX to those hosts shows that not even those
mirrors are consistent. Hence my prior suggestion to get a complete set of all distfiles
needed by ports using MASTER_SITE_FEDORA_LINUX and mirror those on reliable mirrors.

I can assume that task if that's fine with emulation@ :-)

Emanuel


More information about the freebsd-emulation mailing list