MASTER_SITE quality of emulation@, freebsd-emulation@ ports

Tue Mar 1 10:36:09 UTC 2011

Quoting Emanuel Haupt <ehaupt at FreeBSD.org> (from Tue, 1 Mar 2011  
10:06:45 +0100):

> Alexander Leidinger <Alexander at leidinger.net> wrote:
>> Quoting Emanuel Haupt <ehaupt at FreeBSD.org> (from Mon, 28 Feb 2011
>> 10:15:41 +0100):
>>
>> > Alexander Leidinger <Alexander at leidinger.net> wrote:
>> >> Quoting Emanuel Haupt <ehaupt at FreeBSD.org> (from Sat, 26 Feb 2011
>> >> 12:58:14 +0100):
>> >>
>> >> > The distilator [1] shows that roughly 97% by a total of109969 all
>> >> > referenced distfiles fail to download. Resulting in countless
>> >> > timeouts.
>> >> >
>> >> > Excerpt from the most recent run:
>> >> >
>> >> > Maintainer                      ok      bad     % bad
>> >> > emulation at FreeBSD.org           1005    45696   97.85%
>> >> > freebsd-emulation at FreeBSD.org   1691    61577   97.33%
>> >>
>> >> > Ideas?
>> >>
>> >> Would it help to change the order of the master site list? I assume
>> >> that there are some which have everything.
>> >
>> > Unfortunately that wouldn't be much help to people who use
>> > MASTER_SORT.
>>
>> Yes.
>>
>> > I believe the best way would be to cleanup Mk/bsd.sites.mk. In
>> > particular MASTER_SITE_FEDORA_LINUX.
>>
>> I plan to have a look at a more recent linux distribution for our
>> linux_base. If I get the time, and if it will be fedora based
>> (probably it will, as it may make the update a little bit more
>> easy), this may mean the list will go back to what it was...
>>
>> > ports-mgmt/distilator can help identifying those sites. For
>> > instance:
>> >
>> > $ distilator /usr/ports/emulators/linux_base-f10/
>> >
>> > Result:
>> > http://people.freebsd.org/~ehaupt/misc/linux_base-f10-distilator.log.gz
>> >
>> > A quick check would suggests to only keep:
>> > $ zcat linux_base-f10-distilator.log.gz  | grep ^200 | awk '{print
>> > $3}' \
>> > 	| perl -e 'use URI; while(<>) { chomp(); $u=URI->new($_);
>> > 	| print
>> > $u->host . "\n"; }' \
>> > 	| sort | uniq
>> >
>> > archives.fedoraproject.org
>> > ftp.quicknet.nl
>> > ftp.rhd.ru
>> > ftp.udl.es
>> > mirror.steadfast.net
>> >
>> > ...but reducing MASTER_SITE_FEDORA_LINUX to those hosts shows that
>> > not even those
>> > mirrors are consistent. Hence my prior suggestion to get a complete
>>
>> :(
>>
>> > set of all distfiles
>> > needed by ports using MASTER_SITE_FEDORA_LINUX and mirror those on
>> > reliable mirrors.
>>
>> Should be easy to do (if a mirror is available).
>>
>> > I can assume that task if that's fine with emulation@ :-)
>>
>> I am fine with this. I try to deprecate the linux*f[6789]* ports
>> this week (I have to make up my mind if it will be one or two months
>> of grace time). If you just spend the time to have a look at the fc4
>> and f10 ones, everything should arrive at a sane situation after the
>> expiration date.
>
> Ok, I think I'll look into it. I might wait until you're trough with
> expiring the said ports.

It's up to you to wait or not, but with the following you can download  
the relevant (official linux infrastructure for 7.x and 8.x without  
the deprecated ones) distfiles directly:
---snip---
export DISTDIR=/path/to/dir

cd /usr/ports/emulation/linux_base-fc4 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/emulation/linux_base-f10 ; PACKAGE_BUILDING=yes make fetch

cd /usr/ports/accessibility/linux-f10-atk ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/archivers/linux-f10-ucl ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/archivers/linux-f10-upx ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-alsa-lib ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-arts ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-esound ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-freealut ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-libaudiofile ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-libogg ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-libvorbis ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-mikmod ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-nas-libs ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-openal ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-f10-sdl_mixer ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/databases/linux-f10-sqlite3 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-allegro ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-dbus-glib ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-dbus-libs ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-libglade ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-libglade2 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-libsigc++20 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-nspr ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-f10-sdl12 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/ftp/linux-f10-curl ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-cairo ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-dri ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-gdk-pixbuf ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-imlib ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-jpeg ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-libGLU ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-libmng ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-png ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-png10 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-sdl_image ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-tiff ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-f10-ungif ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/lang/linux-f10-libg2c ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/lang/linux-f10-tcl85 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/multimedia/linux-f10-libtheora ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/net/linux-f10-openldap ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/security/linux-f10-cyrus-sasl2 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/security/linux-f10-libssh2 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/security/linux-f10-nss ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/security/linux-f10-openssl ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-f10-aspell ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-f10-expat ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-f10-libxml ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-f10-libxml2 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-f10-scim-gtk ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-f10-scim-libs ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11/linux-f10-xorg-libs ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-fonts/linux-f10-fontconfig ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-themes/linux-f10-hicolor-icon-theme ;  
PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-f10-gtk ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-f10-gtk2 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-f10-openmotif ; PACKAGE_BUILDING=yes  
make fetch
cd /usr/ports/x11-toolkits/linux-f10-pango ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-f10-qt33 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-f10-tk85 ; PACKAGE_BUILDING=yes make fetch

cd /usr/ports/accessibility/linux-atk ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-esound ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-libaudiofile ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/audio/linux-nas-libs ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-allegro ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-libglade ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-libsigc++20 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/devel/linux-sdl12 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-imlib ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-jpeg ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-png ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-png10 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/graphics/linux-tiff ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/lang/linux-libg2c ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/sysutils/linux-procps ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-expat ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/textproc/linux-libxml ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11/linux-xorg-libs ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-fonts/linux-fontconfig ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-gtk ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-gtk2 ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-openmotif ; PACKAGE_BUILDING=yes make fetch
cd /usr/ports/x11-toolkits/linux-pango ; PACKAGE_BUILDING=yes make fetch
---snip---

Bye,
Alexander.

-- 
A vacuum is a hell of a lot better
than some of the stuff that nature replaces it with.
		-- Tennessee Williams

http://www.Leidinger.net    Alexander @ Leidinger.net: PGP ID = B0063FE7
http://www.FreeBSD.org       netchild @ FreeBSD.org  : PGP ID = 72077137