package distribution crisis - CDN needed
pav at FreeBSD.org
Tue Apr 8 08:49:58 UTC 2008
Eberhard Moenkeberg píše v út 08. 04. 2008 v 01:54 +0200:
> > > I do propose a creation of a CDN (Content Delivery Network), having these
> > > features:
> > The success of a CDN is premised on the working set of active files being
> > [significantly] smaller than the set of available files. While I don't doubt
> > that only a few packages are of interest to most users, for a CDN to provide a
> > real benefit it needs to be the case that no users require most files. The
> > reason being that, if you have to transfer all or even most files every time,
> > a CDN may well be a significantly less efficient way to do it than rsync. Has
> > a working set analysis for our main mirrors been done that demonstrates that
> > the actual working set is sufficiently smaller than the total set that a CDN
> > would be more, rather than less, efficient?
I don't have these statistics, but I'd like to see them very much.
Can I ask some of the mirror admins to compile me statistics on
downloads of files from /pub/FreeBSD/ports/*packages*, say for March
I'd also like to have these numbers from ftp.FreeBSD.org so I have a
comparision of volume.
My suspicion is that 99% of users get their packages from
ftp.FreeBSD.org, because that's what pkg_add -r uses without PACKAGEROOT
> Maybe it is interesting for you to have a look at
> The SUSE team has a redirection mechanism at work on single file basis,
> and they also have experienced that it would be "enough" for the users if
> there are lots of mirrors with the "most requested" files plus some
> mirrors with all files.
Now this looks so much better and easier than my CDN idea! We could use
it practically as-is.
We will need to patch pkg_install to use http://redirector.FreeBSD.org/
instead of ftp://ftp.FreeBSD.org/
Pav Lucistnik <pav at oook.cz>
<pav at FreeBSD.org>
Logitech is infamous for providing 30 MB compressed driver software
packages that install a bunch of crap applications on the system and
round up the number of icons in the tray to the nearest power of two.
-- Michael Stromberg
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Size: 195 bytes
Desc: Toto je =?UTF-8?Q?digit=C3=A1ln=C4=9B?=
Url : http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20080408/bfe62618/attachment.pgp
More information about the freebsd-hubs