From dimitar.vassilev at gmail.com  Tue Aug  5 04:14:09 2008
From: dimitar.vassilev at gmail.com (Dimitar Vasilev)
Date: Tue Aug  5 04:14:16 2008
Subject: bg.freebsd.org
Message-ID: <59adc1a0808042114g64706c21q4f08cb7687da5c6c@mail.gmail.com>

Hi all,
bg.freebsd.org is fully operational again: ftp/rsync/cvsup/www/dns et al.
I'm just waiting for snapshots, tools and updates to be synced.
Thanks to all who helped with time and tips.
Best regards,
Dimitar Vassilev
From danfe at nsu.ru  Thu Aug  7 10:56:04 2008
From: danfe at nsu.ru (Alexey Dokuchaev)
Date: Thu Aug  7 10:56:44 2008
Subject: ports/distfiles on FTP
Message-ID: <20080807103121.GA8415@regency.nsu.ru>

Hi there,

I've recent got interested in the fact that our ports/distfiles
directory on FTP contains zillion of out-dated (WRT current ports
versions they serve) tarballs and occupies more than 100GB of disk space.

Is there are any special reason we keep all those distfiles?  If not,
what is the algorithm of putting a distfile there?  Does it take care of
deleting previous versions?  Can it be improved?  I'm eager to provide
help/patches/etc.

./danfe
From kris at FreeBSD.org  Thu Aug  7 11:01:45 2008
From: kris at FreeBSD.org (Kris Kennaway)
Date: Thu Aug  7 11:01:51 2008
Subject: ports/distfiles on FTP
In-Reply-To: <20080807103121.GA8415@regency.nsu.ru>
References: <20080807103121.GA8415@regency.nsu.ru>
Message-ID: <489AD614.3010904@FreeBSD.org>

Alexey Dokuchaev wrote:
> Hi there,
> 
> I've recent got interested in the fact that our ports/distfiles
> directory on FTP contains zillion of out-dated (WRT current ports
> versions they serve) tarballs and occupies more than 100GB of disk space.
> 
> Is there are any special reason we keep all those distfiles?  If not,
> what is the algorithm of putting a distfile there?  Does it take care of
> deleting previous versions?  Can it be improved?  I'm eager to provide
> help/patches/etc.
> 
> ./danfe

We do not delete old distfiles because the space savings are marginal. 
There is value in retaining old distfiles, because they are often still 
needed even years later.

Kris
From wollman at bimajority.org  Thu Aug  7 13:40:42 2008
From: wollman at bimajority.org (Garrett Wollman)
Date: Thu Aug  7 13:40:47 2008
Subject: ports/distfiles on FTP
In-Reply-To: <489AD614.3010904@FreeBSD.org>
References: <20080807103121.GA8415@regency.nsu.ru>
	<489AD614.3010904@FreeBSD.org>
Message-ID: <18586.62597.988090.707524@hergotha.csail.mit.edu>

<<On Thu, 07 Aug 2008 13:01:40 +0200, Kris Kennaway <kris@freebsd.org> said:

> We do not delete old distfiles because the space savings are marginal. 
> There is value in retaining old distfiles, because they are often still 
> needed even years later.

There is also the issue of GPL compliance for the packages
(particularly the static package sets included with releases).

-GAWollman
From danfe at nsu.ru  Thu Aug  7 16:20:04 2008
From: danfe at nsu.ru (Alexey Dokuchaev)
Date: Thu Aug  7 16:20:21 2008
Subject: ports/distfiles on FTP
In-Reply-To: <18586.62597.988090.707524@hergotha.csail.mit.edu>
References: <20080807103121.GA8415@regency.nsu.ru>
	<489AD614.3010904@FreeBSD.org>
	<18586.62597.988090.707524@hergotha.csail.mit.edu>
Message-ID: <20080807162106.GA58873@regency.nsu.ru>

On Thu, Aug 07, 2008 at 09:11:33AM -0400, Garrett Wollman wrote:
> <<On Thu, 07 Aug 2008 13:01:40 +0200, Kris Kennaway <kris@freebsd.org> said:
> 
> > We do not delete old distfiles because the space savings are marginal. 
> > There is value in retaining old distfiles, because they are often still 
> > needed even years later.
> 
> There is also the issue of GPL compliance for the packages
> (particularly the static package sets included with releases).

Fair enough.  However, find . -exec basename {} \; | sort | uniq -d
finds plenty of duplicates, including some monsters like
OOo_1.1.4_source.tar.gz, for instance.

./danfe
From kris at FreeBSD.org  Thu Aug  7 16:30:20 2008
From: kris at FreeBSD.org (Kris Kennaway)
Date: Thu Aug  7 16:30:26 2008
Subject: ports/distfiles on FTP
In-Reply-To: <20080807162106.GA58873@regency.nsu.ru>
References: <20080807103121.GA8415@regency.nsu.ru>
	<489AD614.3010904@FreeBSD.org>
	<18586.62597.988090.707524@hergotha.csail.mit.edu>
	<20080807162106.GA58873@regency.nsu.ru>
Message-ID: <489B2317.7050904@FreeBSD.org>

Alexey Dokuchaev wrote:
> On Thu, Aug 07, 2008 at 09:11:33AM -0400, Garrett Wollman wrote:
>> <<On Thu, 07 Aug 2008 13:01:40 +0200, Kris Kennaway <kris@freebsd.org> said:
>>
>>> We do not delete old distfiles because the space savings are marginal. 
>>> There is value in retaining old distfiles, because they are often still 
>>> needed even years later.
>> There is also the issue of GPL compliance for the packages
>> (particularly the static package sets included with releases).
> 
> Fair enough.  However, find . -exec basename {} \; | sort | uniq -d
> finds plenty of duplicates, including some monsters like
> OOo_1.1.4_source.tar.gz, for instance.

They were all the "right" location for a version of the port at some 
point in history, and still are correct for any remaining users of that 
version.

Kris
From patrik.forsberg at dataphone.net  Mon Aug 11 09:44:46 2008
From: patrik.forsberg at dataphone.net (Patrik Forsberg)
Date: Mon Aug 11 09:44:53 2008
Subject: ftp5.se
Message-ID: <039BED0949CA9C4AB253EBDA3ADDAA320586F411@stomail01.se.dataphone.com>

Hi,

Sorry if this is a repeat of an earlier discussion ;)


We've run out of diskpace on the FreeBSD Mirror drive. Currently we can
hold up to 577G and the FreeBSD directory is now 548G. Are there
anything that can be done about it or just live with a full fs ? :( or
maybe it's just temporary ?

For example can I remove/refuse /snapshot(about 66G) ? or
/development(about 8G) ?
Would save around 74G for more valuable content :)

Regards,
Patrik

From kris at FreeBSD.org  Mon Aug 11 10:29:12 2008
From: kris at FreeBSD.org (Kris Kennaway)
Date: Mon Aug 11 10:29:19 2008
Subject: ftp5.se
In-Reply-To: <039BED0949CA9C4AB253EBDA3ADDAA320586F411@stomail01.se.dataphone.com>
References: <039BED0949CA9C4AB253EBDA3ADDAA320586F411@stomail01.se.dataphone.com>
Message-ID: <48A01472.80605@FreeBSD.org>

Patrik Forsberg wrote:
> Hi,
> 
> Sorry if this is a repeat of an earlier discussion ;)
> 
> 
> We've run out of diskpace on the FreeBSD Mirror drive. Currently we can
> hold up to 577G and the FreeBSD directory is now 548G. Are there
> anything that can be done about it or just live with a full fs ? :( or
> maybe it's just temporary ?

If there's one universal truth about data it is that it never gets 
smaller in size :)

> For example can I remove/refuse /snapshot(about 66G) ? or
> /development(about 8G) ?

I'd suggest either dropping the less popular architectures like ia64 and 
sparc64 (either some or all of their releases and packages), or some or 
all of the snapshots.  development is not that important but it is also 
small and won't help in the long run.

You may want to plan for future growth since e.g. significantly more 
data will be added when 7.1 is released (within a few months).

Kris


From test at airbites.pl  Thu Aug 14 18:21:56 2008
From: test at airbites.pl (770ZE336@n1.com)
Date: Thu Aug 14 18:22:25 2008
Subject: Su carta!
Message-ID: <4671C2A1.8ECB7C44@airbites.pl>

¡Buenos días! 
Nosotros somos vendedores de televisores plasma de las  marcas famosas:
Samsung, LG, Sony, Philips.
Ahora estamos seleccionando consultantes a distancia para nuestros
clientes.
Le garantizamos de 300 a 500 Euros por semana, con su dedicación de 1 a 5
horas por día.
Usted tan solo necesita tener un ordenador y un teléfono.
Para recibir la descripción detallada del trabajo, puede Usted escribir a
nuestro email: Bernardin.Giorgio.31@gmail.com
Por favor, indique en su carta su nombre, edad y ciudad de residencia. 


From edwin at mavetju.org  Mon Aug 25 02:17:25 2008
From: edwin at mavetju.org (Edwin Groothuis)
Date: Mon Aug 25 02:17:33 2008
Subject: Australian FreeBSD CVSup mirror shuffle
Message-ID: <20080825021724.GC3332@k7.mavetju>

The Australian CVSup mirror cvsup.au.freebsd.org, formerly hosted
on planetmirror.com, has been moved to the host of John Marshall
who is running an hourly cvsup from cvsup-master.freebsd.org.

All references to cvsup in the au.freebsd.org zone,
cvsup[2-7].au.freebsd.org, are now pointing to it. 

Edwin
-- 
Edwin Groothuis      |            Personal website: http://www.mavetju.org
edwin@mavetju.org    |              Weblog: http://www.mavetju.org/weblog/
From edwin at freebsd.org  Mon Aug 25 03:29:03 2008
From: edwin at freebsd.org (Edwin Groothuis)
Date: Mon Aug 25 03:29:11 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
Message-ID: <20080825032902.GA90128@k7.mavetju>

About a year ago I made the FreeBSD FTP mirrors statistics for the
availability of ISO images. Recently I have added statistics for
the general up-to-dateness of the FTP server (via contents of the
file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
mirrors, via the file CVSROOT-ports/modules.

The statistics can be found at
http://www.mavetju.org/unix/freebsd-mirrors/

and are available per country or global (for CVSup mirrors and for
TIMESTAMPS).

And as a brain teaser:

    If you have an idea on how to identify the up-to-date
    /pub/FreeBSD/ports/*/packages*/All/ directory let me know and we
    can discuss it. For example, it has to overcome these kind of issues:

	ftp> dir a*
	229 Entering Extended Passive Mode (|||27149|)
	150 Here comes the directory listing.
	[... hundreds of lines deleted ...]
	226 Directory send OK.
	ftp> dir z*
	229 Entering Extended Passive Mode (|||60927|)
	150 Here comes the directory listing.
	226 Directory send OK.

Edwin

-- 
Edwin Groothuis
edwin@freebsd.org
http://www.mavetju.org
From hrs at FreeBSD.org  Mon Aug 25 04:18:53 2008
From: hrs at FreeBSD.org (Hiroki Sato)
Date: Mon Aug 25 04:19:00 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
In-Reply-To: <20080825032902.GA90128@k7.mavetju>
References: <20080825032902.GA90128@k7.mavetju>
Message-ID: <20080825.131817.70164316.hrs@allbsd.org>

Edwin Groothuis <edwin@freebsd.org> wrote
  in <20080825032902.GA90128@k7.mavetju>:

ed> About a year ago I made the FreeBSD FTP mirrors statistics for the
ed> availability of ISO images. Recently I have added statistics for
ed> the general up-to-dateness of the FTP server (via contents of the
ed> file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
ed> mirrors, via the file CVSROOT-ports/modules.
ed>
ed> The statistics can be found at
ed> http://www.mavetju.org/unix/freebsd-mirrors/
ed>
ed> and are available per country or global (for CVSup mirrors and for
ed> TIMESTAMPS).

 Excellent.  We need to do something for stale servers.

--
| Hiroki SATO
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 195 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20080825/8bcd5375/attachment.pgp
From koitsu at FreeBSD.org  Mon Aug 25 04:57:14 2008
From: koitsu at FreeBSD.org (Jeremy Chadwick)
Date: Mon Aug 25 04:57:20 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
In-Reply-To: <20080825032902.GA90128@k7.mavetju>
References: <20080825032902.GA90128@k7.mavetju>
Message-ID: <20080825043956.GA54120@eos.sc1.parodius.com>

On Mon, Aug 25, 2008 at 01:29:02PM +1000, Edwin Groothuis wrote:
> About a year ago I made the FreeBSD FTP mirrors statistics for the
> availability of ISO images. Recently I have added statistics for
> the general up-to-dateness of the FTP server (via contents of the
> file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
> mirrors, via the file CVSROOT-ports/modules.
> 
> The statistics can be found at
> http://www.mavetju.org/unix/freebsd-mirrors/
> 
> and are available per country or global (for CVSup mirrors and for
> TIMESTAMPS).
> 
> And as a brain teaser:
> 
>     If you have an idea on how to identify the up-to-date
>     /pub/FreeBSD/ports/*/packages*/All/ directory let me know and we
>     can discuss it. For example, it has to overcome these kind of issues:
> 
> 	ftp> dir a*
> 	229 Entering Extended Passive Mode (|||27149|)
> 	150 Here comes the directory listing.
> 	[... hundreds of lines deleted ...]
> 	226 Directory send OK.
> 	ftp> dir z*
> 	229 Entering Extended Passive Mode (|||60927|)
> 	150 Here comes the directory listing.
> 	226 Directory send OK.

I don't understand what the "issue" is there; are you saying the
methodology used for detecting out-of-date packages is difficult
when using the base ftp(1) client?  If so, try using the ftp/omi or
ftp/mirror ports, which support a form of directory listing diffs,
including by timestamp.

ftp://sunsite.ualberta.ca/pub/Mirror/mirror/mirror.html
http://doc.gnu-darwin.org/omi/

-- 
| Jeremy Chadwick                                jdc at parodius.com |
| Parodius Networking                       http://www.parodius.com/ |
| UNIX Systems Administrator                  Mountain View, CA, USA |
| Making life hard for others since 1977.              PGP: 4BD6C0CB |

From rafan at infor.org  Mon Aug 25 05:15:19 2008
From: rafan at infor.org (Rong-En Fan)
Date: Mon Aug 25 05:15:36 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
In-Reply-To: <20080825032902.GA90128@k7.mavetju>
References: <20080825032902.GA90128@k7.mavetju>
Message-ID: <20080825043613.GA49656@svm.csie.ntu.edu.tw>

On Mon, Aug 25, 2008 at 01:29:02PM +1000, Edwin Groothuis wrote:
> About a year ago I made the FreeBSD FTP mirrors statistics for the
> availability of ISO images. Recently I have added statistics for
> the general up-to-dateness of the FTP server (via contents of the
> file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
> mirrors, via the file CVSROOT-ports/modules.

Great and thanks!

For checking CVSup, I used to have a small script which checks
the freshness via commit log (under CVSROOT-*/commitlogs/).

Regards,
Rong-En Fan

> 
> The statistics can be found at
> http://www.mavetju.org/unix/freebsd-mirrors/
> 
> and are available per country or global (for CVSup mirrors and for
> TIMESTAMPS).
> 
> And as a brain teaser:
> 
>     If you have an idea on how to identify the up-to-date
>     /pub/FreeBSD/ports/*/packages*/All/ directory let me know and we
>     can discuss it. For example, it has to overcome these kind of issues:
> 
> 	ftp> dir a*
> 	229 Entering Extended Passive Mode (|||27149|)
> 	150 Here comes the directory listing.
> 	[... hundreds of lines deleted ...]
> 	226 Directory send OK.
> 	ftp> dir z*
> 	229 Entering Extended Passive Mode (|||60927|)
> 	150 Here comes the directory listing.
> 	226 Directory send OK.
> 
> Edwin
> 
> -- 
> Edwin Groothuis
> edwin@freebsd.org
> http://www.mavetju.org
> _______________________________________________
> freebsd-hubs@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-hubs
> To unsubscribe, send any mail to "freebsd-hubs-unsubscribe@freebsd.org"
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 195 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20080825/be8f45f2/attachment.pgp
From edwin at mavetju.org  Tue Aug 26 03:14:33 2008
From: edwin at mavetju.org (Edwin Groothuis)
Date: Tue Aug 26 03:14:41 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
In-Reply-To: <20080825043956.GA54120@eos.sc1.parodius.com>
References: <20080825032902.GA90128@k7.mavetju>
	<20080825043956.GA54120@eos.sc1.parodius.com>
Message-ID: <20080826031431.GY3285@k7.mavetju>

Hello Jeremy,

On Sun, Aug 24, 2008 at 09:39:56PM -0700, Jeremy Chadwick wrote:
> On Mon, Aug 25, 2008 at 01:29:02PM +1000, Edwin Groothuis wrote:
> > About a year ago I made the FreeBSD FTP mirrors statistics for the
> > availability of ISO images. Recently I have added statistics for
> > the general up-to-dateness of the FTP server (via contents of the
> > file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
> > mirrors, via the file CVSROOT-ports/modules.
> > 
> > The statistics can be found at
> > http://www.mavetju.org/unix/freebsd-mirrors/
> > 
> > and are available per country or global (for CVSup mirrors and for
> > TIMESTAMPS).
> > 
> > And as a brain teaser:
> > 
> >     If you have an idea on how to identify the up-to-date
> >     /pub/FreeBSD/ports/*/packages*/All/ directory let me know and we
> >     can discuss it. For example, it has to overcome these kind of issues:
> > 
> > 	ftp> dir a*
> > 	229 Entering Extended Passive Mode (|||27149|)
> > 	150 Here comes the directory listing.
> > 	[... hundreds of lines deleted ...]
> > 	226 Directory send OK.
> > 	ftp> dir z*
> > 	229 Entering Extended Passive Mode (|||60927|)
> > 	150 Here comes the directory listing.
> > 	226 Directory send OK.
> 
> I don't understand what the "issue" is there; are you saying the
> methodology used for detecting out-of-date packages is difficult
> when using the base ftp(1) client?  If so, try using the ftp/omi or
> ftp/mirror ports, which support a form of directory listing diffs,
> including by timestamp.

The issue is that the FTP *servers* can limit the amount of returned
entries in a directory listing. Some return all 19K entries. Some
return the first 2K. Some only read the first 2K entries, apply the
filter and return that output. Using a different client will not
resolve it, this is a server issue.

Edwin

-- 
Edwin Groothuis      |            Personal website: http://www.mavetju.org
edwin@mavetju.org    |              Weblog: http://www.mavetju.org/weblog/
From edwin at mavetju.org  Tue Aug 26 03:18:09 2008
From: edwin at mavetju.org (Edwin Groothuis)
Date: Tue Aug 26 03:18:16 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
In-Reply-To: <20080825.131817.70164316.hrs@allbsd.org>
References: <20080825032902.GA90128@k7.mavetju>
	<20080825.131817.70164316.hrs@allbsd.org>
Message-ID: <20080826031805.GZ3285@k7.mavetju>

On Mon, Aug 25, 2008 at 01:18:17PM +0900, Hiroki Sato wrote:
> Edwin Groothuis <edwin@freebsd.org> wrote
>   in <20080825032902.GA90128@k7.mavetju>:
> 
> ed> About a year ago I made the FreeBSD FTP mirrors statistics for the
> ed> availability of ISO images. Recently I have added statistics for
> ed> the general up-to-dateness of the FTP server (via contents of the
> ed> file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
> ed> mirrors, via the file CVSROOT-ports/modules.
> ed>
> ed> The statistics can be found at
> ed> http://www.mavetju.org/unix/freebsd-mirrors/
> ed>
> ed> and are available per country or global (for CVSup mirrors and for
> ed> TIMESTAMPS).
> 
>  Excellent.  We need to do something for stale servers.

I hope that erwin@s (admin of ftp.beastie.tdk.net) project of
contacting stale CVSup / FTP mirrors will be successful. If I am
given the hat, I am more than willing to contact the people myself.

Edwin

-- 
Edwin Groothuis      |            Personal website: http://www.mavetju.org
edwin@mavetju.org    |              Weblog: http://www.mavetju.org/weblog/
From edwin at mavetju.org  Tue Aug 26 03:19:36 2008
From: edwin at mavetju.org (Edwin Groothuis)
Date: Tue Aug 26 03:19:42 2008
Subject: Statistics for FreeBSD FTP and CVSup mirrors
In-Reply-To: <20080825043613.GA49656@svm.csie.ntu.edu.tw>
References: <20080825032902.GA90128@k7.mavetju>
	<20080825043613.GA49656@svm.csie.ntu.edu.tw>
Message-ID: <20080826031935.GA3285@k7.mavetju>

On Mon, Aug 25, 2008 at 12:36:13PM +0800, Rong-En Fan wrote:
> On Mon, Aug 25, 2008 at 01:29:02PM +1000, Edwin Groothuis wrote:
> > About a year ago I made the FreeBSD FTP mirrors statistics for the
> > availability of ISO images. Recently I have added statistics for
> > the general up-to-dateness of the FTP server (via contents of the
> > file /pub/FreeBSD/TIMESTAMP) and the general up-to-dateness of CVSup
> > mirrors, via the file CVSROOT-ports/modules.
> 
> Great and thanks!
> 
> For checking CVSup, I used to have a small script which checks
> the freshness via commit log (under CVSROOT-*/commitlogs/).

Yes, that one gets updated too regularly[sp]. Only issue was that
the size of them is much bigger than the size of the stuff I fetch.

Edwin

-- 
Edwin Groothuis      |            Personal website: http://www.mavetju.org
edwin@mavetju.org    |              Weblog: http://www.mavetju.org/weblog/
From edwin at mavetju.org  Fri Aug 29 07:07:32 2008
From: edwin at mavetju.org (Edwin Groothuis)
Date: Fri Aug 29 07:07:39 2008
Subject: DNS, rsync and WWW too (Was: Statistics for FreeBSD FTP and CVSup
	mirrors)
Message-ID: <20080829070729.GA53898@k7.mavetju>

Please note that I've added checks for the contents of DNS, rsync,
and the WWW mirrors too at http://www.mavetju.org/unix/freebsd-mirrors/.

With these six points of data I'm able to give everything some kind
of score and euhm... the mirror system needs a broom, some sandpaper
and a nice layer of paint.

Edwin

-- 
Edwin Groothuis      |            Personal website: http://www.mavetju.org
edwin@mavetju.org    |              Weblog: http://www.mavetju.org/weblog/
From maxim at macomnet.ru  Fri Aug 29 07:43:47 2008
From: maxim at macomnet.ru (Maxim Konovalov)
Date: Fri Aug 29 07:43:53 2008
Subject: DNS, rsync and WWW too (Was: Statistics for FreeBSD FTP and
 CVSup mirrors)
In-Reply-To: <20080829070729.GA53898@k7.mavetju>
References: <20080829070729.GA53898@k7.mavetju>
Message-ID: <20080829111157.Q57127@mp2.macomnet.net>

On Fri, 29 Aug 2008, 17:07+1000, Edwin Groothuis wrote:

> Please note that I've added checks for the contents of DNS, rsync,
> and the WWW mirrors too at http://www.mavetju.org/unix/freebsd-mirrors/.
>
> With these six points of data I'm able to give everything some kind
> of score and euhm... the mirror system needs a broom, some sandpaper
> and a nice layer of paint.
>
Nice work indeed.  There is a feature request: it it possible to
record a timestamp of the latest successfull connect to www|ftp etc
and show it when connection fails?  E.g. ftp.ru.freebsd.org refuses
connection but it is not clear since when.

Also, at

http://www.mavetju.org/unix/freebsd-mirrors/all-stats-cc.php?country=ru&overview=1

I failed to find a status of rsync mirrors, e.g. ftp2.ru.freebsd.org.

Thanks again.

-- 
Maxim Konovalov
From edwin at mavetju.org  Fri Aug 29 08:14:48 2008
From: edwin at mavetju.org (Edwin Groothuis)
Date: Fri Aug 29 08:14:56 2008
Subject: DNS,
	rsync and WWW too (Was: Statistics for FreeBSD FTP and CVSup
	mirrors)
In-Reply-To: <20080829111157.Q57127@mp2.macomnet.net>
References: <20080829070729.GA53898@k7.mavetju>
	<20080829111157.Q57127@mp2.macomnet.net>
Message-ID: <20080829081446.GN3285@k7.mavetju>

On Fri, Aug 29, 2008 at 11:16:03AM +0400, Maxim Konovalov wrote:
> On Fri, 29 Aug 2008, 17:07+1000, Edwin Groothuis wrote:
> 
> > Please note that I've added checks for the contents of DNS, rsync,
> > and the WWW mirrors too at http://www.mavetju.org/unix/freebsd-mirrors/.
> >
> > With these six points of data I'm able to give everything some kind
> > of score and euhm... the mirror system needs a broom, some sandpaper
> > and a nice layer of paint.
>
> Nice work indeed.  There is a feature request: it it possible to
> record a timestamp of the latest successfull connect to www|ftp etc
> and show it when connection fails?  E.g. ftp.ru.freebsd.org refuses
> connection but it is not clear since when.

It changed between:
http://www.mavetju.org/unix/freebsd-mirrors/ftp-stats-iso-cc.php?country=ru&date=2008-08-26
and
http://www.mavetju.org/unix/freebsd-mirrors/ftp-stats-iso-cc.php?country=ru&date=2008-08-27

> I failed to find a status of rsync mirrors, e.g. ftp2.ru.freebsd.org.

That is because they don't have DNS names for them:

=========================== 8< =================================
The hostnames are determined once per week in the following ways:

* For domains which DNS servers do allow zone-transfers, I check for the hosts which start with ftp*, rsync*, cvsup* etc.
* For domains which DNS servers do not allow zone-transfers, I check for the existence of hosts named ftp, ftp[1-19], cvsup, cvsup[1-19], rsync, rsync[1-19] etc. 
=========================== 8< =================================

The time-warp thing is something I still haev to figure out how to
best visualize it.

Edwin

-- 
Edwin Groothuis      |            Personal website: http://www.mavetju.org
edwin@mavetju.org    |              Weblog: http://www.mavetju.org/weblog/
From tomas at zvala.cz  Fri Aug 29 09:01:38 2008
From: tomas at zvala.cz (Tomas Zvala)
Date: Fri Aug 29 09:01:45 2008
Subject: DNS,
 rsync and WWW too (Was: Statistics for FreeBSD FTP and CVSup
 mirrors)
In-Reply-To: <20080829081446.GN3285@k7.mavetju>
References: <20080829070729.GA53898@k7.mavetju>	<20080829111157.Q57127@mp2.macomnet.net>
	<20080829081446.GN3285@k7.mavetju>
Message-ID: <48B7BAEC.10207@zvala.cz>

Edwin Groothuis wrote:
> On Fri, Aug 29, 2008 at 11:16:03AM +0400, Maxim Konovalov wrote:
>
> The time-warp thing is something I still haev to figure out how to
> best visualize it.
>
> Edwin
>
>
Hello Edwin,
very good work i should say. And for the visualisation you probably are 
aware of gentoo way of doing this, but just in case an inspiration can 
be found http://mirrorstats.gentoo.org/ . It  seems to be pretty 
straightforward.

Tomas


From Peter_Losher at isc.org  Fri Aug 29 18:26:14 2008
From: Peter_Losher at isc.org (Peter Losher)
Date: Fri Aug 29 18:26:26 2008
Subject: DNS,
 rsync and WWW too (Was: Statistics for FreeBSD FTP and CVSup
 mirrors)
In-Reply-To: <48B7BAEC.10207@zvala.cz>
References: <20080829070729.GA53898@k7.mavetju>	<20080829111157.Q57127@mp2.macomnet.net>	<20080829081446.GN3285@k7.mavetju>
	<48B7BAEC.10207@zvala.cz>
Message-ID: <48B83F3D.5000401@isc.org>

On 8/29/08 2:01 AM, Tomas Zvala wrote:

> very good work i should say. And for the visualisation you probably are
> aware of gentoo way of doing this, but just in case an inspiration can
> be found http://mirrorstats.gentoo.org/ . It  seems to be pretty
> straightforward.

The Gentoo folks just use the standard mirmon software; a lot of
projects use it to monitor their mirrors. (but that only works for
FTP/WWW sites and not for things like CVSup)

Best Wishes - Perer
-- 
Peter_Losher@isc.org | ISC | OpenPGP 0xE8048D08 | "The bits must flow"

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 194 bytes
Desc: OpenPGP digital signature
Url : http://lists.freebsd.org/pipermail/freebsd-hubs/attachments/20080829/188a39db/signature.pgp
From dimitar.vassilev at gmail.com  Sat Aug 30 06:33:32 2008
From: dimitar.vassilev at gmail.com (Dimitar Vasilev)
Date: Sat Aug 30 06:33:38 2008
Subject: DNS,
	rsync and WWW too (Was: Statistics for FreeBSD FTP and CVSup
	mirrors)
In-Reply-To: <48B83F3D.5000401@isc.org>
References: <20080829070729.GA53898@k7.mavetju>
	<20080829111157.Q57127@mp2.macomnet.net>
	<20080829081446.GN3285@k7.mavetju> <48B7BAEC.10207@zvala.cz>
	<48B83F3D.5000401@isc.org>
Message-ID: <59adc1a0808292305l60983b9cr66db821f4e1892fd@mail.gmail.com>

2008/8/29 Peter Losher <Peter_Losher@isc.org>

> On 8/29/08 2:01 AM, Tomas Zvala wrote:
>
> > very good work i should say. And for the visualisation you probably are
> > aware of gentoo way of doing this, but just in case an inspiration can
> > be found http://mirrorstats.gentoo.org/ . It  seems to be pretty
> > straightforward.
>
> The Gentoo folks just use the standard mirmon software; a lot of
> projects use it to monitor their mirrors. (but that only works for
> FTP/WWW sites and not for things like CVSup)
>
> Best Wishes - Perer
> --
> Peter_Losher@isc.org | ISC | OpenPGP 0xE8048D08 | "The bits must flow"
>
> We have something similar:

http://people.freebsd.org/~kuriyama/mirrors/


However last check has been run about a month ago.

Best regards,

Dimitar Vassilev