website statistics
Pav Lucistnik
pav at FreeBSD.org
Tue May 9 21:02:45 UTC 2006
Murray Stokely píše v út 09. 05. 2006 v 11:11 -0700:
> > SEARCHBOTS
> >
> > On top of the numbers above, search engine crawlers generated another
> > 43,778 hits/day. Googlebot alone is responsible for 7875 hits/day.
>
> Google claims to have 1,680,000 documents from www.freebsd.org indexed
> (+site:www.freebsd.org query), and 3 times as much if you count
> people.freebsd.org and the various ftpN and other domains. If that is
> anywhere near correct, then 7875 hits / day means the average page is
> only refreshed every 213 days. I hope it crawls faster than 7875 hits
> / day on other days. Does Apache log a page hit if it was not
> returned because of an If-Modified-Since header?
Yes, that's counted as a page view. Google is known to record the
frequency with which the page is updated, and crawl often updated pages
more often. Also, I would imagine, it would crawl homepage daily, just
for the sake of having a fresh one in cache.
Someone is reading us in Google, now it gives 2,040,000 documents on
that site. Honestly, that figure feels overshot by a lot. Can't imagine
2 million distinct pages here.
--
Pav Lucistnik <pav at oook.cz>
<pav at FreeBSD.org>
Any sufficiently advanced technology is indistinguishable from magic.
-- Arthur C. Clarke
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 187 bytes
Desc: Toto je =?iso-8859-2?Q?digit=E1ln=EC?=
=?ISO-8859-1?Q?_podepsan=E1?= =?iso-8859-2?Q?_=E8=E1st?=
=?ISO-8859-1?Q?_zpr=E1vy?=
Url : http://lists.freebsd.org/pipermail/freebsd-www/attachments/20060509/aff56492/attachment.pgp
More information about the freebsd-www
mailing list