Is Apache rotatelogs efficienct for real world use?
cswiger at mac.com
Mon Oct 1 14:53:27 PDT 2007
On Oct 1, 2007, at 3:43 PM, Bahman M. wrote:
> Is Apache rotatelogs suitable for handling large volumes of
> access logs, i.e. around 50K requests per hour at _peak_ time which is
> 1.2M requests per day. According to Apache website
> (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes
> about 120MB in size per day.
> Does somebody have similar experience with rotatelogs?
Absolutely-- rotatelogs did just fine with one of the sites I used to
admin which was getting between 1 and 2.5 million hits a day,
depending on the day of the week it was.
Storing the logfiles and doing analysis on them afterwards started
getting pretty challenging, however: even doing reverse DNS lookups
took a fair amount of work, and once you started piling up a year or
so's worth, doing things like analog or webalyzer or Unison started
taking close to 24-hours to finish running and produce a report.
More information about the freebsd-questions