Is Apache rotatelogs efficienct for real world use?

[Chuck Swiger]

On Oct 1, 2007, at 3:43 PM, Bahman M. wrote:
> Is Apache rotatelogs suitable for handling large volumes of
> access logs, i.e. around 50K requests per hour at _peak_ time which is
> 1.2M requests per day.  According to Apache website
> (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes
> about 120MB in size per day.
>
> Does somebody have similar experience with rotatelogs?

Absolutely-- rotatelogs did just fine with one of the sites I used to  
admin which was getting between 1 and 2.5 million hits a day,  
depending on the day of the week it was.

Storing the logfiles and doing analysis on them afterwards started  
getting pretty challenging, however: even doing reverse DNS lookups  
took a fair amount of work, and once you started piling up a year or  
so's worth, doing things like analog or webalyzer or Unison started  
taking close to 24-hours to finish running and produce a report.

-- 
-Chuck