Apache log analysis tools for multiple virtual hosts

apache-2.2loggingvirtualhost

I am interested in trying to get a side by side usage comparison of all the virtual hosts being served up by my apache server.

In the simplest case, I want to see a list (or bar chart) with each virtual host and the number of requests/traffic on that site.

I've been playing around with webalyzer and awstats but I haven't been able to compare multiple virtual hosts in the same infographic.

Anyone have any suggestions on tools for doing this (or how I might use the above tools to do so)?

Best Answer

Well generally when using virtual hosts I have different access logs for each virtual host. If this is the case and you just want hits:

wc -l foo_vhosts.access*

This counts the lines, which would be log entires, which is basically how many hits you got. But you should describe if you log to different files or not, and post an example log entry.

If you don't log to different files, and your logging format doesn't include %v in its format, you are kind of out of luck, unless you can correlate each uri to its virtual host.

Related Solutions

Apache – Using Same Directory Directive for Multiple Virtual Hosts

Pull your Directory stanzas outside of your VirtualHost containers and it should do what you want.

<VirtualHost *:80>
  ServerName domain.com
  ErrorLog logs/domain.com-error_log
  CustomLog logs/domain.com-access_log common
  DocumentRoot "/var/www/srs/web"
  DirectoryIndex index.php
  Alias /sf /usr/share/pear/data/symfony/web/sf
</VirtualHost>

<VirtualHost *:80>
  ServerName domain2.com
  ErrorLog logs/domain2.com-error_log
  CustomLog logs/domain2.com-access_log common
  DocumentRoot "/var/www/srs/web"
  DirectoryIndex index.php
  Alias /sf /usr/share/pear/data/symfony/web/sf
</VirtualHost>

<Directory "/usr/share/pear/data/symfony/web/sf">
  AllowOverride All
  Allow from All
</Directory>
<Directory "/var/www/srs/web">
  AllowOverride All
  Allow from All
</Directory>

“Catch-All” access log with Apache Virtual Hosts

See http://httpd.apache.org/docs/2.2/logs.html#virtualhost

If CustomLog or ErrorLog directives are placed inside a section, all requests or errors for that virtual host will be logged only to the specified file. Any virtual host which does not have logging directives will still have its requests sent to the main server logs.

In other words, if you place Logging directives within a VirtualHost section, it will override the Logging directives within the main server configuration. If you want to log to a single logfile, then remove the log configuration from your VirtualHost sections.

For simplicity, I prefer to log all Access data to a single logfile. Later, you can process the logs and split the logfiles into logfiles for the Virtual Hosts. Also, writing to a single logfile is a more efficient use of computer resources then writing to 30 logfiles at once. Just make sure your LogFormat includes the '%v', which will log the name of the Virtual Host.

Is it possible to have ALL accesses and errors duplicated to a shared logfile?

You can log all errors and access to a shared logfile, but the logfile is ugly. First, send the Apache log data to syslog, and then use syslog to send to a local file or a remote log server.

# Send access logs to syslog
LogFormat "%v %h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined
CustomLog "|/usr/bin/logger -t httpd -i -p local7.notice" combined
# Send error logs to syslog
ErrorLog syslog:local7

And then in /etc/syslog.conf

# Send all HTTP log data to this file
local7.*        /var/log/http-all.log

Best Answer

Related Solutions

Apache – Using Same Directory Directive for Multiple Virtual Hosts

“Catch-All” access log with Apache Virtual Hosts

Related Topic