The sys admin's daily grind: New logfile tool
Sweet Logger
Just as a craftsman is unlikely to purchase a new angle grinder every month, sys admins are unlikely to change constantly their tried and trusted tools. Columnist Charly Kühnast ditches this conservative philosophy this month, lured by the charms of a new logfile tool.
A system administrator's choice of weapons for dueling with the daily grind is likely to be pretty conservative. For example, Webalizer has been my tool of choice for analyzing web server logs for something approaching eternity. However, there is no shortage of alternatives: AWStats, AWFFull, and others are available for adventurous admins. But, why experiment? The other tools just do the same thing as Webalizer – that is, create intuitive evaluations from web server logs.
I am tempted to be unfaithful, however, if I need a real-time summary, with precision down to a second. Apachetop gives you a line on this, and I wrote about it some time back [1]. Since then, a better tool has hit the market: Go Access [2]. This tool parses the web server logfile, evaluates it up to the present point in time, and displays the results at the command line. Go Access reads typical logfiles in Common Logfile format, but also in Combined Logfile format. If you have something more exotic, you have the option of teaching Go Access how to handle it.
Go Access writes its output continuously. Thus, I can watch the web server work in real time. In the simplest case, you just pass in a single parameter, the path to the logfile, at run time:
goaccess -f /var/log/apache2/access.log
Another very practical aspect is the ability to add an IP address and, at the same time, tell Go Access to ignore access to it:
goaccess -f /var/log/apache2/access.log-e 10.50.1.25
This approach avoids evaluating access by the monitoring systems (Nagios, Icinga, or load balancers), all of which cyclically check whether the server is still alive.
Forward Roll
The command-line display is divided into sections Go Access calls modules. The modules are listed from the top down, so you need to scroll to see them all. Some lucky admins have access to portrait-format displays – not me.
Figure 1 only shows the first four modules and the first line of the fifth. In fact, however, Go Access displays 11 modules, including overviews of the most commonly used browsers and client operating systems, the most frequently referring sites, and search keys that prompted search engines to point users to my website. Another practical thing is that Go Access painstakingly differentiates between crawlers and genuine browsers in its evaluations.
A module only shows the "Top 6" list for its category. More details are quickly accessed, however: Each module is represented by a number in the header; for example, 6 - Operating Systems
. If you press 6 on the keyboard and then O (for open Detail View), you are treated to a full list view. Pressing F1 displays more interactive shortcuts.
Authoritative reports on closed logfiles, long the domain of classic log analyzers like Webalizer and others, are naturally part of Go Access's feature set. It looks like I'll be sending Webalizer and Apachetop off to the happy hunting grounds in the near future.
Infos
- "The Sysadmin's Daily Grind: Webalizer Xtended" by Charly Kühnast, Linux Magazine, February 2006, pg. 65
- Go Access: http://goaccess.prosoftcorp.com
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
First Release Candidate for Linux Kernel 6.14 Now Available
Linus Torvalds has officially released the first release candidate for kernel 6.14 and it includes over 500,000 lines of modified code, making for a small release.
-
System76 Refreshes Meerkat Mini PC
If you're looking for a small form factor PC powered by Linux, System76 has exactly what you need in the Meerkat mini PC.
-
Gnome 48 Alpha Ready for Testing
The latest Gnome desktop alpha is now available with plenty of new features and improvements.
-
Wine 10 Includes Plenty to Excite Users
With its latest release, Wine has the usual crop of bug fixes and improvements, along with some exciting new features.
-
Linux Kernel 6.13 Offers Improvements for AMD/Apple Users
The latest Linux kernel is now available, and it includes plenty of improvements, especially for those who use AMD or Apple-based systems.
-
Gnome 48 Debuts New Audio Player
To date, the audio player found within the Gnome desktop has been meh at best, but with the upcoming release that all changes.
-
Plasma 6.3 Ready for Public Beta Testing
Plasma 6.3 will ship with KDE Gear 24.12.1 and KDE Frameworks 6.10, along with some new and exciting features.
-
Budgie 10.10 Scheduled for Q1 2025 with a Surprising Desktop Update
If Budgie is your desktop environment of choice, 2025 is going to be a great year for you.
-
Firefox 134 Offers Improvements for Linux Version
Fans of Linux and Firefox rejoice, as there's a new version available that includes some handy updates.
-
Serpent OS Arrives with a New Alpha Release
After months of silence, Ikey Doherty has released a new alpha for his Serpent OS.