Published 2020-08-23 on Anjan's Homepage
The problem and alternative solution
- You are not able to debug which pages might be down or not working
- You don’t have insight into which pages are the biggest burden to serve
- You don’t know what content attracts visitors
- You don’t get a hit of dopamine by observing the growth of your blog
I found a solution that gives me insight into my website but preserves user freedom. “GoAccess, is an open source real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser”. Basically, goaccess reads in nginx or apache log files and outputs various analytics about your site.
On my server, I run the following command to analyze my nginx logs:
zcat -f /var/log/nginx/access.log*.gz | cat /var/log/nginx/access.log - | grep -v 192.168.1.0 | goaccess -f -
nginx compresses older access logs into
access.log*.gz so I used zcat to decompress and concatenate all the archives.
The ip address:
192.168.1.0 represents http requests from my LAN.
I only want to analyze traffic on WAN so I excluded 192.168.1.0 by running
grep -v 192.168.1.0 where the -v flag “selects non-matching lines”.
When goaccess opens, I select “NCSA Combined Log Format” and press Enter. Finally, I get the following output:
I prefer cli output but you can also get an html webpage to view.
Since IP addresses can be used to track users, I obfuscate ip addresses with nginx. I left “log full ip address on hack / access denied attempts” on as the tutorial suggests. Logging IPs on error allows me to use tools like fail2ban to ban ip addresses that are trying to bruteforce my server. I also setup log rotation to delete my nginx logs older than 7 days. The log data stays on my server and is not exported to any other third party.
Hopefully goaccess gives you more motivation to write!
Have a comment on one of my posts? Start a discussion in my public inbox by sending an email to ~firstname.lastname@example.org [mailing list etiquette]
Articles from blogs I follow around the netThese articles/blogs do not represent my own opinions or views.
Todo.txt-more: Efficiently managing your todo list and your time
Todo.txt More: Efficiently managing your todo list and your time Introduction I tend to get fairly enthusiastic when it comes to lists, even more so when there's a chance to optimise my productivity. The end of the year is a time for looking backward an…via Proycon's website December 31, 2022
The PineTab2 is a new, faster Linux tablet - and it's not alone
In their December update, Pine64 announced the PineTab2, which is the successor to their PineTab from 2018. As a major change, the PineTab2 upgrades the slow A53-based A64 SoC with an A55-based Rockchip RK3566, the same chip that was used for the Quartz64…via TuxPhones - Linux phones, tablets and portable devices December 19, 2022
I shall toil at a reduced volume
Over the last nine years I have written 300,000 words for this blog on the topics which are important to me. I am not certain that I have much left to say. I can keep revisiting these topics for years, each time adding a couple more years of wisdom and impro…via Drew DeVault's blog December 1, 2022
Generated by openring