University Crest

[wlug] the Wiki

 
wlug archive index About the wlug list Mailing lists home
To The University of Waikato HomepageWaikato Home > Waikato Mailing Lists > wlug Info > wlug archives
Perry Lorier perry@c...
Sun Feb 23 01:06:11 NZDT 2003


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

> Well you're getting a lot of hits.  However, most of it seems to be
> being generated by search robots.  The vast majority being from
> googlebot.com and fastsearch.net.  

they were important to me when I set it up, since it was hosted on adsl,
and I was worried how much bandwidth it was pulling, but less about how
much it was human.  http://www.wlug.org.nz/archive/querys-recent.txt is
autogenerated every night with what everyone is searching for from
google.  it appears to be about 150 hits from google a day at the
moment.  I touched the config up a bit last night before I went to bed.
What I really want to do is get all the search engines grouped into one
line, but I've not had success with getting webaliser to do that for me.
All in all I've been rather disappointed with log analysers in general,
to me webaliser is the best of a particularly bad bunch.

> When I'm creating Webalizer usage reports I set it up to completely
> ignore hits from search engine robots.  Either with "IgnoreSite" or
> "IgnoreAgent".  Without doing this your results are perfectly
> meaningless.  You should be interested in what humans are looking at not
> robots.  If you're wanting to know how much total data the site is
> generating then you should just use HTTPD::Log::Filter perl scripts or
> at least just using Webalizer "Hide" directives instead of Ignores.
> 
> Also you're referrer records are useless. You've not filtered out local
> referrers.  Eg, you should be hiding referrers from www.wlug.org.nz.

I played with that last night, apparently my changes didn't work,
perhaps because of the history file.  Oh well, I've updated it some,
I'll play with it a bit over the next few days and see if it helps.  I
suspect it might just boil down to waiting to a new month roll over so
the history file sorts itself out.

- -- 
Be cheerful while you are alive. -- Phathotep, 24th Century B.C.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.1 (GNU/Linux)
Comment: Only when you are sure they have you, can you stop being paranoid

iD8DBQE+V2eycAgRpy8z8UQRAu3kAKDmNO1QGNrfXqITJSzc4kOr+R0ydQCeO4JA
JQpuktPaXbTTN+Dvj6JM5VM=
=K9Ta
-----END PGP SIGNATURE-----


More information about the wlug mailing list
NOTICE: This is an archive of a public mailing list. The University of Waikato is not responsible for its contents.

The University of Waikato - Te Whare Wananga o Waikato