Sarg package for pfsense

marcelloc

Hi marcelloc,

Great package. But how to manually delete the sarg reports?
My pfsense got problem with full hard disk error and the largest directory is from the sarg reports.
I forgot to use the rotate logs before.

Just delete reports on /usr/local/www/sarg-reports using rm on console/ssh.

marcelloc

Hi all,

Just published version 0.4.2 with fixes on squidguard log rotate and a faster boot startup process.

att,
Marcello Coutinho

elemay

here it doesn't show realtime logs since latest upgrade.

anyone else with this problem?

miodzicho

Cannot generate anything at all.

Package has been removed, re-installed, directory deleted (under www), recreated, given write rights and still :

sarg -x
SARG: Init
SARG: Loading configuration from /usr/local/etc/sarg/sarg.conf
SARG: Loading exclude host file from: /usr/local/etc/sarg/exclude_hosts.conf
SARG: Loading exclude file from: /usr/local/etc/sarg/exclude_users.conf
SARG: Reading host alias file "/usr/local/etc/sarg/hostalias"
SARG: List of host names to alias:
SARG: Parameters:
SARG: Hostname or IP address (-a) =
SARG: Useragent log (-b) =
SARG: Exclude file (-c) = /usr/local/etc/sarg/exclude_hosts.conf
SARG: Date from-until (-d) =
SARG: Email address to send reports (-e) =
SARG: Config file (-f) = /usr/local/etc/sarg/sarg.conf
SARG: Date format (-g) = Europe (dd/mm/yyyy)
SARG: IP report (-i) = No
SARG: Input log (-l) = /var/squid/logs/access.log
SARG: Resolve IP Address (-n) = No
SARG: Output dir (-o) = /usr/local/www/sarg-reports/
SARG: Use Ip Address instead of userid (-p) = No
SARG: Accessed site (-s) =
SARG: Time (-t) =
SARG: User (-u) =
SARG: Temporary dir (-w) = /tmp/sarg
SARG: Debug messages (-x) = Yes
SARG: Process messages (-z) = No
SARG: Previous reports to keep (–lastlog) = 0
SARG:
SARG: sarg version: 2.3.2 Nov-23-2011
SARG: Reading access log file: /var/squid/logs/access.log
SARG: Records in file: 344851, reading: 100.00%
SARG: Records read: 344851, written: 344691, excluded: 0
SARG: Squid log format
SARG: Period: 06 Apr 2012-07 May 2012
SARG: pre-sorting files
SARG: File /usr/local/www/sarg-reports/2012/04-05/06-07 already exists, moved to /usr/local/www/sarg-reports/2012/04-05/06-07.2
SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
SARG:: No such file or directory

sarg
SARG: Records in file: 344851, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

marcelloc

@miodzicho:

SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
SARG:: No such file or directory
SARG: Records in file: 344851, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

You have permission problems on your install, clean up(not remove) /usr/local/www/sarg-reports and try to run again.

miodzicho

@marcelloc:

@miodzicho:

SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
SARG:: No such file or directory
SARG: Records in file: 344851, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

You have permission problems on your install, clean up(not remove) /usr/local/www/sarg-reports and try to run again.

Hi Marcelloc

What do you mean by clean ? rm -rf ?

marcelloc

@miodzicho:

What do you mean by clean ? rm -rf ?

could be a rm -rf /usr/local/www/sarg-reports/*

Please be carefull with rm.

miodzicho

@marcelloc:

@miodzicho:

What do you mean by clean ? rm -rf ?

could be a rm -rf /usr/local/www/sarg-reports/*

Please be carefull with rm.

Of course I'm :)

Here are results, negative I'm afraid

rm -rf /usr/local/www/sarg-reports/*
[2.0.1-RELEASE][root@xxx]/root(5): ls /usr/local/www/sarg-reports
[2.0.1-RELEASE][root@xxx]/root(6): sarg
SARG: Records in file: 344852, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory
[2.0.1-RELEASE][root@xxx]/root(7):

marcelloc

Check options you selected on sarg gui and try again.

der.tale

Hi there,

I think I found two minor bugs with the sarg configuration:

When configuring exclude strings, the resulting configuration entry looks like this:

exclude_string"testasd' # note the missing space and the wrong quote character at the end

Also, when setting exclude_codes, these are written to the correct configuration file (exclude_codes.conf), but in sarg.conf "exclude_code" (without the .conf", probably the default) is referenced.

Another side note / question:

I'm combining squid and squidGuard. This works quite good so far. My squidGuard config defines several ACLs. After generating some sample reports I noticed that blocked URLs are not marked as blocked in the Squid log file. At least not in the same way when "Plain Squid" would be blocking them. This throws Sarg off, and blocked URLs are included in the list of visited websites without a special marker that these were blocked / redirected.

Is there any way around that? I tried to remove these entries with exclude_strings or exclude_codes (to remove all 403 redirects) - which did not work because of the mentioned bugs. But aside from these options, is there any other way?

Thanks for the good work on the package btw!

Manuel

marcelloc

der.tale,

Thanks for your feedback. I've pushed version 0.4.2_1 with these fixes.

check if you can use exclude codes and exclude_string now.

att,
Marcello Coutinho

miodzicho

@marcelloc:

Check options you selected on sarg gui and try again.

I have tried to enable and disable options in GUI, tried as well schedule forced.
Unfortunately still no go.Error is the same.

marcelloc

miodzicho,

Try sarg with the same options I use.

att,
Marcello Coutinho

sarg_options.png_thumb

miodzicho

@marcelloc:

miodzicho,

Try sarg with the same options I use.

att,
Marcello Coutinho

Marcello, you are star :) It works as it should. Many thanks !

der.tale

marcelloc,

thanks for the quick fix, it works now as expected!

der.tale

jikjik101

i can't find the sarg menu in the gui. i can't find it under Status after an upgrade to 2.3.2 pkg v.0.4.2_1

marcelloc

try to reinstall

jikjik101

already did but the same. reinstall and reboot give the same result. no menu. ???

marcelloc

The menu is there, I have no idea what is happening with your system.

did you tried to uninstall and then install?

if you want, the url /pkg_edit.php?xml=sarg.xml

jikjik101

the first thing I did is an upgrade.
When it failed, i tried to do a reinstall - no web menu
Then I did another upgrade - no web menu
Reboot - no webmenu
Uninstall and reinstall - no webmenu
Reboot - no webmenu

I will try to reinstall with no LAN clients connected.

Edit…
After nth time of reinstallation, the menu just popped out. what a relief.

sarg.jpg_thumb

sarg2.jpg_thumb