Sarg package for pfsense

marcelloc · May 3, 2012, 10:17 PM

Hi all,

Just published version 0.4.2 with fixes on squidguard log rotate and a faster boot startup process.

att,
Marcello Coutinho

elemay · May 4, 2012, 7:15 AM

here it doesn't show realtime logs since latest upgrade.

anyone else with this problem?

miodzicho · May 7, 2012, 2:59 PM

Cannot generate anything at all.

Package has been removed, re-installed, directory deleted (under www), recreated, given write rights and still :

sarg -x
SARG: Init
SARG: Loading configuration from /usr/local/etc/sarg/sarg.conf
SARG: Loading exclude host file from: /usr/local/etc/sarg/exclude_hosts.conf
SARG: Loading exclude file from: /usr/local/etc/sarg/exclude_users.conf
SARG: Reading host alias file "/usr/local/etc/sarg/hostalias"
SARG: List of host names to alias:
SARG: Parameters:
SARG: Hostname or IP address (-a) =
SARG: Useragent log (-b) =
SARG: Exclude file (-c) = /usr/local/etc/sarg/exclude_hosts.conf
SARG: Date from-until (-d) =
SARG: Email address to send reports (-e) =
SARG: Config file (-f) = /usr/local/etc/sarg/sarg.conf
SARG: Date format (-g) = Europe (dd/mm/yyyy)
SARG: IP report (-i) = No
SARG: Input log (-l) = /var/squid/logs/access.log
SARG: Resolve IP Address (-n) = No
SARG: Output dir (-o) = /usr/local/www/sarg-reports/
SARG: Use Ip Address instead of userid (-p) = No
SARG: Accessed site (-s) =
SARG: Time (-t) =
SARG: User (-u) =
SARG: Temporary dir (-w) = /tmp/sarg
SARG: Debug messages (-x) = Yes
SARG: Process messages (-z) = No
SARG: Previous reports to keep (–lastlog) = 0
SARG:
SARG: sarg version: 2.3.2 Nov-23-2011
SARG: Reading access log file: /var/squid/logs/access.log
SARG: Records in file: 344851, reading: 100.00%
SARG: Records read: 344851, written: 344691, excluded: 0
SARG: Squid log format
SARG: Period: 06 Apr 2012-07 May 2012
SARG: pre-sorting files
SARG: File /usr/local/www/sarg-reports/2012/04-05/06-07 already exists, moved to /usr/local/www/sarg-reports/2012/04-05/06-07.2
SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
SARG:: No such file or directory

sarg
SARG: Records in file: 344851, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

marcelloc · May 7, 2012, 3:24 PM

@miodzicho:

SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
SARG:: No such file or directory
SARG: Records in file: 344851, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

You have permission problems on your install, clean up(not remove) /usr/local/www/sarg-reports and try to run again.

miodzicho · May 7, 2012, 3:44 PM

@marcelloc:

@miodzicho:

SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
SARG:: No such file or directory
SARG: Records in file: 344851, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

You have permission problems on your install, clean up(not remove) /usr/local/www/sarg-reports and try to run again.

Hi Marcelloc

What do you mean by clean ? rm -rf ?

marcelloc · May 7, 2012, 3:53 PM

@miodzicho:

What do you mean by clean ? rm -rf ?

could be a rm -rf /usr/local/www/sarg-reports/*

Please be carefull with rm.

miodzicho · May 7, 2012, 4:05 PM

@marcelloc:

@miodzicho:

What do you mean by clean ? rm -rf ?

could be a rm -rf /usr/local/www/sarg-reports/*

Please be carefull with rm.

Of course I'm :)

Here are results, negative I'm afraid

rm -rf /usr/local/www/sarg-reports/*
[2.0.1-RELEASE][root@xxx]/root(5): ls /usr/local/www/sarg-reports
[2.0.1-RELEASE][root@xxx]/root(6): sarg
SARG: Records in file: 344852, reading: 100.00%
SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory
[2.0.1-RELEASE][root@xxx]/root(7):

marcelloc · May 7, 2012, 4:06 PM

Check options you selected on sarg gui and try again.

der.tale · May 7, 2012, 4:22 PM

Hi there,

I think I found two minor bugs with the sarg configuration:

When configuring exclude strings, the resulting configuration entry looks like this:

exclude_string"testasd' # note the missing space and the wrong quote character at the end

Also, when setting exclude_codes, these are written to the correct configuration file (exclude_codes.conf), but in sarg.conf "exclude_code" (without the .conf", probably the default) is referenced.

Another side note / question:

I'm combining squid and squidGuard. This works quite good so far. My squidGuard config defines several ACLs. After generating some sample reports I noticed that blocked URLs are not marked as blocked in the Squid log file. At least not in the same way when "Plain Squid" would be blocking them. This throws Sarg off, and blocked URLs are included in the list of visited websites without a special marker that these were blocked / redirected.

Is there any way around that? I tried to remove these entries with exclude_strings or exclude_codes (to remove all 403 redirects) - which did not work because of the mentioned bugs. But aside from these options, is there any other way?

Thanks for the good work on the package btw!

Manuel

marcelloc · May 7, 2012, 6:25 PM

der.tale,

Thanks for your feedback. I've pushed version 0.4.2_1 with these fixes.

check if you can use exclude codes and exclude_string now.

att,
Marcello Coutinho

miodzicho · May 7, 2012, 7:32 PM

@marcelloc:

Check options you selected on sarg gui and try again.

I have tried to enable and disable options in GUI, tried as well schedule forced.
Unfortunately still no go.Error is the same.

marcelloc · May 7, 2012, 7:39 PM

miodzicho,

Try sarg with the same options I use.

att,
Marcello Coutinho

miodzicho · May 7, 2012, 7:58 PM

@marcelloc:

miodzicho,

Try sarg with the same options I use.

att,
Marcello Coutinho

Marcello, you are star :) It works as it should. Many thanks !

der.tale · May 8, 2012, 2:29 PM

marcelloc,

thanks for the quick fix, it works now as expected!

der.tale

jikjik101 · May 9, 2012, 1:03 AM

i can't find the sarg menu in the gui. i can't find it under Status after an upgrade to 2.3.2 pkg v.0.4.2_1

marcelloc · May 9, 2012, 1:25 AM

try to reinstall

jikjik101 · May 9, 2012, 2:19 AM

already did but the same. reinstall and reboot give the same result. no menu. ???

marcelloc · May 9, 2012, 2:54 AM

The menu is there, I have no idea what is happening with your system.

did you tried to uninstall and then install?

if you want, the url /pkg_edit.php?xml=sarg.xml

jikjik101 · May 9, 2012, 8:23 AM

the first thing I did is an upgrade.
When it failed, i tried to do a reinstall - no web menu
Then I did another upgrade - no web menu
Reboot - no webmenu
Uninstall and reinstall - no webmenu
Reboot - no webmenu

I will try to reinstall with no LAN clients connected.

Edit…
After nth time of reinstallation, the menu just popped out. what a relief.

Donny · May 15, 2012, 10:04 AM

Hello all,

Has anyone successes with Sarg report full username from LDAP server of windows 2008?

Thank u