Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Sarg package for pfsense

    Scheduled Pinned Locked Moved pfSense Packages
    467 Posts 99 Posters 501.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DonnyD
      Donny
      last edited by

      @marcelloc:

      Somebody posted these day a workaround for this, try to search on forum for dns rebind ad.

      No more ask again because I have 2 or 3 times posted.

      Thank u very much Marcelloc

      Donny

      1 Reply Last reply Reply Quote 0
      • J
        jikjik101
        last edited by

        Hi marcelloc,

        Great package. But how to manually delete the sarg reports?
        My pfsense got problem with full hard disk error and the largest directory is from the sarg reports.
        I forgot to use the rotate logs before.

        And what does Cache-in and Cache-out mean?

        Thanks in advance.

        1 Reply Last reply Reply Quote 0
        • marcellocM
          marcelloc
          last edited by

          @jikjik101:

          Hi marcelloc,

          Great package. But how to manually delete the sarg reports?
          My pfsense got problem with full hard disk error and the largest directory is from the sarg reports.
          I forgot to use the rotate logs before.

          Just delete reports on /usr/local/www/sarg-reports using rm on console/ssh.

          Treinamentos de Elite: http://sys-squad.com

          Help a community developer! ;D

          1 Reply Last reply Reply Quote 0
          • marcellocM
            marcelloc
            last edited by

            Hi all,

            Just published version 0.4.2 with fixes on squidguard log rotate and a faster boot startup process.

            att,
            Marcello Coutinho

            Treinamentos de Elite: http://sys-squad.com

            Help a community developer! ;D

            1 Reply Last reply Reply Quote 0
            • E
              elemay
              last edited by

              here it doesn't show realtime logs since latest upgrade.

              anyone else with this problem?

              1 Reply Last reply Reply Quote 0
              • M
                miodzicho
                last edited by

                Cannot generate anything at all.

                Package has been removed, re-installed, directory deleted (under www), recreated, given write rights and still :

                sarg -x
                SARG: Init
                SARG: Loading configuration from /usr/local/etc/sarg/sarg.conf
                SARG: Loading exclude host file from: /usr/local/etc/sarg/exclude_hosts.conf
                SARG: Loading exclude file from: /usr/local/etc/sarg/exclude_users.conf
                SARG: Reading host alias file "/usr/local/etc/sarg/hostalias"
                SARG: List of host names to alias:
                SARG: Parameters:
                SARG:          Hostname or IP address (-a) =
                SARG:                    Useragent log (-b) =
                SARG:                    Exclude file (-c) = /usr/local/etc/sarg/exclude_hosts.conf
                SARG:                  Date from-until (-d) =
                SARG:    Email address to send reports (-e) =
                SARG:                      Config file (-f) = /usr/local/etc/sarg/sarg.conf
                SARG:                      Date format (-g) = Europe (dd/mm/yyyy)
                SARG:                        IP report (-i) = No
                SARG:                        Input log (-l) = /var/squid/logs/access.log
                SARG:              Resolve IP Address (-n) = No
                SARG:                      Output dir (-o) = /usr/local/www/sarg-reports/
                SARG: Use Ip Address instead of userid (-p) = No
                SARG:                    Accessed site (-s) =
                SARG:                            Time (-t) =
                SARG:                            User (-u) =
                SARG:                    Temporary dir (-w) = /tmp/sarg
                SARG:                  Debug messages (-x) = Yes
                SARG:                Process messages (-z) = No
                SARG:  Previous reports to keep (–lastlog) = 0
                SARG:
                SARG: sarg version: 2.3.2 Nov-23-2011
                SARG: Reading access log file: /var/squid/logs/access.log
                SARG: Records in file: 344851, reading: 100.00%
                SARG:    Records read: 344851, written: 344691, excluded: 0
                SARG: Squid log format
                SARG: Period: 06 Apr 2012-07 May 2012
                SARG: pre-sorting files
                SARG: File /usr/local/www/sarg-reports/2012/04-05/06-07 already exists, moved to /usr/local/www/sarg-reports/2012/04-05/06-07.2
                SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
                SARG:: No such file or directory

                sarg
                SARG: Records in file: 344851, reading: 100.00%
                SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

                2.4.4-RELEASE (amd64)
                built on Thu Sep 20 09:03:12 EDT 2018
                FreeBSD 11.2-RELEASE-p3
                QOTOM Q355G4 - i5 8G RAM 128G SSD

                1 Reply Last reply Reply Quote 0
                • marcellocM
                  marcelloc
                  last edited by

                  @miodzicho:

                  SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
                  SARG:: No such file or directory
                  SARG: Records in file: 344851, reading: 100.00%
                  SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

                  You have permission problems on your install, clean up(not remove) /usr/local/www/sarg-reports and try to run again.

                  Treinamentos de Elite: http://sys-squad.com

                  Help a community developer! ;D

                  1 Reply Last reply Reply Quote 0
                  • M
                    miodzicho
                    last edited by

                    @marcelloc:

                    @miodzicho:

                    SARG: cannot open /usr/local/www/sarg-reports/2012/04-05/06-07/sarg-date for writing
                    SARG:: No such file or directory
                    SARG: Records in file: 344851, reading: 100.00%
                    SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory

                    You have permission problems on your install, clean up(not remove) /usr/local/www/sarg-reports and try to run again.

                    Hi Marcelloc

                    What do you mean by clean ? rm -rf ?

                    2.4.4-RELEASE (amd64)
                    built on Thu Sep 20 09:03:12 EDT 2018
                    FreeBSD 11.2-RELEASE-p3
                    QOTOM Q355G4 - i5 8G RAM 128G SSD

                    1 Reply Last reply Reply Quote 0
                    • marcellocM
                      marcelloc
                      last edited by

                      @miodzicho:

                      What do you mean by clean ? rm -rf ?

                      could be a rm -rf /usr/local/www/sarg-reports/*

                      Please be carefull with rm.

                      Treinamentos de Elite: http://sys-squad.com

                      Help a community developer! ;D

                      1 Reply Last reply Reply Quote 0
                      • M
                        miodzicho
                        last edited by

                        @marcelloc:

                        @miodzicho:

                        What do you mean by clean ? rm -rf ?

                        could be a rm -rf /usr/local/www/sarg-reports/*

                        Please be carefull with rm.

                        Of course I'm :)

                        Here are results, negative I'm afraid

                        rm -rf /usr/local/www/sarg-reports/*
                        [2.0.1-RELEASE][root@xxx]/root(5): ls /usr/local/www/sarg-reports
                        [2.0.1-RELEASE][root@xxx]/root(6): sarg
                        SARG: Records in file: 344852, reading: 100.00%
                        SARG: Cannot delete /usr/local/www/sarg-reports/2012/04-05/06-07/d192_168_20_4.html - No such file or directory
                        [2.0.1-RELEASE][root@xxx]/root(7):

                        2.4.4-RELEASE (amd64)
                        built on Thu Sep 20 09:03:12 EDT 2018
                        FreeBSD 11.2-RELEASE-p3
                        QOTOM Q355G4 - i5 8G RAM 128G SSD

                        1 Reply Last reply Reply Quote 0
                        • marcellocM
                          marcelloc
                          last edited by

                          Check options you selected on sarg gui and try again.

                          Treinamentos de Elite: http://sys-squad.com

                          Help a community developer! ;D

                          1 Reply Last reply Reply Quote 0
                          • D
                            der.tale
                            last edited by

                            Hi there,

                            I think I found two minor bugs with the sarg configuration:

                            When configuring exclude strings, the resulting configuration entry looks like this:

                            exclude_string"testasd'              # note the missing space and the wrong quote character at the end

                            Also, when setting exclude_codes, these are written to the correct configuration file (exclude_codes.conf), but in sarg.conf "exclude_code" (without the .conf", probably the default) is referenced.

                            Another side note / question:

                            I'm combining squid and squidGuard. This works quite good so far. My squidGuard config defines several ACLs. After generating some sample reports I noticed that blocked URLs are not marked as blocked in the Squid log file. At least not in the same way when "Plain Squid" would be blocking them. This throws Sarg off, and blocked URLs are included in the list of visited websites without a special marker that these were blocked / redirected.

                            Is there any way around that? I tried to remove these entries with exclude_strings or exclude_codes (to remove all 403 redirects) - which did not work because of the mentioned bugs. But aside from these options, is there any other way?

                            Thanks for the good work on the package btw!

                            Manuel

                            1 Reply Last reply Reply Quote 0
                            • marcellocM
                              marcelloc
                              last edited by

                              der.tale,

                              Thanks for your feedback. I've pushed version 0.4.2_1 with these fixes.

                              check if you can use exclude codes and exclude_string now.

                              att,
                              Marcello Coutinho

                              Treinamentos de Elite: http://sys-squad.com

                              Help a community developer! ;D

                              1 Reply Last reply Reply Quote 0
                              • M
                                miodzicho
                                last edited by

                                @marcelloc:

                                Check options you selected on sarg gui and try again.

                                I have tried to enable and disable options in GUI, tried as well schedule forced.
                                Unfortunately still no go.Error is the same.

                                2.4.4-RELEASE (amd64)
                                built on Thu Sep 20 09:03:12 EDT 2018
                                FreeBSD 11.2-RELEASE-p3
                                QOTOM Q355G4 - i5 8G RAM 128G SSD

                                1 Reply Last reply Reply Quote 0
                                • marcellocM
                                  marcelloc
                                  last edited by

                                  miodzicho,

                                  Try sarg with the same options I use.

                                  att,
                                  Marcello Coutinho

                                  sarg_options.png
                                  sarg_options.png_thumb

                                  Treinamentos de Elite: http://sys-squad.com

                                  Help a community developer! ;D

                                  1 Reply Last reply Reply Quote 0
                                  • M
                                    miodzicho
                                    last edited by

                                    @marcelloc:

                                    miodzicho,

                                    Try sarg with the same options I use.

                                    att,
                                    Marcello Coutinho

                                    Marcello, you are star :) It works as it should. Many thanks !

                                    2.4.4-RELEASE (amd64)
                                    built on Thu Sep 20 09:03:12 EDT 2018
                                    FreeBSD 11.2-RELEASE-p3
                                    QOTOM Q355G4 - i5 8G RAM 128G SSD

                                    1 Reply Last reply Reply Quote 0
                                    • D
                                      der.tale
                                      last edited by

                                      marcelloc,

                                      thanks for the quick fix, it works now as expected!

                                      der.tale

                                      1 Reply Last reply Reply Quote 0
                                      • J
                                        jikjik101
                                        last edited by

                                        i can't find the sarg menu in the gui. i can't find it under Status after an upgrade to 2.3.2 pkg v.0.4.2_1

                                        1 Reply Last reply Reply Quote 0
                                        • marcellocM
                                          marcelloc
                                          last edited by

                                          try to reinstall

                                          Treinamentos de Elite: http://sys-squad.com

                                          Help a community developer! ;D

                                          1 Reply Last reply Reply Quote 0
                                          • J
                                            jikjik101
                                            last edited by

                                            already did but the same. reinstall and reboot give the same result. no menu.  ???

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.