• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

Want package for squidanalyzer. INSTRUCTIONS AND FILES TO INSTALL

Scheduled Pinned Locked Moved Cache/Proxy
94 Posts 18 Posters 29.1k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • K
    KOM
    last edited by Feb 23, 2015, 8:27 PM

    After manually installing perl and clearing up stupid typos that I insist on making, I got it working on my 2.2-x64 test box.  I'm trying to make it work on a 2.1.5-i386 box and it does everything except write the report into the output folder.  NO errors, but no output.  Hmmm.

    Does anyone know if this script will handle archived logs, like access.log.0, access.log.1 etc?

    1 Reply Last reply Reply Quote 0
    • S
      sacaman
      last edited by Feb 23, 2015, 9:03 PM

      try only this command in terminal

      cd /temp/squidanalyzer/ && perl squid-analyzer

      1 Reply Last reply Reply Quote 0
      • K
        KOM
        last edited by Feb 23, 2015, 9:10 PM

        The script runs, but it doesn't create any files and there is no error log or anything.  Here is the output:

        [2.1.5-RELEASE][admin@pfsense.MyDomain.local]/etc/squidanalyzer(137): perl /usr/local/bin/squidanalyzer -d -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log
        No new log registered…
        DEBUG: the log statistics gathering took: 0 wallclock secs ( 0.00 usr +  0.00 sys =  0.00 CPU)
        Building HTML output into /usr/local/www/squidanalyzer
        DEBUG: generating HTML output took: 0 wallclock secs ( 0.00 usr +  0.00 sys =  0.00 CPU)
        DEBUG: total execution time: 0 wallclock secs ( 0.00 usr +  0.00 sys =  0.00 CPU)

        1 Reply Last reply Reply Quote 0
        • K
          KOM
          last edited by Feb 23, 2015, 9:41 PM

          OK, I managed to get it working by running just this command:

          perl /usr/local/bin/squidanalyzer /var/squid/logs/access.log
          

          Just that by itself generated the reports.

          1 Reply Last reply Reply Quote 0
          • T
            Topper727
            last edited by Apr 8, 2015, 11:32 AM

            Sorry been busy and not around to help

            Dell 2950 g3 server
            Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
            Current: 2000 MHz, Max: 2667 MHz
            8 CPUs: 2 package(s) x 4 core(s)
            8152 MiB and 600meg 10k drive
            Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

            1 Reply Last reply Reply Quote 0
            • K
              KOM
              last edited by Apr 8, 2015, 3:11 PM

              No problem.  I've long since given up on it and moved on.

              1 Reply Last reply Reply Quote 0
              • A
                acc4ever
                last edited by Jul 29, 2015, 3:28 PM

                Guys, thank you very much for this How-To … I was able to install SquidAnalyzer v6.1, It works really good ...

                Topper727, can you compile/port the new version ?

                Thanx in advance

                1 Reply Last reply Reply Quote 0
                • T
                  Topper727
                  last edited by Aug 10, 2015, 10:54 AM

                  Yes, I will try make one soon for you. sorry I been away for bit..

                  Dell 2950 g3 server
                  Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                  Current: 2000 MHz, Max: 2667 MHz
                  8 CPUs: 2 package(s) x 4 core(s)
                  8152 MiB and 600meg 10k drive
                  Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                  1 Reply Last reply Reply Quote 0
                  • T
                    Topper727
                    last edited by Sep 11, 2015, 10:39 PM

                    I looked up the new version.. seems nothing new yet or I missed it. mine is still working quite well. love to see how many hits in percents and all that per day and all that stuff..shows me squid proxy is working and if I make a change I can see maybe a increase or decrease in stuff proxy caches.. Nice to have

                    Dell 2950 g3 server
                    Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                    Current: 2000 MHz, Max: 2667 MHz
                    8 CPUs: 2 package(s) x 4 core(s)
                    8152 MiB and 600meg 10k drive
                    Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                    1 Reply Last reply Reply Quote 0
                    • T
                      Topper727
                      last edited by Dec 8, 2015, 1:12 AM

                      Wish someone with package skills could turn this into package for all of us.  Nice reporting tool

                      Dell 2950 g3 server
                      Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                      Current: 2000 MHz, Max: 2667 MHz
                      8 CPUs: 2 package(s) x 4 core(s)
                      8152 MiB and 600meg 10k drive
                      Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                      1 Reply Last reply Reply Quote 0
                      • K
                        killmasta93
                        last edited by Jan 2, 2016, 4:29 PM Jan 2, 2016, 4:09 PM

                        awsome stuff :)

                        But cant seem to install perl it says that its not in the repository, I also tried looking for perl it did show up on some files.

                        any idea?

                        Updating FreeBSD repository catalogue...
                        FreeBSD repository is up-to-date.
                        All repositories are up-to-date.
                        pkg: No packages available to install matching 'perl5.16-5.16.3_18' have been fo
                        

                        then tried installing perl

                        pkg install perl5
                        

                        then ran your command

                        cd /temp/squidanalyzer/ && perl squid-analyzer -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log
                        perl: Command not found.
                        
                        

                        Thank you

                        Clipboarder.2016.01.02-002.png
                        Clipboarder.2016.01.02-002.png_thumb
                        Clipboarder.2016.01.02-005.png
                        Clipboarder.2016.01.02-005.png_thumb

                        Tutorials:

                        https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

                        1 Reply Last reply Reply Quote 0
                        • T
                          Topper727
                          last edited by Jan 2, 2016, 9:27 PM

                          I will get my notes tonight and see what can help.  Just wanted drop a line sayjng i relead this and will help later today

                          Dell 2950 g3 server
                          Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                          Current: 2000 MHz, Max: 2667 MHz
                          8 CPUs: 2 package(s) x 4 core(s)
                          8152 MiB and 600meg 10k drive
                          Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                          1 Reply Last reply Reply Quote 0
                          • K
                            killmasta93
                            last edited by Jan 2, 2016, 9:56 PM

                            Thanks mate really good stuff :)

                            Tutorials:

                            https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

                            1 Reply Last reply Reply Quote 0
                            • T
                              Topper727
                              last edited by Jan 18, 2016, 5:19 AM

                              When I ran pkg install perl5 I got this

                              FreeBSD repository update completed. 24761 packages processed.
                              New version of pkg detected; it needs to be installed first.
                              The following 1 package(s) will be affected (of 0 checked):

                              Installed packages to be UPGRADED:
                                      pkg: 1.5.6 -> 1.6.2

                              The process will require 148 KiB more space.
                              2 MiB to be downloaded.

                              Proceed with this action? [y/N]:

                              I wonder if there is something with your repository lists.

                              Dell 2950 g3 server
                              Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                              Current: 2000 MHz, Max: 2667 MHz
                              8 CPUs: 2 package(s) x 4 core(s)
                              8152 MiB and 600meg 10k drive
                              Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                              1 Reply Last reply Reply Quote 0
                              • T
                                Topper727
                                last edited by Jan 18, 2016, 5:34 AM

                                what happens if you type

                                perl -v

                                I get

                                [2.2.6-RELEASE][admin@firewall.wholesale-florida.com]/temp/squidanalyzer: perl -v

                                This is perl 5, version 20, subversion 2 (v5.20.2) built for amd64-freebsd-thread-multi

                                Copyright 1987-2015, Larry Wall

                                Perl may be copied only under the terms of either the Artistic License or the
                                GNU General Public License, which may be found in the Perl 5 source kit.

                                Complete documentation for Perl, including FAQ lists, should be found on
                                this system using "man perl" or "perldoc perl".  If you have access to the
                                Internet, point your browser at http://www.perl.org/, the Perl Home Page.

                                maybe type

                                rehash

                                Then your perl -v again if it not works

                                Dell 2950 g3 server
                                Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                                Current: 2000 MHz, Max: 2667 MHz
                                8 CPUs: 2 package(s) x 4 core(s)
                                8152 MiB and 600meg 10k drive
                                Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                                1 Reply Last reply Reply Quote 0
                                • K
                                  killmasta93
                                  last edited by Jan 18, 2016, 9:41 PM

                                  Hi Topper,
                                  Thank you for the reply,
                                  I seems that perl is installed and working i guess but when i run your command

                                  cd /temp/squidanalyzer/ && perl squid-analyzer -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log
                                  

                                  I get Fatal no configuration file

                                  But i do have the squid analyzer webui

                                  See pictures

                                  Thank you

                                  Clipboarder.2016.01.18-002.png
                                  Clipboarder.2016.01.18-002.png_thumb
                                  Clipboarder.2016.01.18-003.png
                                  Clipboarder.2016.01.18-003.png_thumb
                                  Clipboarder.2016.01.18-004.png
                                  Clipboarder.2016.01.18-004.png_thumb
                                  Clipboarder.2016.01.18-005.png
                                  Clipboarder.2016.01.18-005.png_thumb

                                  Tutorials:

                                  https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

                                  1 Reply Last reply Reply Quote 0
                                  • T
                                    Topper727
                                    last edited by Jan 19, 2016, 3:17 AM Jan 19, 2016, 3:07 AM

                                    Ah .. make sure you have this file

                                    /etc/squidanalyzer/squidanalyzer.conf

                                    It should have this inside

                                    This file is the default configuration file for SquidAnalyzer

                                    Edit it to match your needs and copy it under /etc/squidanalyzer/squidanalyzer.conf

                                    Path where SquidAnalyzer should dump all HTML and images files.

                                    Choose a path that can  be read by a Web browser

                                    Output /usr/local/www/squidanalyzer

                                    The URL of the SquidAnalyzer javascript, HTML and images files.

                                    WebUrl /squidanalyzer

                                    Set the path to the Squid log file

                                    LogFile /var/squid/logs/access.log

                                    If you want to use DNS name instead of client Ip address as username enable

                                    this directive. When you don't have authentication, the username is set to

                                    the client ip address, this allow you to use the DNS name instead.

                                    Note that you must have a working DNS resolution and that it can really slow

                                    down the generation of reports.

                                    UseClientDNSName 1

                                    If you have enabled UseClientDNSName and have lot of ip addresses that do

                                    not resolve you may want to increase the DNS lookup timeout. By default

                                    SquidAnalyzer will stop to lookup a DNS name after 0.0001 second (100 ms).

                                    DNSLookupTimeout 0.001

                                    Set the file containing network alias name. Network are

                                    show as Ip addresses so if you want to display name instead

                                    create a file with this format :

                                    LOCATION_NAME IP_NETWORK_ADDRESS

                                    Separator must be a tabulation

                                    NetworkAlias /etc/squidanalyzer/network-aliases

                                    Set the file containing user alias name. If you don't have auth_proxy

                                    enable user are seen as Ip addresses, or if you want to replace login

                                    name by full user name, create a file with this format :

                                    FULL_USERNAME IP_ADDRESS || LOGIN_NAME

                                    Separator must be a tabulation

                                    UserAlias /etc/squidanalyzer/user-aliases

                                    How do we sort Network, User and Url report screen

                                    Value can be: bytes, hits or duration. Default is bytes.

                                    OrderNetwork bytes
                                    OrderUser bytes
                                    OrderUrl bytes

                                    How do we sort Mime types report screen

                                    Value can be: bytes or hits. Default is bytes.

                                    OrderMime bytes

                                    Should we display user URL details. This will show all URL read

                                    by user. Take care to have enougth space disk for large user.

                                    UrlReport 1

                                    Should we display user details. This will show statistics

                                    per user.

                                    UserReport 1

                                    Run in quiet mode or print debug information

                                    QuietMode 1

                                    Cost of the bandwith per Mb. If you want to generate invoice per Mb

                                    for bandwith traffic this can help you. Value 0 mean no cost.

                                    CostPrice 0

                                    Currency of the bandwith cost

                                    Currency €

                                    Top number of url to show

                                    TopNumber 100

                                    Path to the file containing client ip addresses, network ip address,

                                    and/or auth login to exclude from report

                                    Exclude /etc/squidanalyzer/excluded

                                    Path to the file containing client ip addresses, network ip address,

                                    and/or auth login to include into the report. Other entries will be

                                    excluded by default.

                                    Include /etc/squidanalyzer/included

                                    Translation Lang /etc/squidanalyzer/lang/en_US.txt,

                                    en_US.txt, ru_RU.txt, uk_UA.txt, cs_CZ.txt, pl_PL.txt and de_DE.txt).

                                    Default to:

                                    Lang /etc/squidanalyzer/lang/en_US.txt

                                    Date format used to display date (year = %y, month = %m and day = %d)

                                    You can also use %M to replace month by its 3 letters abbreviation.

                                    DateFormat %y-%m-%d

                                    Set this to 1 if you want to anonymize all user login. The username

                                    will be replaced by an unique id that change at each squid-analyzer

                                    run. Default disable.

                                    AnonymizeLogin 0

                                    Adds peer cache hit (CD_SIBLING_HIT) to be taken has local cache hit.

                                    Enabled by default, you must disabled it if you don't want to report

                                    peer cache hit onto your stats.

                                    SiblingHit 1

                                    Set the default unit for transfert size. Default is BYTES, other possible

                                    values are KB, MB and GB

                                    TransfertUnit BYTES

                                    Minimum percentage of data in pie's graphs to not be placed in the others item.

                                    MinPie 2

                                    Set this to your locale to display generated date in your language. Default

                                    is to use strftime. If you want date in German for example, set it to de_DE.

                                    For french, fr_FR should do the work.

                                    Locale en_US

                                    By default SquidAnalyzer is saving current collected statistics each time

                                    a new hour is found in log file. Most of the time this is enough but if

                                    you have huge log file and don't have enough memory this will slow down the

                                    parser by forcing Perl to use temporaries files. Use lower value following

                                    your memory and the size of your log file, on very huge log file with lot of

                                    requests/seconde a value of 30 minutes (1800) or less should help.

                                    WriteDelay 3600

                                    Use this directive to show the top N users that look at an URL or a domain.

                                    Set it to 0 to disable this feature.

                                    TopUrlUser 10

                                    This directive allow you to replace the SquidAnalyze logo by your custom

                                    logo. The default value is defined as follow:

                                    [#

                                    #]($self->{WebUrl}) SquidAnalyzer

                                    Feel free to define your own header but take care to not break current design.

                                    #CustomHeader My ISP Company

                                    This directive allow exclusion of some unwanted methods in report statistics

                                    like HEAD, POST, CONNECT, etc. Can be a comma separated list of methods.

                                    #ExcludedMethods HEAD

                                    This directive allow exclusion of some unwanted mimetypes in report statistics

                                    like text/html, text/plain, or more generally text/*, etc. Can be a comma separated

                                    list of perl regular expression.

                                    #ExcludedMimes text/.,image/.

                                    This directive allow exclusion of some unwanted codes in report statistics

                                    like TCP_DENIED/403 which are generated when a user accesses a page the first

                                    time without authentication. Can be a comma separated list of methods.

                                    #ExcludedCodes TCP_DENIED/403

                                    https://www.dropbox.com/s/vtf7loy2x9lnhl3/squidanalyzer.conf?dl=0

                                    download this file, run winscp and put in the folder on your firewall of
                                    /etc/squidanalyzer/

                                    This should of been created by unzipping the files from my original zip. Not sure why it failed there.  If file exists maybe permission?

                                    squidanalyzer.png
                                    squidanalyzer.png_thumb

                                    Dell 2950 g3 server
                                    Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                                    Current: 2000 MHz, Max: 2667 MHz
                                    8 CPUs: 2 package(s) x 4 core(s)
                                    8152 MiB and 600meg 10k drive
                                    Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                                    1 Reply Last reply Reply Quote 0
                                    • K
                                      killmasta93
                                      last edited by Jan 19, 2016, 4:26 AM

                                      ooOOOooo

                                      I thought i could unzip it and put though winscp oh oh

                                      Alright re did your guide I put
                                      squidanalyzer.rar into /usr/local/www  then on putty rancd /usr/local/www then```
                                      tar -xzf squidanalyzer.rar

                                      
                                      Worked fine
                                      
                                      Then temp.rar  into /      In putty ran```
                                      cd /
                                      ```then```
                                      tar -xzf temp.rar
                                      

                                      and got this error```
                                      temp/squidanalyzer/.git/objects/pack/pack-ef251a8f0489dcdb37651a0598fe5e498ffee007.idx: Parsing filters is unsupported.

                                      
                                      then i exited it out to just run the command```
                                      tar -xzf temp.rar
                                      

                                      and got this error```
                                      tar: Error opening archive: Failed to open 'temp.rar'

                                      
                                      ??? ???
                                      
                                      Thank you
                                      
                                      ![Clipboarder.2016.01.18-009.png](/public/_imported_attachments_/1/Clipboarder.2016.01.18-009.png)
                                      ![Clipboarder.2016.01.18-009.png_thumb](/public/_imported_attachments_/1/Clipboarder.2016.01.18-009.png_thumb)

                                      Tutorials:

                                      https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

                                      1 Reply Last reply Reply Quote 0
                                      • K
                                        killmasta93
                                        last edited by Jan 31, 2016, 1:14 AM Jan 31, 2016, 1:10 AM

                                        Allright so I bought myself a new comp so I had to format pfSense tried to add it again and no luck this time i added the directory

                                        to etc

                                        So when running the command

                                         cd /temp/squidanalyzer/ && perl squid-analyzer -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log
                                        
                                        

                                        I would get

                                        ERROR: you must give a valid output directory. See option: Output
                                        

                                        But isn't the output directory the /var/squid/logs/access.log

                                        Thank you

                                        Clipboarder.2016.01.30-006.png
                                        Clipboarder.2016.01.30-006.png_thumb
                                        Clipboarder.2016.01.30-007.png
                                        Clipboarder.2016.01.30-007.png_thumb
                                        Clipboarder.2016.01.30-009.png
                                        Clipboarder.2016.01.30-009.png_thumb
                                        Clipboarder.2016.01.30-010.png
                                        Clipboarder.2016.01.30-010.png_thumb

                                        Tutorials:

                                        https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

                                        1 Reply Last reply Reply Quote 0
                                        • T
                                          Topper727
                                          last edited by Jan 31, 2016, 7:40 AM

                                          Yes, I also noticed that perl version is now gone from the repository.  I will have to find out what perl will work and not break a system.  As far as the zip file error I think it is bad copy.. I re installed my firewall just recently so I will put this squidanalyzer back in when I do I will update the install steps again to include the new perl and new files if needed

                                          Dell 2950 g3 server
                                          Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                                          Current: 2000 MHz, Max: 2667 MHz
                                          8 CPUs: 2 package(s) x 4 core(s)
                                          8152 MiB and 600meg 10k drive
                                          Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                                          1 Reply Last reply Reply Quote 0
                                          • First post
                                            Last post
                                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                                            [[user:consent.lead]]
                                            [[user:consent.not_received]]