Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Want package for squidanalyzer. INSTRUCTIONS AND FILES TO INSTALL

    Scheduled Pinned Locked Moved Cache/Proxy
    94 Posts 18 Posters 28.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • T
      Topper727
      last edited by

      Lightsquid hmm not really looked into what it uses to run.  Squidanalyzer is so much more indepth .. wish someone would make a package for it. I am not really that skilled to make yet. and not know the system well enough to know if I will break something till I try it.

      I may try tomorrow to get squid analyzer going again. if so I post what I did. I got a clean machine here as I reinstalled cause of too much modding to it got it messy..

      Dell 2950 g3 server
      Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
      Current: 2000 MHz, Max: 2667 MHz
      8 CPUs: 2 package(s) x 4 core(s)
      8152 MiB and 600meg 10k drive
      Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

      1 Reply Last reply Reply Quote 0
      • K
        killmasta93
        last edited by

        Thanks man :) you made something really special  ;D appreciate your work

        Tutorials:

        https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

        1 Reply Last reply Reply Quote 0
        • F
          foxnet8
          last edited by

          got this working on my virtualbox THANKS your the MAN! ;)

          1 Reply Last reply Reply Quote 0
          • K
            killmasta93
            last edited by

            care to share?

            Tutorials:

            https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

            1 Reply Last reply Reply Quote 0
            • T
              Topper727
              last edited by

              Well I got it working again. I just copied the files in my tutorial into the /temp/squidanalyzer for the temp.rar (which I had to extract in windows then copy the files over to the directory.

              Then the squidanalyzer.rar I copied into /usr/local/www/squidanalyzer

              Perl was already version 1.6.2 in my
              2.2.6-RELEASE (amd64)
              built on Mon Dec 21 14:50:08 CST 2015
              FreeBSD firewall.wholesale-florida.com 10.1-RELEASE-p25 FreeBSD 10.1-RELEASE-p25 #0 c39b63e(releng/10.1)-dirty: Mon Dec 21 15:20:13 CST 2015 root@pfs22-amd64-builder:/usr/obj.RELENG_2_2.amd64/usr/pfSensesrc/src.RELENG_2_2/sys/pfSense_SMP.10 amd64

              Version

              Dell 2950 g3 server
              Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
              Current: 2000 MHz, Max: 2667 MHz
              8 CPUs: 2 package(s) x 4 core(s)
              8152 MiB and 600meg 10k drive
              Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

              1 Reply Last reply Reply Quote 0
              • T
                Topper727
                last edited by

                Oh I do need the /temp/squidanalyzer folder.. hmm finding which perl will work.

                pkg install perl5-5.20.3_8

                This seems to put the perl back and not break anything but can't get new data to come in with that

                cd /temp/squidanalyzer/ && perl squid-analyzer -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log /var/squid/logs/

                I did have to put the files in /etc/squidanalyzer this is why some get missing config.

                Dell 2950 g3 server
                Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                Current: 2000 MHz, Max: 2667 MHz
                8 CPUs: 2 package(s) x 4 core(s)
                8152 MiB and 600meg 10k drive
                Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                1 Reply Last reply Reply Quote 0
                • T
                  Topper727
                  last edited by

                  ok got it!

                  this is command that worked

                  cd /temp/squidanalyzer/ && perl squid-analyzer -d -l /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log /var/squid/logs/

                  screencapture-192-168-5-1-squidanalyzer-2016-02-index-html-1455000167666.png
                  screencapture-192-168-5-1-squidanalyzer-2016-02-index-html-1455000167666.png_thumb

                  Dell 2950 g3 server
                  Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                  Current: 2000 MHz, Max: 2667 MHz
                  8 CPUs: 2 package(s) x 4 core(s)
                  8152 MiB and 600meg 10k drive
                  Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                  1 Reply Last reply Reply Quote 0
                  • M
                    maverick_slo
                    last edited by

                    Hmm if we only had a package :)

                    1 Reply Last reply Reply Quote 0
                    • T
                      Topper727
                      last edited by

                      I know.  I will try learn how to make one.  I am pretty good at learning this stuff.  I did do programming in the past so not too much to learn I think. If I find the right tools. and maybe a video on how

                      Dell 2950 g3 server
                      Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                      Current: 2000 MHz, Max: 2667 MHz
                      8 CPUs: 2 package(s) x 4 core(s)
                      8152 MiB and 600meg 10k drive
                      Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                      1 Reply Last reply Reply Quote 0
                      • T
                        Topper727
                        last edited by

                        Is there no one who knows how to make packages willing to try to make this one?

                        Dell 2950 g3 server
                        Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                        Current: 2000 MHz, Max: 2667 MHz
                        8 CPUs: 2 package(s) x 4 core(s)
                        8152 MiB and 600meg 10k drive
                        Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                        1 Reply Last reply Reply Quote 0
                        • T
                          Topper727
                          last edited by

                          wish I had money for a bounty.  Someone has to be interested with the package for this. And have the skills to do.. maybe even someone with money for bounty to find the right person to do it.

                          Dell 2950 g3 server
                          Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                          Current: 2000 MHz, Max: 2667 MHz
                          8 CPUs: 2 package(s) x 4 core(s)
                          8152 MiB and 600meg 10k drive
                          Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                          1 Reply Last reply Reply Quote 0
                          • K
                            killmasta93
                            last edited by

                            its been a while havent tried it until today still no luck :(

                            First

                            cd /temp/squidanalyzer/ && perl squid-analyzer -d -l /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log /var/squid/logs/
                            

                            The issue with that the route /etc/squidanalyzer/squidanalyzer.conf it was not created or did i miss something?

                            I would then unzip temp folder on windows and then place it in the  / directory (root) of pfSense

                            then the squidanalyzer.rar unzip  it on a windows copy that folder to /usr/local/www/

                            but had no luck im going to see if next week ill post a bounty

                            Tutorials:

                            https://www.mediafire.com/folder/v329emaz1e9ih/Tutorials

                            1 Reply Last reply Reply Quote 0
                            • T
                              Topper727
                              last edited by

                              I have done some work to make it the newest version 6.5 and works good.  I know now why some people have had some issues.. I really hope someone can make package. Let me know if I should zip up and make easy install for people

                              Dell 2950 g3 server
                              Intel(R) Xeon(R) CPU E5430 @ 2.66GHz
                              Current: 2000 MHz, Max: 2667 MHz
                              8 CPUs: 2 package(s) x 4 core(s)
                              8152 MiB and 600meg 10k drive
                              Pfsense 2.4 .. Hoping to get the phpvirtualbox going again.

                              1 Reply Last reply Reply Quote 0
                              • P
                                Presbuteros
                                last edited by

                                Thank you to Topper and Cino for your input here.

                                After a lot of reading this is what worked for me:

                                1. Thousands of additional FreeBSD packages can be installed on pfSense as noted here: https://doc.pfsense.org/index.php/Installing_FreeBSD_Packages

                                2. In the Index of those FreeBSD packages at this link http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/ you will find that SquidAnalyzer is available as "squidanalyzer-6.5.txz"

                                3. In the shell enter "pkg add http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/squidanalyzer-6.5.txz" (without quotes)

                                4. You will receive a confirmation of the install. The squidanalyzer.conf file is in usr/local/etc/squidreport/

                                5. Run the command manually once: cd /usr/local/bin/ && perl squid-analyzer

                                6. Set this as a cron job to your desire frequency

                                7. You should be able to access SquidAnalyzer at  x.x.x.x/squidreport

                                It is cleaner to use pkg to install a FreeBSD package than to use WinSCP to copy and paste items from dropbox into your firewall installation.  ;)

                                1 Reply Last reply Reply Quote 0
                                • A
                                  AR15USR
                                  last edited by

                                  @Presbuteros:

                                  Thank you to Topper and Cino for your input here.

                                  After a lot of reading this is what worked for me:

                                  1. Thousands of additional FreeBSD packages can be installed on pfSense as noted here: https://doc.pfsense.org/index.php/Installing_FreeBSD_Packages

                                  2. In the Index of those FreeBSD packages at this link http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/ you will find that SquidAnalyzer is available as "squidanalyzer-6.5.txz"

                                  3. In the shell enter "pkg add http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/squidanalyzer-6.5.txz" (without quotes)

                                  4. You will receive a confirmation of the install. The squidanalyzer.conf file is in usr/local/etc/squidreport/

                                  5. Run the command manually once: cd /usr/local/bin/ && perl squid-analyzer

                                  6. Set this as a cron job to your desire frequency

                                  7. You should be able to access SquidAnalyzer at  x.x.x.x/squidreport

                                  It is cleaner to use pkg to install a FreeBSD package than to use WinSCP to copy and paste items from dropbox into your firewall installation.  ;)

                                  At step 5 I get this error:

                                  [2.3.3-RELEASE][admin@xxxx.lan]/usr/local/bin: cd /usr/local/bin/ && perl squid-analyzer -r -c /var/squid/logs/access.log
                                  ERROR: you must give a valid output directory. See option: Output
                                  

                                  Also, the output from the pkg install says:

                                  Message from squidanalyzer-6.5:
                                  -----------------------------------------------------------------------------
                                  1\. Modify your httpd.conf to allow access to HTML output like follow:
                                          Alias /squidreport /usr/local/www/squidreport
                                          <directory usr="" local="" www="" squidreport="">Options -Indexes FollowSymLinks MultiViews
                                              AllowOverride None
                                              Order deny,allow
                                              Deny from all
                                              Allow from 127.0.0.1</directory> 
                                  2\. If necessary, give additional host access to SquidAnalyzer in httpd.conf.
                                     Restart and ensure that httpd is running.
                                  3\. Browse to http://my.host.dom/squidreport/ to ensure that things are working
                                     properly.
                                  4\. Setup a cronjob to run squid-analyzer daily:
                                  
                                       # SquidAnalyzer log reporting daily
                                       0 2 * * * /usr/local/bin/squid-analyzer > /dev/null 2>&1
                                  
                                  or run it manually.
                                  For more information, see /usr/local/share/doc/squidanalyzer/README file.
                                  

                                  Where is the httpd.conf file located?


                                  2.6.0-RELEASE

                                  1 Reply Last reply Reply Quote 0
                                  • D
                                    doktornotor Banned
                                    last edited by

                                    There is no httpd.conf anywhere, obviously. Apache is not part of pfSense install.

                                    1 Reply Last reply Reply Quote 0
                                    • A
                                      AR15USR
                                      last edited by

                                      Well not obvious to a non developer home user like myself, but now I know. Thanks.

                                      I'm a bit out of my league without a walk through on this one, so I will have to hope for a package as well..

                                      If I run "pkg delete squidanalyzer-6.5.txz" will I break anything? (will that even work?)


                                      2.6.0-RELEASE

                                      1 Reply Last reply Reply Quote 0
                                      • P
                                        Presbuteros
                                        last edited by

                                        @AR15USR:

                                        At step 5 I get this error:

                                        [2.3.3-RELEASE][admin@xxxx.lan]/usr/local/bin: cd /usr/local/bin/ && perl squid-analyzer -r -c /var/squid/logs/access.log
                                        ERROR: you must give a valid output directory. See option: Output
                                        

                                        AR15USR no need to uninstall the package, you are almost there. I failed to mention in my install notes that there is no httpd.conf. Instead there is squidanalyzer.conf and it is asking for a valid output directory. This file is located in

                                        /usr/local/etc/squidreport/

                                        You can edit squidanalyzer.conf by navigating to Diagnostics>Edit File>Browse and browse to that location. Or you can paste /usr/local/etc/squidreport/ into the "Path to be edited" bar and choose "Browse." Either way will get to the folder you need to be in to see squidanalyzer.conf

                                        You can find your default Log Store Directory settings under Services>Squid Proxy Server>General. That log file location needs to be entered into the squidanalyzer.conf file. It is likely the default directory /var/squid/logs/access.log  See below the section of the .conf file you will need to edit.

                                        
                                        # Set the path to the Squid, squidGuard and/or ufdbGuard log files
                                        LogFile	/var/squid/logs/access.log
                                        
                                        

                                        Once you edit the .conf file, run this command again:  cd /usr/local/bin/ && perl squid-analyzer

                                        Then navigate to x.x.x.x/squidreport and enjoy.

                                        Let us know how it goes.

                                        1 Reply Last reply Reply Quote 0
                                        • A
                                          AR15USR
                                          last edited by

                                          Thanks for the help Presbuteros. I got the squidanalyzer.conf file edited and ran the command. It took a while to finish but it did so with no error.

                                          When I pointed my browser to http://192.168.1.1/squidreport I get "403 Forbidden nginx".

                                          EDIT: It works if I go to http://192.168.1.1/squidreport/2017/
                                          I browsed the /squidreport folder and there is no .html file in there:

                                          /usr/local/www/squidreport
                                            ..
                                            2016
                                            2017
                                            images
                                            SquidAnalyzer.current
                                            flotr2.js
                                            sorttable.js
                                            squidanalyzer.css
                                          

                                          2.6.0-RELEASE

                                          1 Reply Last reply Reply Quote 0
                                          • P
                                            Presbuteros
                                            last edited by

                                            AR15USR glad you did not give up. Interesting that that x.x.x.x/squidreport doesn't work but x.x.x.x/squidreport/2017/ does.
                                            Also interesting that an "index.html" file was not created when the command was run.

                                            I have recreated your issue on my install by deleting my index.html in /usr/local/www/squidreport/  However, when I run the command

                                            cd /usr/local/bin/ && perl squid-analyzer
                                            

                                            the index.html file is created again and I can access Squidanalyzer at my x.x.x.x/squidreport

                                            Try this:

                                            1. Compare your .conf file to mine

                                            
                                            ####
                                            # This file is the default configuration file for SquidAnalyzer
                                            # Edit it to match your needs and copy it under /usr/local/etc/squidreport/squidanalyzer.conf
                                            #####
                                            
                                            # Path where SquidAnalyzer should dump all HTML and images files.
                                            # Choose a path that can be read by a Web browser
                                            Output	/usr/local/www/squidreport
                                            
                                            # The URL of the SquidAnalyzer javascript, HTML and images files.
                                            WebUrl	/squidreport
                                            
                                            # Set the path to the Squid, squidGuard and/or ufdbGuard log files
                                            LogFile	/var/squid/logs/access.log
                                            
                                            # If you want to use DNS name instead of client Ip address as username enable
                                            # this directive. When you don't have authentication, the username is set to
                                            # the client ip address, this allow you to use the DNS name instead.
                                            # Note that you must have a working DNS resolution and that it can really slow
                                            # down the generation of reports.
                                            UseClientDNSName	0
                                            
                                            # If you have enabled UseClientDNSName and have lot of ip addresses that do
                                            # not resolve you may want to increase the DNS lookup timeout. By default
                                            # SquidAnalyzer will stop to lookup a DNS name after 0.0001 second (100 ms).
                                            DNSLookupTimeout	0.0001
                                            
                                            # Set the file containing network alias name. Network are
                                            # show as Ip addresses so if you want to display name instead
                                            # create a file with this format :
                                            # LOCATION_NAME	IP_NETWORK_ADDRESS
                                            # Separator must be a tabulation
                                            NetworkAlias	/usr/local/etc/squidreport/network-aliases
                                            
                                            # Set the file containing user alias name. If you don't have auth_proxy
                                            # enable user are seen as Ip addresses, or if you want to replace login
                                            # name by full user name, create a file with this format :
                                            # FULL_USERNAME	IP_ADDRESS || LOGIN_NAME
                                            # Separator must be a tabulation
                                            UserAlias	/usr/local/etc/squidreport/user-aliases
                                            
                                            # How do we sort Network, User and Url report screen
                                            # Value can be: bytes, hits or duration. Default is bytes.
                                            OrderNetwork	bytes
                                            OrderUser	bytes
                                            OrderUrl	bytes
                                            
                                            # How do we sort Mime types report screen
                                            # Value can be: bytes or hits. Default is bytes.
                                            OrderMime	bytes
                                            
                                            # Should we display user URL details. This will show all URL read
                                            # by user. Take care to have enougth space disk for large user.
                                            UrlReport	1
                                            
                                            # Enable this directive if you don't want the tree Top URL and Domain HTML tables.
                                            # You will just have the table of Url/Domain ordered per hits then you can still
                                            # sort the URL/Domain order by clicking on each column
                                            UrlHitsOnly	0
                                            
                                            # Should we display user details. This will show statistics per user.
                                            UserReport	1
                                            
                                            # Run in quiet mode or print debug information
                                            QuietMode	1
                                            
                                            # Cost of the bandwith per Mb. If you want to generate invoice per Mb
                                            # for bandwith traffic this can help you. Value 0 mean no cost.
                                            CostPrice	0
                                            
                                            # Currency of the bandwith cost
                                            Currency	$
                                            
                                            # Top number of url to show
                                            TopNumber	300
                                            
                                            # Path to the file containing client ip addresses, network ip address,
                                            # and/or auth login to exclude from report
                                            Exclude	/usr/local/etc/squidreport/excluded
                                            
                                            # Path to the file containing client ip addresses, network ip address,
                                            # and/or auth login to include into the report. Other entries will be
                                            # excluded by default.
                                            Include	/usr/local/etc/squidreport/included
                                            
                                            # Translation Lang	/usr/local/etc/squidreport/lang/en_US.txt,
                                            # en_US.txt, ru_RU.txt, uk_UA.txt, cs_CZ.txt, pl_PL.txt and de_DE.txt).
                                            # Default to:
                                            #Lang	/usr/local/etc/squidreport/lang/en_US.txt
                                            
                                            # Date format used to display date (year = %y, month = %m and day = %d)
                                            # You can also use %M to replace month by its 3 letters abbreviation.
                                            DateFormat	%y-%m-%d
                                            
                                            # Set this to 1 if you want to anonymize all user login. The username
                                            # will be replaced by an unique id that change at each squid-analyzer
                                            # run. Default disable.
                                            AnonymizeLogin	0
                                            
                                            # Adds peer cache hit (CD_SIBLING_HIT) to be taken has local cache hit.
                                            # Enabled by default, you must disabled it if you don't want to report
                                            # peer cache hit onto your stats.
                                            SiblingHit	1
                                            
                                            # Set the default unit for transfert size. Default is BYTES, other possible
                                            # values are KB, MB and GB
                                            TransfertUnit	BYTES
                                            
                                            # Minimum percentage of data in pie's graphs to not be placed in the others item.
                                            MinPie		2
                                            
                                            # Set this to your locale to display generated date in your language. Default
                                            # is to use strftime. If you want date in German for example, set it to de_DE.
                                            # For french, fr_FR should do the work.
                                            #Locale		en_US
                                            
                                            # By default SquidAnalyzer is saving current collected statistics each time
                                            # a new hour is found in log file. Most of the time this is enough but if
                                            # you have huge log file and don't have enough memory this will slow down the
                                            # parser by forcing Perl to use temporaries files. Use lower value following
                                            # your memory and the size of your log file, on very huge log file with lot of
                                            # requests/seconde a value of 30 minutes (1800) or less should help.
                                            WriteDelay	3600
                                            
                                            # Use this directive to show the top N users that look at an URL or a domain.
                                            # Set it to 0 to disable this feature.
                                            TopUrlUser	20
                                            
                                            # This directive allow you to replace the SquidAnalyze logo by your custom
                                            # logo. The default value is defined as follow:
                                            # [
                                            # ![]($self->{WebUrl}images/logo-squidanalyzer.png "SquidAnalyzer $VERSION")
                                            # ]($self->{WebUrl}) SquidAnalyzer
                                            # Feel free to define your own header but take care to not break current design.
                                            #CustomHeader	[![](http://my.isp.dom/logo.png "My ISP link")](http://my.isp.dom/) My ISP Company
                                            
                                            # This directive allow exclusion of some unwanted methods in report statistics
                                            # like HEAD, POST, CONNECT, etc. Can be a comma separated list of methods.
                                            #ExcludedMethods	HEAD
                                            
                                            # This directive allow exclusion of some unwanted mimetypes in report statistics
                                            # like text/html, text/plain, or more generally text/*, etc. Can be a comma separated
                                            # list of perl regular expression.
                                            #ExcludedMimes	text/.*,image/.*
                                            
                                            # This directive allow exclusion of some unwanted codes in report statistics
                                            # like TCP_DENIED/403 which are generated when a user accesses a page the first
                                            # time without authentication. Can be a comma separated list of methods.
                                            #ExcludedCodes	TCP_DENIED/403
                                            
                                            # When SquidAnalyzer find a corrupted line in his data file, it exit immedialtly.
                                            # You can force him to wait for a certain amount of errors before exiting. Of
                                            # course you might want to remove the corrupted line before the next run. This
                                            # can be useful if you have special characters in some fields like mime type.
                                            #MaxFormatError	0
                                            
                                            # Set timezone to use when SquidAnalyzer is used in a different server than
                                            # the one running squid and there is a different timezone between these two
                                            # machine. The value must follow format: +/-HH. Default is to use local time.
                                            #TimeZone	+01
                                            
                                            

                                            2. Reboot (if you haven't already tried this)

                                            Keep us updated…

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.