Want package for squidanalyzer. INSTRUCTIONS AND FILES TO INSTALL

Topper727

Ah .. make sure you have this file

/etc/squidanalyzer/squidanalyzer.conf

It should have this inside

This file is the default configuration file for SquidAnalyzer

Edit it to match your needs and copy it under /etc/squidanalyzer/squidanalyzer.conf

Path where SquidAnalyzer should dump all HTML and images files.

Choose a path that can be read by a Web browser

Output /usr/local/www/squidanalyzer

The URL of the SquidAnalyzer javascript, HTML and images files.

WebUrl /squidanalyzer

Set the path to the Squid log file

LogFile /var/squid/logs/access.log

If you want to use DNS name instead of client Ip address as username enable

this directive. When you don't have authentication, the username is set to

the client ip address, this allow you to use the DNS name instead.

Note that you must have a working DNS resolution and that it can really slow

down the generation of reports.

UseClientDNSName 1

If you have enabled UseClientDNSName and have lot of ip addresses that do

not resolve you may want to increase the DNS lookup timeout. By default

SquidAnalyzer will stop to lookup a DNS name after 0.0001 second (100 ms).

DNSLookupTimeout 0.001

Set the file containing network alias name. Network are

show as Ip addresses so if you want to display name instead

create a file with this format :

LOCATION_NAME IP_NETWORK_ADDRESS

Separator must be a tabulation

NetworkAlias /etc/squidanalyzer/network-aliases

Set the file containing user alias name. If you don't have auth_proxy

enable user are seen as Ip addresses, or if you want to replace login

name by full user name, create a file with this format :

FULL_USERNAME IP_ADDRESS || LOGIN_NAME

Separator must be a tabulation

UserAlias /etc/squidanalyzer/user-aliases

How do we sort Network, User and Url report screen

Value can be: bytes, hits or duration. Default is bytes.

OrderNetwork bytes
OrderUser bytes
OrderUrl bytes

How do we sort Mime types report screen

Value can be: bytes or hits. Default is bytes.

OrderMime bytes

Should we display user URL details. This will show all URL read

by user. Take care to have enougth space disk for large user.

UrlReport 1

Should we display user details. This will show statistics

per user.

UserReport 1

Run in quiet mode or print debug information

QuietMode 1

Cost of the bandwith per Mb. If you want to generate invoice per Mb

for bandwith traffic this can help you. Value 0 mean no cost.

CostPrice 0

Currency of the bandwith cost

Currency €

Top number of url to show

TopNumber 100

Path to the file containing client ip addresses, network ip address,

and/or auth login to exclude from report

Exclude /etc/squidanalyzer/excluded

Path to the file containing client ip addresses, network ip address,

and/or auth login to include into the report. Other entries will be

excluded by default.

Include /etc/squidanalyzer/included

Translation Lang /etc/squidanalyzer/lang/en_US.txt,

en_US.txt, ru_RU.txt, uk_UA.txt, cs_CZ.txt, pl_PL.txt and de_DE.txt).

Default to:

Lang /etc/squidanalyzer/lang/en_US.txt

Date format used to display date (year = %y, month = %m and day = %d)

You can also use %M to replace month by its 3 letters abbreviation.

DateFormat %y-%m-%d

Set this to 1 if you want to anonymize all user login. The username

will be replaced by an unique id that change at each squid-analyzer

run. Default disable.

AnonymizeLogin 0

Adds peer cache hit (CD_SIBLING_HIT) to be taken has local cache hit.

Enabled by default, you must disabled it if you don't want to report

peer cache hit onto your stats.

SiblingHit 1

Set the default unit for transfert size. Default is BYTES, other possible

values are KB, MB and GB

TransfertUnit BYTES

Minimum percentage of data in pie's graphs to not be placed in the others item.

MinPie 2

Set this to your locale to display generated date in your language. Default

is to use strftime. If you want date in German for example, set it to de_DE.

For french, fr_FR should do the work.

Locale en_US

By default SquidAnalyzer is saving current collected statistics each time

a new hour is found in log file. Most of the time this is enough but if

you have huge log file and don't have enough memory this will slow down the

parser by forcing Perl to use temporaries files. Use lower value following

your memory and the size of your log file, on very huge log file with lot of

requests/seconde a value of 30 minutes (1800) or less should help.

WriteDelay 3600

Use this directive to show the top N users that look at an URL or a domain.

Set it to 0 to disable this feature.

TopUrlUser 10

This directive allow you to replace the SquidAnalyze logo by your custom

logo. The default value is defined as follow:

[#

#]($self->{WebUrl}) SquidAnalyzer

Feel free to define your own header but take care to not break current design.

#CustomHeader My ISP Company

This directive allow exclusion of some unwanted methods in report statistics

like HEAD, POST, CONNECT, etc. Can be a comma separated list of methods.

#ExcludedMethods HEAD

This directive allow exclusion of some unwanted mimetypes in report statistics

like text/html, text/plain, or more generally text/*, etc. Can be a comma separated

list of perl regular expression.

#ExcludedMimes text/.,image/.

This directive allow exclusion of some unwanted codes in report statistics

like TCP_DENIED/403 which are generated when a user accesses a page the first

time without authentication. Can be a comma separated list of methods.

#ExcludedCodes TCP_DENIED/403

https://www.dropbox.com/s/vtf7loy2x9lnhl3/squidanalyzer.conf?dl=0

download this file, run winscp and put in the folder on your firewall of
/etc/squidanalyzer/

This should of been created by unzipping the files from my original zip. Not sure why it failed there. If file exists maybe permission?

squidanalyzer.png_thumb

killmasta93

ooOOOooo

I thought i could unzip it and put though winscp oh oh

Alright re did your guide I put
squidanalyzer.rar into /usr/local/www then on putty rancd /usr/local/www then```
tar -xzf squidanalyzer.rar


Worked fine

Then temp.rar  into /      In putty ran```
cd /
```then```
tar -xzf temp.rar

and got this error```
temp/squidanalyzer/.git/objects/pack/pack-ef251a8f0489dcdb37651a0598fe5e498ffee007.idx: Parsing filters is unsupported.


then i exited it out to just run the command```
tar -xzf temp.rar

and got this error```
tar: Error opening archive: Failed to open 'temp.rar'


??? ???

Thank you

![Clipboarder.2016.01.18-009.png](/public/_imported_attachments_/1/Clipboarder.2016.01.18-009.png)
![Clipboarder.2016.01.18-009.png_thumb](/public/_imported_attachments_/1/Clipboarder.2016.01.18-009.png_thumb)

killmasta93

Allright so I bought myself a new comp so I had to format pfSense tried to add it again and no luck this time i added the directory

to etc

So when running the command

 cd /temp/squidanalyzer/ && perl squid-analyzer -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log

I would get

ERROR: you must give a valid output directory. See option: Output

But isn't the output directory the /var/squid/logs/access.log

Thank you

Clipboarder.2016.01.30-006.png

Clipboarder.2016.01.30-007.png

Clipboarder.2016.01.30-009.png

Clipboarder.2016.01.30-010.png

Topper727

Yes, I also noticed that perl version is now gone from the repository. I will have to find out what perl will work and not break a system. As far as the zip file error I think it is bad copy.. I re installed my firewall just recently so I will put this squidanalyzer back in when I do I will update the install steps again to include the new perl and new files if needed

killmasta93

thanks hopefully it goes well :)

Also I had lightsquid before and umm…i think it broke it :( any way to fix perl again to get lightsquid working?

Thank you

Topper727

Lightsquid hmm not really looked into what it uses to run. Squidanalyzer is so much more indepth .. wish someone would make a package for it. I am not really that skilled to make yet. and not know the system well enough to know if I will break something till I try it.

I may try tomorrow to get squid analyzer going again. if so I post what I did. I got a clean machine here as I reinstalled cause of too much modding to it got it messy..

killmasta93

Thanks man :) you made something really special ;D appreciate your work

foxnet8

got this working on my virtualbox THANKS your the MAN! ;)

killmasta93

care to share?

Topper727

Well I got it working again. I just copied the files in my tutorial into the /temp/squidanalyzer for the temp.rar (which I had to extract in windows then copy the files over to the directory.

Then the squidanalyzer.rar I copied into /usr/local/www/squidanalyzer

Perl was already version 1.6.2 in my
2.2.6-RELEASE (amd64)
built on Mon Dec 21 14:50:08 CST 2015
FreeBSD firewall.wholesale-florida.com 10.1-RELEASE-p25 FreeBSD 10.1-RELEASE-p25 #0 c39b63e(releng/10.1)-dirty: Mon Dec 21 15:20:13 CST 2015 root@pfs22-amd64-builder:/usr/obj.RELENG_2_2.amd64/usr/pfSensesrc/src.RELENG_2_2/sys/pfSense_SMP.10 amd64

Version

Topper727

Oh I do need the /temp/squidanalyzer folder.. hmm finding which perl will work.

pkg install perl5-5.20.3_8

This seems to put the perl back and not break anything but can't get new data to come in with that

cd /temp/squidanalyzer/ && perl squid-analyzer -r -c /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log /var/squid/logs/

I did have to put the files in /etc/squidanalyzer this is why some get missing config.

Topper727

ok got it!

this is command that worked

cd /temp/squidanalyzer/ && perl squid-analyzer -d -l /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log /var/squid/logs/

screencapture-192-168-5-1-squidanalyzer-2016-02-index-html-1455000167666.png

maverick_slo

Hmm if we only had a package :)

Topper727

I know. I will try learn how to make one. I am pretty good at learning this stuff. I did do programming in the past so not too much to learn I think. If I find the right tools. and maybe a video on how

Topper727

Is there no one who knows how to make packages willing to try to make this one?

Topper727

wish I had money for a bounty. Someone has to be interested with the package for this. And have the skills to do.. maybe even someone with money for bounty to find the right person to do it.

killmasta93

its been a while havent tried it until today still no luck :(

First

cd /temp/squidanalyzer/ && perl squid-analyzer -d -l /etc/squidanalyzer/squidanalyzer.conf /var/squid/logs/access.log /var/squid/logs/

The issue with that the route /etc/squidanalyzer/squidanalyzer.conf it was not created or did i miss something?

I would then unzip temp folder on windows and then place it in the / directory (root) of pfSense

then the squidanalyzer.rar unzip it on a windows copy that folder to /usr/local/www/

but had no luck im going to see if next week ill post a bounty

Topper727

I have done some work to make it the newest version 6.5 and works good. I know now why some people have had some issues.. I really hope someone can make package. Let me know if I should zip up and make easy install for people

Presbuteros

Thank you to Topper and Cino for your input here.

After a lot of reading this is what worked for me:

1. Thousands of additional FreeBSD packages can be installed on pfSense as noted here: https://doc.pfsense.org/index.php/Installing_FreeBSD_Packages

2. In the Index of those FreeBSD packages at this link http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/ you will find that SquidAnalyzer is available as "squidanalyzer-6.5.txz"

3. In the shell enter "pkg add http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/squidanalyzer-6.5.txz" (without quotes)

4. You will receive a confirmation of the install. The squidanalyzer.conf file is in usr/local/etc/squidreport/

5. Run the command manually once: cd /usr/local/bin/ && perl squid-analyzer

6. Set this as a cron job to your desire frequency

7. You should be able to access SquidAnalyzer at x.x.x.x/squidreport

It is cleaner to use pkg to install a FreeBSD package than to use WinSCP to copy and paste items from dropbox into your firewall installation. ;)

AR15USR

@Presbuteros:

Thank you to Topper and Cino for your input here.

After a lot of reading this is what worked for me:

1. Thousands of additional FreeBSD packages can be installed on pfSense as noted here: https://doc.pfsense.org/index.php/Installing_FreeBSD_Packages

2. In the Index of those FreeBSD packages at this link http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/ you will find that SquidAnalyzer is available as "squidanalyzer-6.5.txz"

3. In the shell enter "pkg add http://pkg.freebsd.org/freebsd:10:x86:64/latest/All/squidanalyzer-6.5.txz" (without quotes)

4. You will receive a confirmation of the install. The squidanalyzer.conf file is in usr/local/etc/squidreport/

5. Run the command manually once: cd /usr/local/bin/ && perl squid-analyzer

6. Set this as a cron job to your desire frequency

7. You should be able to access SquidAnalyzer at x.x.x.x/squidreport

It is cleaner to use pkg to install a FreeBSD package than to use WinSCP to copy and paste items from dropbox into your firewall installation. ;)

At step 5 I get this error:

[2.3.3-RELEASE][admin@xxxx.lan]/usr/local/bin: cd /usr/local/bin/ && perl squid-analyzer -r -c /var/squid/logs/access.log
ERROR: you must give a valid output directory. See option: Output

Also, the output from the pkg install says:

Message from squidanalyzer-6.5:
-----------------------------------------------------------------------------
1\. Modify your httpd.conf to allow access to HTML output like follow:
        Alias /squidreport /usr/local/www/squidreport
        <directory usr="" local="" www="" squidreport="">Options -Indexes FollowSymLinks MultiViews
            AllowOverride None
            Order deny,allow
            Deny from all
            Allow from 127.0.0.1</directory> 
2\. If necessary, give additional host access to SquidAnalyzer in httpd.conf.
   Restart and ensure that httpd is running.
3\. Browse to http://my.host.dom/squidreport/ to ensure that things are working
   properly.
4\. Setup a cronjob to run squid-analyzer daily:

     # SquidAnalyzer log reporting daily
     0 2 * * * /usr/local/bin/squid-analyzer > /dev/null 2>&1

or run it manually.
For more information, see /usr/local/share/doc/squidanalyzer/README file.

Where is the httpd.conf file located?