SquidGuard 1.9.18 crashing

josey

2.2.5 release amd 64
AMD Athlon 64 X2 Dual Core Processor 6000+
2gb ram

installed packages
freeradius2 -- 1.6.19
iperf -- 2.0.5.4
squid 3 -- 0.4.6
squidguard -- 1.9.18

thing is,
squid3 works perfectly, (and radius but it is not important for this problem) until i enable squidguard.
Than, machine becomes unbelievably slow, and it does not pass internet traffic.
even ssh is unbelievably slow, it takes few times to log on to machine.

under
services
-squidguard proxy
--general settings
after i uncheck enable, and apply settings, pfs machine is busy for couple of minutes, but
SquidGuard service state said STARTED. ??

only thing i can do is restart machine, and then everything works as before enabling squidguard.
Again, same thing if i enable it again.

i tried to, reinstall packages, delete them, reinstall them with different order (squid than squidguard, and squidguard than squid) same thing.

oh, i followed https://forum.pfsense.org/index.php?topic=94312.0

suggestions ?

thanks

doktornotor

Out of RAM pretty likely.

josey

with squid started,
dashboard status, 25% of 2gb used.

I just realized i have 4x 1gb in machine, and PFS sees only 2gb.

I will investigate this and let you know is it amount of RAM issue.

doktornotor

Uhm… Looks like you installed i386 instead of amd64. Bad idea.

josey

nope, its AMD 64 version

_(2.2.5-RELEASE (amd64)
built on Wed Nov 04 15:49:37 CST 2015
FreeBSD 10.1-RELEASE-p24

You are on the latest version.)_

ram was kit, so 1gb kit is actually 2x 512m. so 4x 512 is 2gb

however,
swapped for 2x 2gb
PFS sees it like 4gb

with squid started 7% of ram used
with squid guard 17% of ram used

but same thing,
machine become unbelievably slow.

Even with keyboard connected to machine i couldnt hit "5" - reboot for few minutes after i enable/ disable squidguard.

KOM

Pleas read this thread and follow the same suggestions:

https://forum.pfsense.org/index.php?topic=101642.0

josey

ok,
im not using NTLM auth
4gb ram used 7-10%
4gb swap used 0%
2x 320gb hdd
cpu 10%

KOM

SSH in and run:
squidclient -h LAN_IP_ADDRESS -p 3128 mgr:info
and look at the Median Service Times. See if anything looks out of order. Also check your Squid logs at /var/squid/logs/cache.log.

josey

hm….

-diagnostics
-- edit file

load from path /var/squid/logs/cache.log
2015/12/04 00:00:00| pinger: Initialising ICMP pinger …
2015/12/04 06:45:03 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 06:45:06 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 06:45:10 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 06:45:13 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 07:00:18 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_CONNECT_FAIL': (2) No such file or directory
2015/12/04 07:14:29 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 07:21:07 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 07:21:10 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory
2015/12/04 07:24:52 kid1| '/usr/local/etc/squid/errors/hr-hr/ERR_ACCESS_DENIED': (2) No such file or directory

-diagnostics
–command prompt

execute command
$ /var/squid/logs/cache.log
/var/squid/logs/cache.log: Permission denied

-diagnostics
–command prompt

squidclient -h 10.10.0.254 -p 3128 mgr:info

attached

SSH

[2.2.5-RELEASE][admin@router]/root: squidclient -h 10.10.0.0254 -p 3128 mgr:info
=> nothing happens

it seems like permission problem?

best thing would be to format hdd and make fresh install ?

[squidclient -h.txt](/public/imported_attachments/1/squidclient -h.txt)

doktornotor

@josey:

-diagnostics
– edit file
load from path /var/squid/logs/cache.log

What?! OMG, there's Real Time tab with logs. Look there!

Other than that, which part of SSH in and run was unclear? Do NOT paste this into the GUI!

KOM

or go to pfSense console and select option 8) Shell

josey

yes i did that,
i get same result as from webgui. (attached in reply before this one)

and isnt that exact same thing?

also i think this may be related to the fact i cant make fresh install to 2.2.5,
and i realized that few minutes ago.
freebsd does not communicate good with sata controller on mainboard.

KOM

Well, that's not a good sign.

josey

agree :(
i think this two issues are related
https://forum.pfsense.org/index.php?topic=103090.0

josey

update,
fresh install of 2.2.5 us up (with new HDD and new RAM)
i didnt restore config.xml

squidclient -h LAN_IP_ADDRESS -p 3128 mgr:info

gives same error as before

BUT this time it seems squidguard is working well, no crashing anymore.

$ squidclient -h 192.168.7.254 -p 3128 mgr:info
Sending HTTP request … done.
HTTP/1.1 403 Forbidden
Server: squid/3.4.10
Mime-Version: 1.0
Date: Wed, 09 Dec 2015 10:14:36 GMT
Content-Type: text/html
Content-Length: 3102
X-Squid-Error: ERR_ACCESS_DENIED 0
Vary: Accept-Language
Content-Language: en
X-Cache: MISS from localhost
X-Cache-Lookup: NONE from localhost:3128
Via: 1.1 localhost (squid/3.4.10)
Connection: close

<title>ERROR: The requested URL could not be retrieved</title>

ERROR

The requested URL could not be retrieved

The following error was encountered while trying to retrieve the URL: cache_object://192.168.7.254/info

Access Denied.

Access control configuration prevents your request from being allowed at this time. Please contact your service provider if you feel this is incorrect.

Your cache administrator is admin@localhost.

Generated Wed, 09 Dec 2015 10:14:36 GMT by localhost (squid/3.4.10)

i guess until it works i dont have to be worried about ?

aGeekhere

I get the same error with

squidclient -h LAN_IP_ADDRESS -p 3128 mgr:info

But it does not affect squid or squidguard, so don't know.

doktornotor

Do NOT use LAN_IP, use 127.0.0.1


squidclient -h 127.0.0.1 -p 3128 mgr:info

josey

i did, before posting (updating topic)
tried with localhost and with 127.0.0.1

$ squidclient -h 127.0.0.1 -p 3128 mgr:info
client: ERROR: Cannot connect to 127.0.0.1:3128: Operation timed out

doktornotor

Then make Squid listen on loopback.

josey

finally

squidclient -h 127.0.0.1 -p 3128 mgr:info

do the trick

from "broken" machine, but everything looks fine :(

$ squidclient -h 127.0.0.1 -p 3128 mgr:info
Sending HTTP request … done.
HTTP/1.1 200 OK
Server: squid
Mime-Version: 1.0
Date: Wed, 09 Dec 2015 11:14:42 GMT
Content-Type: text/plain
Expires: Wed, 09 Dec 2015 11:14:42 GMT
Last-Modified: Wed, 09 Dec 2015 11:14:42 GMT
X-Cache: MISS from localhost
X-Cache-Lookup: MISS from localhost:3128
Via: 1.1 localhost (squid)
Connection: close

Squid Object Cache: Version 3.4.10
Build Info:
Start Time: Thu, 03 Dec 2015 09:42:00 GMT
Current Time: Wed, 09 Dec 2015 11:14:42 GMT
Connection information for squid:
Number of clients accessing cache: 71
Number of HTTP requests received: 316414
Number of ICP messages received: 0
Number of ICP messages sent: 0
Number of queued ICP replies: 0
Number of HTCP messages received: 0
Number of HTCP messages sent: 0
Request failure ratio: 0.00
Average HTTP requests per minute since start: 36.2
Average ICP messages per minute since start: 0.0
Select loop called: 22462701 times, 23.326 ms avg
Cache information for squid:
Hits as % of all requests: 5min: 9.7%, 60min: 12.7%
Hits as % of bytes sent: 5min: 0.8%, 60min: 2.9%
Memory hits as % of hit requests: 5min: 28.7%, 60min: 17.4%
Disk hits as % of hit requests: 5min: 5.7%, 60min: 10.1%
Storage Swap size: 2750244 KB
Storage Swap capacity: 1.3% used, 98.7% free
Storage Mem size: 64592 KB
Storage Mem capacity: 98.6% used, 1.4% free
Mean Object Size: 25.29 KB
Requests given to unlinkd: 8463
Median Service Times (seconds) 5 min 60 min:
HTTP Requests (All): 0.10281 0.12783
Cache Misses: 0.28853 0.18699
Cache Hits: 0.00000 0.00000
Near Hits: 0.00286 0.10857
Not-Modified Replies: 0.00000 0.00000
DNS Lookups: 0.08334 0.06963
ICP Queries: 0.00000 0.00000
Resource usage for squid:
UP Time: 523961.789 seconds
CPU Time: 961.271 seconds
CPU Usage: 0.18%
CPU Usage, 5 minute avg: 1.89%
CPU Usage, 60 minute avg: 0.96%
Maximum Resident Size: 1006864 KB
Page faults with physical i/o: 0
Memory accounted for:
Total accounted: 106905 KB
memPoolAlloc calls: 67766971
memPoolFree calls: 69055066
File descriptor usage for squid:
Maximum number of file descriptors: 116910
Largest file desc currently in use: 363
Number of file desc currently in use: 111
Files queued for open: 0
Available number of file descriptors: 116799
Reserved number of file descriptors: 100
Store Disk files open: 0
Internal Data Structures:
108796 StoreEntries
13048 StoreEntries with MemObjects
13045 Hot Object Cache Items
108741 on-disk objects