Squid exited due to repeated failures
-
Hi folks, I'm getting the problem described in this thread, however the solutions posted there haven't worked for me. I thought that given they didn't work it would probably be a good idea to have a separate thread.
So, here's what I've tried, in order:
- Restarted pfsense
- Cleared cache
- Designated new cache folder
- Halved the log rotation period (saw another page that mentioned this might be the issue)
I haven't tried reducing the cache size because I would have expected clearing the cache to solve the problem (at least temporarily) if that was the solution. It didn't.
Effectively what I get in my logs is a repeating cycle of the following:
Sep 30 22:14:00 php: servicewatchdog_cron.php: Service Watchdog detected service squid stopped. Restarting squid (Proxy server Service)
Sep 30 22:13:20 squid[51949]: Exiting due to repeated, frequent failures
Sep 30 22:13:20 kernel: pid 59274 (squid), uid 62: exited on signal 6
Sep 30 22:13:20 squid[51949]: Squid Parent: child process 59274 exited due to signal 6
Sep 30 22:13:20 squid[59274]: msgget failed
Sep 30 22:13:20 squid[51949]: Squid Parent: child process 59274 started
Sep 30 22:13:17 kernel: pid 57633 (squid), uid 62: exited on signal 6
Sep 30 22:13:17 squid[51949]: Squid Parent: child process 57633 exited due to signal 6
Sep 30 22:13:17 squid[57633]: msgget failed
Sep 30 22:13:17 squid[51949]: Squid Parent: child process 57633 started
Sep 30 22:13:14 kernel: pid 55950 (squid), uid 62: exited on signal 6
Sep 30 22:13:14 squid[51949]: Squid Parent: child process 55950 exited due to signal 6
Sep 30 22:13:14 squid[55950]: msgget failed
Sep 30 22:13:13 squid[51949]: Squid Parent: child process 55950 started
Sep 30 22:13:10 kernel: pid 54451 (squid), uid 62: exited on signal 6
Sep 30 22:13:10 squid[51949]: Squid Parent: child process 54451 exited due to signal 6
Sep 30 22:13:10 squid[54451]: msgget failed
Sep 30 22:13:10 squid[51949]: Squid Parent: child process 54451 started
Sep 30 22:13:07 kernel: pid 52399 (squid), uid 62: exited on signal 6
Sep 30 22:13:07 squid[51949]: Squid Parent: child process 52399 exited due to signal 6
Sep 30 22:13:07 squid[52399]: msgget failed
Sep 30 22:13:07 squid[51949]: Squid Parent: child process 52399 started
Sep 30 22:13:07 php: servicewatchdog_cron.php: Service Watchdog detected service squidGuard stopped. Restarting squidGuard (Proxy server filter Service)
Sep 30 22:13:05 php: servicewatchdog_cron.php: The command '/usr/local/etc/rc.d/squid.sh stop' returned exit code '1', the output was '2014/09/30 22:13:00| aclParseAclLine: WARNING: empty ACL: acl throttle_exts urlpath_regex -i "/var/squid/acl/throttle_exts.acl" squid: ERROR: Could not send signal 15 to process 59270: (3) No such process'
Sep 30 22:13:00 php: servicewatchdog_cron.php: Service Watchdog detected service squid stopped. Restarting squid (Proxy server Service)The log folder is currently 160Mb. The cache folder was 614Mb before I cleared it.
-
OK, benefits of going away and doing something completely different for 15 minutes, I think I may have figured out what this is. I'll add to this once I confirm one way or the other, but for now let's just say if you run your PFSense box as a VM and then start doing I/O intensive stuff with other VMs, be prepared for some Weird Shenanigans.
UPDATE:
It wasn't disk I/O. That's stopped and the problem's still present. Halp!
-
You could try clearing the cache. SSH in and run:
mv /var/squid/cache /var/squid/cache.old
squid -z
rm -rf /var/squid/cache.old -
No change, sorry. When I run squid -z I get the following message: (don't know if it's relevant)
aclParseAclLine: WARNING: empty ACL: acl throttle_exts urlpath_regex -i "/var/squid/acl/throttle_exts.acl"
-
I saw that initially but wasn't sure it was the root cause of your problem. You could try checking your ACLs for obvious problems (like being blank or empty) and then recreating them.
