Squidguard memory exhausted

UnderCover

i uploaded one blacklist from one website

when i try to upload another one from another website i get

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 9111760 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1651

is this because hard drive is full or memory (ram) is full

if its the ram is there anyway to write the blacklist to the hd?

dvserg

What you pfSense version ? HDD/Ram size(free)?

UnderCover

Version 1.2.1-RC1
built on Sun Aug 17 23:30:22 EDT 2008

Memory usage 35% total: 256mb
SWAP usage 0%
Disk usage 1% total: 40gb

UnderCover

i tried this blacklist

http://www.shallalist.de/Downloads/shallalist.tar.gz

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 9111760 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1651

also tried this one

http://urlblacklist.com/cgi-bin/commercialdownload.pl?type=download&file=bigblacklist

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 6744 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1651

dvserg

squidguard_configurator.inc must contains after require section [ln 53..]:

/* Allow additional execution time 0 = no limit. */
ini_set('max_execution_time', '3600');
ini_set('max_input_time', '3600');

http://forum.pfsense.org/index.php/topic,10586.msg59172.html#msg59172

UnderCover

where is that file located

dvserg

/usr/local/pkg

UnderCover

@dvserg:

squidguard_configurator.inc must contains after require section [ln 53..]:

/* Allow additional execution time 0 = no limit. */
ini_set('max_execution_time', '3600');
ini_set('max_input_time', '3600');

http://forum.pfsense.org/index.php/topic,10586.msg59172.html#msg59172

i see the values, should i change them to 0?

dvserg

For begin - add this lines and test.

UnderCover

ok i tried

SquidGuard was just fixed. Please reinstall.

Iperf will be fixed on the next snapshot.

in temrs of ntop, I would suggest doing this from a shell:

rm -rf /var/db/pkg/*

Diagnostics -> Backup/Restore -> Reinstall all packages

it still says the same error when i try uploading the file

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 9111760 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1603

UnderCover

i also tried changing those two files to 0

and it reports the same error

tester_02

ditto. memory exhausted 1.2.1 (aug 20)

dvserg

Hm. I test 1.2.1 success. You have latest SG update? As temporary possible upload blacklist manually to /tmp dir and update SG from /tmp/myblacklistexample.tar.gz

tester_02

The problem seems to be the actual blacklist…
http://squidguard.mesd.k12.or.us/blacklists.tgz blacklist works.
http://www.shallalist.de/Downloads/shallalist.tar.gz blacklist crashes with the memory error.
So the problem seems to be the size of the blacklist. I was originally only trying out the 2nd one as that is what most people seem to recommend.
The it does work, just seems to have problems with the larger lists?

Tried reinstalling with the latest packages available on 1.2.1 and no changes to this problem.

dvserg

Probably this php settings problem ..
Anybody pls test with setting
ini_set('memory_limit', '24M');

UnderCover

i added that line after


/* Allow additional execution time 0 = no limit. */
ini_set('max_execution_time', '3600');
ini_set('max_input_time', '3600');

worked perfectly THX

edited:

http://urlblacklist.com/cgi-bin/commercialdownload.pl?type=download&file=bigblacklist

gives this error

Fatal error: Allowed memory size of 25165824 bytes exhausted (tried to allocate 16636786 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1604

i am going to try to change the line

ini_set('memory_limit', '24M');

to

ini_set('memory_limit', '50M');

UnderCover

setting it to 50M worked
for the urlblacklist.com