Squidguard memory exhausted

[UnderCover]

i uploaded one blacklist from one website

when i try to upload another one from another website i get

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 9111760 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1651

is this because hard drive is full or memory (ram) is full

if its the ram is there anyway to write the blacklist to the hd?

[dvserg]

What you pfSense version ?  HDD/Ram size(free)?

[UnderCover]

Version 1.2.1-RC1
built on Sun Aug 17 23:30:22 EDT 2008

Memory usage      35%  total: 256mb
SWAP usage      0%
Disk usage     1%  total: 40gb

[UnderCover]

i tried this blacklist

http://www.shallalist.de/Downloads/shallalist.tar.gz

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 9111760 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1651

also tried this one

http://urlblacklist.com/cgi-bin/commercialdownload.pl?type=download&file=bigblacklist

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 6744 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1651

[dvserg]

squidguard_configurator.inc must contains after require section [ln 53..]:

/* Allow additional execution time 0 = no limit. */
ini_set('max_execution_time', '3600');
ini_set('max_input_time', '3600');

http://forum.pfsense.org/index.php/topic,10586.msg59172.html#msg59172

[UnderCover]

where is that file located

[dvserg]

/usr/local/pkg

[UnderCover]

@dvserg:

squidguard_configurator.inc must contains after require section [ln 53..]:

/* Allow additional execution time 0 = no limit. */
ini_set('max_execution_time', '3600');
ini_set('max_input_time', '3600');

http://forum.pfsense.org/index.php/topic,10586.msg59172.html#msg59172

i see the values, should i change them to 0?

[dvserg]

For begin - add this lines and test.

[UnderCover]

ok i tried

SquidGuard was just fixed.  Please reinstall.

Iperf will be fixed on the next snapshot.

in temrs of ntop, I would suggest doing this from a shell:

rm -rf /var/db/pkg/*

Diagnostics -> Backup/Restore -> Reinstall all packages

it still says the same error when i try uploading the file

Fatal error: Allowed memory size of 12582912 bytes exhausted (tried to allocate 9111760 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1603

[UnderCover]

i also tried changing those two files to 0

and it reports the same error

[tester_02]

ditto. memory exhausted 1.2.1 (aug 20)

[dvserg]

Hm. I test 1.2.1 success. You have latest SG update? As temporary possible upload blacklist manually to /tmp dir and update SG from /tmp/myblacklistexample.tar.gz

[tester_02]

The problem seems to be the actual blacklist…
http://squidguard.mesd.k12.or.us/blacklists.tgz  blacklist works.
http://www.shallalist.de/Downloads/shallalist.tar.gz  blacklist crashes with the memory error. 
So the problem seems to be the size of the blacklist.  I was originally only trying out the 2nd one as that is what most people seem to recommend.
The it does work, just seems to have problems with the larger lists?

Tried reinstalling with the latest packages available on 1.2.1 and no changes to this problem.

[dvserg]

Probably this php settings problem ..
Anybody pls test with setting
ini_set('memory_limit', '24M');

[UnderCover]

i added that line after

/* Allow additional execution time 0 = no limit. */
ini_set('max_execution_time', '3600');
ini_set('max_input_time', '3600');

worked perfectly THX

edited:

http://urlblacklist.com/cgi-bin/commercialdownload.pl?type=download&file=bigblacklist

gives this error

Fatal error: Allowed memory size of 25165824 bytes exhausted (tried to allocate 16636786 bytes) in /usr/local/pkg/squidguard_configurator.inc on line 1604

i am going to try to change the line

ini_set('memory_limit', '24M');

to

ini_set('memory_limit', '50M');

[UnderCover]

setting it to 50M worked
for the urlblacklist.com