Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PFBlockerNG 2.1.1_2 Memory Errors

    Scheduled Pinned Locked Moved pfBlockerNG
    61 Posts 17 Posters 69.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RonpfSR
      RonpfS
      last edited by

      Well on amd64 the default is 512MB.

      /var in Ramdisk ? getting full ?

      2.4.5-RELEASE-p1 (amd64)
      Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
      Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

      1 Reply Last reply Reply Quote 0
      • RonpfSR
        RonpfS
        last edited by

        @oswoldy:

        Ok, while the php /usr/local/www/pfblockerng/pfblockerng.php dc command works, the cron jobs are still crashing and giving errors, I am currently at 2GB limit and climbing.

        If you run the dc command, it changes the GeoIP database, you have to run a force reload after the dc complete.

        Also check diagnostic system activity to see if there isn't something unusual.
        Look at the System log for hints on the failure mode.
        An can you post the portion of the pfblockerng.log file where you have failure.

        2.4.5-RELEASE-p1 (amd64)
        Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
        Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

        1 Reply Last reply Reply Quote 0
        • RonpfSR
          RonpfS
          last edited by

          @oswoldy:

          @RonpfS:

          @oswoldy:

          Ok, while the php /usr/local/www/pfblockerng/pfblockerng.php dc command works, the cron jobs are still crashing and giving errors, I am currently at 2GB limit and climbing.

          If you run the dc command, it changes the GeoIP database, you have to run a force reload after the dc complete.

          Also check diagnostic system activity to see if there isn't something unusual.
          Look at the System log for hints on the failure mode.
          An can you post the portion of the pfblockerng.log file where you have failure.

          Ok, I ran the dc command, followed by a force reload, no different. If I remove pfB_NAmerica_v4 then it works fine, crash report is:

          Crash report begins.  Anonymous machine information:

          amd64
          10.3-RELEASE-p5
          FreeBSD 10.3-RELEASE-p5 #0 7307492(RELENG_2_3_2): Tue Jul 19 13:29:35 CDT 2016    root@ce23-amd64-builder:/builder/pfsense-232/tmp/obj/builder/pfsense-232/tmp/FreeBSD-src/sys/pfSense

          Crash report details:

          PHP Errors:
          [04-Aug-2016 10:29:24 Europe/London] PHP Fatal error:  Allowed memory size of 524288000 bytes exhausted (tried to allocate 20 bytes) in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 3875
          [04-Aug-2016 10:29:24 Europe/London] PHP Stack trace:
          [04-Aug-2016 10:29:24 Europe/London] PHP  1. {main}() /usr/local/www/pfblockerng/pfblockerng.php:0
          [04-Aug-2016 10:29:24 Europe/London] PHP  2. sync_package_pfblockerng() /usr/local/www/pfblockerng/pfblockerng.php:87
          [04-Aug-2016 10:29:24 Europe/London] PHP  3. file() /usr/local/pkg/pfblockerng/pfblockerng.inc:3875

          I have reduced the limit back to 500MB as increasing it wasnt making a difference, the dc command still completes but not a force reload or CRON.

          Once the dc command complete, the MaxMind database is created, so you do not need to re run it.

          What about the pfblockerng.log ? What are the symptoms ?
          Maybe raise it to 640M or 768M?

          2.4.5-RELEASE-p1 (amd64)
          Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
          Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

          1 Reply Last reply Reply Quote 0
          • W
            wiz561
            last edited by

            I started a thread up over in the pfblocker posting and just letting everybody know that I'm also experiencing very similar memory issues.

            Thismorning when I logged in, I also had a pfsense crash report with the following:

            					Crash report begins.  Anonymous machine information:
            
            amd64
            10.3-RELEASE-p5
            FreeBSD 10.3-RELEASE-p5 #0 7307492(RELENG_2_3_2): Tue Jul 19 13:29:35 CDT 2016     root@ce23-amd64-builder:/builder/pfsense-232/tmp/obj/builder/pfsense-232/tmp/FreeBSD-src/sys/pfSense
            
            Crash report details:
            
            PHP Errors:
            [04-Aug-2016 00:18:40 America/Chicago] PHP Fatal error:  Allowed memory size of 402653184 bytes exhausted (tried to allocate 72 bytes) in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 3868
            [04-Aug-2016 00:18:40 America/Chicago] PHP Stack trace:
            [04-Aug-2016 00:18:40 America/Chicago] PHP   1\. {main}() /etc/rc.start_packages:0
            [04-Aug-2016 00:18:40 America/Chicago] PHP   2\. sync_package() /etc/rc.start_packages:90
            [04-Aug-2016 00:18:40 America/Chicago] PHP   3\. eval() /etc/inc/pkg-utils.inc:631
            [04-Aug-2016 00:18:40 America/Chicago] PHP   4\. sync_package_pfblockerng() /etc/inc/pkg-utils.inc(631) : eval()'d code:3
            [04-Aug-2016 00:18:40 America/Chicago] PHP   5\. array_merge() /usr/local/pkg/pfblockerng/pfblockerng.inc:3868
            
            Filename: /var/crash/minfree
            2048
            
            1 Reply Last reply Reply Quote 0
            • L
              lucasrca
              last edited by

              How I solved my problem:

              My pfSense config:

              • Version: 2.3.2 (amd64), running on VMWare 6
                – Snort
                -- pfBlockerNG
                -- OpenVPN
                -- Open-vm-tools
                -- DHCP Relay
                -- Quagga OSPFd with another 2 pfSense.
              • ~3000 users simultaneously
              • 2 x 100 Mbit uplinks
              • 16 GB RAM
              • 80 GB SAS
              • CPU Type: Intel(R) Xeon(R) CPU E5-4620 v2 @ 2.60GHz
              • 16 CPUs: 8 package(s) x 2 core(s)
              • 8 Interfaces, including WAN
              • routing, filtering and relaying dhcp to 16 branches over MPLS, WiMax and fiber
              • Load balance and failover
              • QoS with Traffic shaper
              1. Updated Firewall Maximum Table Entries: 4000000 -> 8000000
                1.1) Reboot
              2. Edited /usr/local/pkg/pfblockerng/pfblockerng.inc and set memory limit to 500M
              3. Executed php /usr/local/www/pfblockerng/pfblockerng.php dc
              4. It's alive.

              Thanks to all involved.

              This a UNIX country. On a quiet night, you can hear Windows rebooting.

              1 Reply Last reply Reply Quote 0
              • M
                Mithrondil
                last edited by

                POST-INSTALL script failed
                Message from GeoIP-1.6.9:
                GeoIP does not ship with the actual data files. You must download
                them yourself! Please run:

                /usr/local/bin/geoipupdate.sh

                1 Reply Last reply Reply Quote 0
                • RonpfSR
                  RonpfS
                  last edited by

                  @wiz561:

                  I started a thread up over in the pfblocker posting and just letting everybody know that I'm also experiencing very similar memory issues.

                  Thismorning when I logged in, I also had a pfsense crash report with the following:

                  					Crash report begins.  Anonymous machine information:
                  
                  amd64
                  10.3-RELEASE-p5
                  FreeBSD 10.3-RELEASE-p5 #0 7307492(RELENG_2_3_2): Tue Jul 19 13:29:35 CDT 2016     root@ce23-amd64-builder:/builder/pfsense-232/tmp/obj/builder/pfsense-232/tmp/FreeBSD-src/sys/pfSense
                  
                  Crash report details:
                  
                  PHP Errors:
                  [04-Aug-2016 00:18:40 America/Chicago] PHP Fatal error:  Allowed memory size of 402653184 bytes exhausted (tried to allocate 72 bytes) in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 3868
                  [04-Aug-2016 00:18:40 America/Chicago] PHP Stack trace:
                  [04-Aug-2016 00:18:40 America/Chicago] PHP   1\. {main}() /etc/rc.start_packages:0
                  [04-Aug-2016 00:18:40 America/Chicago] PHP   2\. sync_package() /etc/rc.start_packages:90
                  [04-Aug-2016 00:18:40 America/Chicago] PHP   3\. eval() /etc/inc/pkg-utils.inc:631
                  [04-Aug-2016 00:18:40 America/Chicago] PHP   4\. sync_package_pfblockerng() /etc/inc/pkg-utils.inc(631) : eval()'d code:3
                  [04-Aug-2016 00:18:40 America/Chicago] PHP   5\. array_merge() /usr/local/pkg/pfblockerng/pfblockerng.inc:3868
                  
                  Filename: /var/crash/minfree
                  2048
                  

                  The php memory should be 512M by default, so setting it in the inc file to 400M might not help.
                  Did it fail without any fix to the inc file? Can you try setting the limit to 640M or 768M?
                  What do you have for Firewall Maximum Table Entries?

                  2.4.5-RELEASE-p1 (amd64)
                  Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                  Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                  1 Reply Last reply Reply Quote 0
                  • RonpfSR
                    RonpfS
                    last edited by

                    @Mithrondil:

                    POST-INSTALL script failed
                    Message from GeoIP-1.6.9:
                    GeoIP does not ship with the actual data files. You must download
                    them yourself! Please run:

                    /usr/local/bin/geoipupdate.sh

                    You will need to run  php /usr/local/www/pfblockerng/pfblockerng.php dc from the shell.
                    Once it succeeds, you should be able to install, it may need a reboot.

                    2.4.5-RELEASE-p1 (amd64)
                    Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                    Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                    1 Reply Last reply Reply Quote 0
                    • RonpfSR
                      RonpfS
                      last edited by

                      For those with failed installation. Verify that /var isn't full. The MaxMind database is huge so if you are using a RAM Disk, it might eat up memory that is needed for the pfblockerng.php.

                      If disk space is running low, BBcan177 suggest to delete the /var/db/pfblockerng/deny and /var/db/pfblockerng/original folders before installation to free some disk space. This means it will need to redownload all IP feeds after installation.

                      Check pfblockerng.log, the system log, Dashboard for crash report, Status Monitoring System Memory.

                      Post relevant debug info here.

                      2.4.5-RELEASE-p1 (amd64)
                      Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                      Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                      1 Reply Last reply Reply Quote 0
                      • W
                        wiz561
                        last edited by

                        @RonpfS:

                        @wiz561:

                        I started a thread up over in the pfblocker posting and just letting everybody know that I'm also experiencing very similar memory issues.

                        Thismorning when I logged in, I also had a pfsense crash report with the following:

                        					Crash report begins.  Anonymous machine information:
                        
                        amd64
                        10.3-RELEASE-p5
                        FreeBSD 10.3-RELEASE-p5 #0 7307492(RELENG_2_3_2): Tue Jul 19 13:29:35 CDT 2016     root@ce23-amd64-builder:/builder/pfsense-232/tmp/obj/builder/pfsense-232/tmp/FreeBSD-src/sys/pfSense
                        
                        Crash report details:
                        
                        PHP Errors:
                        [04-Aug-2016 00:18:40 America/Chicago] PHP Fatal error:  Allowed memory size of 402653184 bytes exhausted (tried to allocate 72 bytes) in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 3868
                        [04-Aug-2016 00:18:40 America/Chicago] PHP Stack trace:
                        [04-Aug-2016 00:18:40 America/Chicago] PHP   1\. {main}() /etc/rc.start_packages:0
                        [04-Aug-2016 00:18:40 America/Chicago] PHP   2\. sync_package() /etc/rc.start_packages:90
                        [04-Aug-2016 00:18:40 America/Chicago] PHP   3\. eval() /etc/inc/pkg-utils.inc:631
                        [04-Aug-2016 00:18:40 America/Chicago] PHP   4\. sync_package_pfblockerng() /etc/inc/pkg-utils.inc(631) : eval()'d code:3
                        [04-Aug-2016 00:18:40 America/Chicago] PHP   5\. array_merge() /usr/local/pkg/pfblockerng/pfblockerng.inc:3868
                        
                        Filename: /var/crash/minfree
                        2048
                        

                        The php memory should be 512M by default, so setting it in the inc file to 400M might not help.
                        Did it fail without any fix to the inc file? Can you try setting the limit to 640M or 768M?
                        What do you have for Firewall Maximum Table Entries?

                        I'm going to have to do a bit of work this weekend on this and see more.  I can try it and see what happens, but I'm getting concerned about reaching my 2gb memory limit.  I can add more memory, but that requires me to go to the store and I'm kinda lazy…..and cheap.  :)

                        Interesting that I too have a similar setup to the one user above.  I'm running it on vmware esxi with Snort (disabled) and OpenVPN.  Granted, I don't have nearly the hardware or setup, but it's interesting that we're both running vmware.

                        1 Reply Last reply Reply Quote 0
                        • W
                          wiz561
                          last edited by

                          OK…  Now maybe I'll try what others suggested...  :)

                          I wiped and reinstalled pfsense tonight and pfblockng is still coming back with that crash and memory errors.  I know others said to adjust the memory but I thought I would give this a try.  Unfortunately, it failed.

                          I also had issues with php-fpm having high utilization....so I'm hoping that the wipe/reinstall fixed the issue with that.  Time will tell.

                          1 Reply Last reply Reply Quote 0
                          • RonpfSR
                            RonpfS
                            last edited by

                            What about posting pfblockerNG, system log, crash report, screen shot of system activity, etc, so we can see what is happening on your setup?

                            The crash report you posted earlier tells me you have under 400MB defined.

                            PHP Fatal error:  Allowed memory size of 402653184 bytes exhausted

                            Did you raise the Firewall Maximum Table Entries ?

                            2.4.5-RELEASE-p1 (amd64)
                            Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                            Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                            1 Reply Last reply Reply Quote 0
                            • PerforadoP
                              Perforado Rebel Alliance
                              last edited by

                              Temporary Fix for

                              php /usr/local/www/pfblockerng/pfblockerng.php update

                              Failing with memory exhaustion:

                              edit /usr/local/pkg/pfblockerng/pfblockerng.inc as discussed above:
                              …
                              pfb_global();
                              ini_set('memory_limit', '640M');
                              ...

                              cp /etc/rc.php_ini_setup /etc/rc.php_ini_setup.BACKUP
                              cp /usr/local/etc/php.ini /usr/local/etc/php.ini.BACKUP
                              perl -pi -e 's/536870912/671088640/g' /etc/rc.php_ini_setup /usr/local/etc/php.ini

                              512 * 1024 * 1024 -> 536870912
                              640 * 1024 * 1024 -> 671088640 works for me. maybe your setup needs more :)

                              1 Reply Last reply Reply Quote 0
                              • RonpfSR
                                RonpfS
                                last edited by

                                @Perforado:

                                Temporary Fix for

                                php /usr/local/www/pfblockerng/pfblockerng.php update

                                Failing with memory exhaustion:

                                cp /etc/rc.php_ini_setup /etc/rc.php_ini_setup.BACKUP
                                cp /usr/local/etc/php.ini /usr/local/etc/php.ini.BACKUP
                                perl -pi -e 's/536870912/671088640/g' /etc/rc.php_ini_setup /usr/local/etc/php.ini

                                512 * 1024 * 1024 -> 536870912
                                640 * 1024 * 1024 -> 671088640 works for me. maybe your setup needs more :)

                                There is probably a setting (memory_limit?) we can configure in the System/Advanced/System Tunables that will do that for you. But it may require a reboot.

                                The fix for the inc file is specific to pfblocker and shouldn't be needed once BBcan177 change the code.

                                2.4.5-RELEASE-p1 (amd64)
                                Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                                Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                                1 Reply Last reply Reply Quote 0
                                • PerforadoP
                                  Perforado Rebel Alliance
                                  last edited by

                                  /var/db/aliastables:
                                  -rw-r–r--  1 root  wheel    351450 Aug  5 10:56 pfB_Top_v4.txt
                                  -rw-r--r--  1 root  wheel  30690970 Aug  5 11:00 pfB_Top_v6.txt

                                  cat pfB_Top_v6.txt | wc -l
                                  1421351

                                  1.4mio entries? That can't be right?

                                  cat pfB_Top_v4.txt | wc -l
                                    22410

                                  Could this be the the root cause of all this?

                                  1 Reply Last reply Reply Quote 0
                                  • RonpfSR
                                    RonpfS
                                    last edited by

                                    @Perforado:

                                    /var/db/aliastables:
                                    -rw-r–r--  1 root  wheel    351450 Aug  5 10:56 pfB_Top_v4.txt
                                    -rw-r--r--  1 root  wheel  30690970 Aug  5 11:00 pfB_Top_v6.txt

                                    cat pfB_Top_v6.txt | wc -l
                                    1421351

                                    1.4mio entries? That can't be right?

                                    cat pfB_Top_v4.txt | wc -l
                                      22410

                                    Could this be the the root cause of all this?

                                    What was the size of pfB_Top_v6.txt before the MaxMind db change ?  I do not use these table, so I can't compare.

                                    On option BBcan177 mentioned was that he might need to aggregate the table  to shrink them.

                                    2.4.5-RELEASE-p1 (amd64)
                                    Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                                    Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                                    1 Reply Last reply Reply Quote 0
                                    • PerforadoP
                                      Perforado Rebel Alliance
                                      last edited by

                                      pfB_Top_v6 was about 13000-ish before as far as i recall.

                                      1 Reply Last reply Reply Quote 0
                                      • W
                                        wiz561
                                        last edited by

                                        @RonpfS:

                                        What about posting pfblockerNG, system log, crash report, screen shot of system activity, etc, so we can see what is happening on your setup?

                                        The crash report you posted earlier tells me you have under 400MB defined.

                                        PHP Fatal error:  Allowed memory size of 402653184 bytes exhausted

                                        Did you raise the Firewall Maximum Table Entries ?

                                        I've been busy the past couple of days and blowing it away and restoring the config was pretty simple.  I'm going to try to work on this a bit more this week and take the suggestions of what others have posted to see if it fixes it.  I am going to guess that changing the memory settings around will help, but I also need to buy more memory for my system.

                                        1 Reply Last reply Reply Quote 0
                                        • R
                                          Rickinfl
                                          last edited by

                                          Hi,

                                          I've been reading this forum and trying to figure out if there is a fix for this or not. I really didn't see anyone say "This is the fix" with instructions.

                                          Can someone point me in the right direction?
                                          Has anyone contacted the package creator?
                                          Why hasn't anyone pulled this package from being install if there is issues with it?

                                          They should pull this package if its not working. It pretty much killed my pfsense box and I had to remove it.

                                          Sorry for being so direct. But I just had to shut down my firewall ports to my websites and I'm trying to get this fixed as soon as possible so I can bring them back online.

                                          Thanks,
                                          Rick

                                          1 Reply Last reply Reply Quote 0
                                          • D
                                            duanes
                                            last edited by

                                            Me Too…..
                                            (NOTE - malloc failure still shows 512mb of ram.  My mem limit seems to be ignored)

                                            I'm using
                                            pfb_global();
                                            ini_set('memory_limit', '4096M');

                                            Still fails when updating with....

                                            amd64
                                            10.3-RELEASE-p5
                                            FreeBSD 10.3-RELEASE-p5 #0 7307492(RELENG_2_3_2): Tue Jul 19 13:29:35 CDT 2016    root@ce23-amd64-builder:/builder/pfsense-232/tmp/obj/builder/pfsense-232/tmp/FreeBSD-src/sys/pfSense

                                            Crash report details:

                                            PHP Errors:
                                            [08-Aug-2016 07:47:51 America/Chicago] PHP Fatal error:  Allowed memory size of 536870912 bytes exhausted (tried to allocate 72 bytes) in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 3876
                                            [08-Aug-2016 07:47:51 America/Chicago] PHP Stack trace:
                                            [08-Aug-2016 07:47:51 America/Chicago] PHP  1. {main}() /usr/local/www/pfblockerng/pfblockerng.php:0
                                            [08-Aug-2016 07:47:51 America/Chicago] PHP  2. sync_package_pfblockerng() /usr/local/www/pfblockerng/pfblockerng.php:87
                                            [08-Aug-2016 07:47:51 America/Chicago] PHP  3. file() /usr/local/pkg/pfblockerng/pfblockerng.inc:3876

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.