Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    pfBlockerNG IP Reputation

    Scheduled Pinned Locked Moved 2.5 Development Snapshots (Retired)
    35 Posts 6 Posters 4.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • NollipfSenseN
      NollipfSense
      last edited by

      This picture is worth many words!

      Screen Shot 2020-05-12 at 4.53.45 PM.png

      pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
      pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

      1 Reply Last reply Reply Quote 0
      • NollipfSenseN
        NollipfSense
        last edited by

        No one else reproduced the above result? Is it that IP reputation had been removed from the package?

        pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
        pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

        S 1 Reply Last reply Reply Quote 0
        • GertjanG
          Gertjan
          last edited by Gertjan

          @NollipfSense said in pfBlockerNG IP Reputation:

          reputation

          Noop.

          6c14cb53-872b-4241-979a-5cc33fc8f5a1-image.png

          Works for me.

          Btw : The php file exists :

          965f291e-e41f-4b09-b7c1-21f3424b7992-image.png

          No "help me" PM's please. Use the forum, the community will thank you.
          Edit : and where are the logs ??

          NollipfSenseN 1 Reply Last reply Reply Quote 0
          • Bob.DigB
            Bob.Dig LAYER 8
            last edited by

            I had this some month ago, installation was corrupt.

            NollipfSenseN 1 Reply Last reply Reply Quote 0
            • NollipfSenseN
              NollipfSense @Gertjan
              last edited by

              @Gertjan Wow ... thank you for sharing. What folder did you select to view the file?

              pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
              pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

              1 Reply Last reply Reply Quote 0
              • NollipfSenseN
                NollipfSense @Bob.Dig
                last edited by

                @Bob-Dig I'll reinstall pfBlockerNG.

                pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                1 Reply Last reply Reply Quote 0
                • NollipfSenseN
                  NollipfSense
                  last edited by

                  Reinstalling pfBlockerNG did not fix; so, I'll need to reinstall pfSense.

                  pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                  pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                  GertjanG 1 Reply Last reply Reply Quote 1
                  • GertjanG
                    Gertjan @NollipfSense
                    last edited by

                    @NollipfSense said in pfBlockerNG IP Reputation:

                    Reinstalling pfBlockerNG did not fix

                    When removing pfBlocker, the usr/local/www/pfblockerng/ directory should be gone, or, at least empty.
                    When you re install, that file doesn't come back ??

                    Re installing pfSEnse will not generate these files.

                    File system problems ?

                    No "help me" PM's please. Use the forum, the community will thank you.
                    Edit : and where are the logs ??

                    NollipfSenseN 1 Reply Last reply Reply Quote 0
                    • NollipfSenseN
                      NollipfSense @Gertjan
                      last edited by NollipfSense

                      @Gertjan said in pfBlockerNG IP Reputation:

                      @NollipfSense said in pfBlockerNG IP Reputation:

                      Reinstalling pfBlockerNG did not fix
                      

                      When removing pfBlocker, the usr/local/www/pfblockerng/ directory should be gone, or, at least empty.
                      When you re install, that file doesn't come back ??

                      Re installing pfSEnse will not generate these files.

                      File system problems ?

                      Okay Gertjan, I did not completely remove it ... just reinstalled it and it's the same. So, I will remove it then check to be sure the directory is gone or empty. Thank you!

                      Completely removed pfBlockerNG, keep setting, and reinstall ... same issue. The directory was there but empty. I'll try removing again then delete the directory.

                      pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                      pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                      1 Reply Last reply Reply Quote 0
                      • NollipfSenseN
                        NollipfSense
                        last edited by NollipfSense

                        This is the only file in the directory when pfBlockerNG is removed.

                        Screen Shot 2020-05-22 at 2.07.18 PM.png

                        Then, when reinstalling pfBlockerNG, some how IP reputation.php is not included.

                        Screen Shot 2020-05-22 at 2.19.36 PM.png

                        pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                        pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                        GertjanG 1 Reply Last reply Reply Quote 0
                        • S
                          serbus
                          last edited by

                          Hello!

                          Did you run a full update of pfbng? I think that file might be dynamically generated at some point during that process.

                          John

                          Lex parsimoniae

                          NollipfSenseN 1 Reply Last reply Reply Quote 1
                          • GertjanG
                            Gertjan @NollipfSense
                            last edited by

                            @NollipfSense said in pfBlockerNG IP Reputation:

                            Then, when reinstalling pfBlockerNG, some how IP reputation.php is not included.

                            Yep, I confirm.
                            It's not included in the package file - neither referenced in the manifest.
                            It's a package build issue.
                            Some one should inform @BBcan177.

                            Maybe the reputation functionality was removed from pfBlocker ?

                            I can rename any file in that directory, re install pfBlockerNG, and the file will reapaer.
                            Except the pfblockerng_reputation.php file.

                            @serbus said in pfBlockerNG IP Reputation:

                            I think that file might be dynamically generated at some point during that process.

                            It's a static web page.
                            pfBlockerNG does not generate this page.
                            An exception exists : the /usr/local/www/pfblockerng/www/dnsbl_active.php page, which is copied from the dnsbl_default.php file by pfBlockerNG itself. This is the way we select the default "Blocked Webpage" - made our own one.

                            18acd772-82a8-4906-84fb-ab8c41b8f7f6-image.png

                            No "help me" PM's please. Use the forum, the community will thank you.
                            Edit : and where are the logs ??

                            NollipfSenseN 1 Reply Last reply Reply Quote 0
                            • S
                              serbus
                              last edited by

                              @Gertjan said in pfBlockerNG IP Reputation:

                              It's a static web page.
                              pfBlockerNG does not generate this page.

                              Hello!

                              I am new to pfsense and still working through much of the code. Maybe you can help.

                              How and when are the pfblocker reputation and country xml files generated?
                              What is the purpose of the pkg.php system?
                              Does pkg ever save/cache the php it dynamically generates from xml for performance or other reasons?

                              Thanks!

                              John

                              Lex parsimoniae

                              1 Reply Last reply Reply Quote 0
                              • S
                                serbus @NollipfSense
                                last edited by

                                @NollipfSense said in pfBlockerNG IP Reputation:

                                No one else reproduced the above result? Is it that IP reputation had been removed from the package?

                                Hello!

                                You could try running :

                                php /usr/local/www/pfblockerng/pfblockerng.php gc

                                To recreate the reputation and country php files.

                                John

                                Lex parsimoniae

                                NollipfSenseN 1 Reply Last reply Reply Quote 0
                                • NollipfSenseN
                                  NollipfSense @serbus
                                  last edited by

                                  @serbus said in pfBlockerNG IP Reputation:

                                  I think that file might be dynamically generated at some point during that process.

                                  I have been thinking along those lines because I noticed also that Maxmind data had not loaded despite providing my key.

                                  pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                                  pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                                  1 Reply Last reply Reply Quote 0
                                  • NollipfSenseN
                                    NollipfSense @Gertjan
                                    last edited by

                                    @Gertjan Do you also have the MaxMind feed loaded?

                                    pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                                    pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                                    1 Reply Last reply Reply Quote 0
                                    • NollipfSenseN
                                      NollipfSense @serbus
                                      last edited by NollipfSense

                                      @serbus said in pfBlockerNG IP Reputation:

                                      php /usr/local/www/pfblockerng/pfblockerng.php gc

                                      Hey John, I am reporting that worked. However, the command result shows geolocation files not found confirmed that IP reputation list is derived from geolocation feed. Just discovered making the page had produced a crash

                                      Screen Shot 2020-05-24 at 10.05.09 PM.png

                                      Screen Shot 2020-05-24 at 10.06.55 PM.png

                                      Screen Shot 2020-05-24 at 10.23.49 PM.png

                                      pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                                      pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                                      1 Reply Last reply Reply Quote 0
                                      • GertjanG
                                        Gertjan
                                        last edited by

                                        @NollipfSense :

                                        [2.4.5-RELEASE][admin@pfsense.brit-hotel-fumel.net]/root: php /usr/local/www/pfblockerng/pfblockerng.php gc
                                         Creating pfBlockerNG Continent PHP files
                                         IPv4 Africa                     [ 05/25/20 07:16:41 ]
                                         IPv6 Africa                     [ 05/25/20 07:16:43 ]
                                         IPv4 Antarctica
                                         IPv6 Antarctica
                                         IPv4 Asia
                                         IPv6 Asia                       [ 05/25/20 07:16:46 ]
                                         IPv4 Europe                     [ 05/25/20 07:16:47 ]
                                         IPv6 Europe                     [ 05/25/20 07:16:55 ]
                                         IPv4 North America              [ 05/25/20 07:16:58 ]
                                         IPv6 North America              [ 05/25/20 07:17:04 ]
                                         IPv4 Oceania                    [ 05/25/20 07:17:05 ]
                                         IPv6 Oceania                    [ 05/25/20 07:17:06 ]
                                         IPv4 South America
                                         IPv6 South America              [ 05/25/20 07:17:07 ]
                                         IPv4 Proxy and Satellite
                                         IPv6 Proxy and Satellite        [ 05/25/20 07:17:08 ]
                                         IPv4 Top Spammers
                                         IPv6 Top Spammers
                                         pfBlockerNG Reputation Tab
                                        Country Code Update Ended
                                        

                                        and

                                        [2.4.5-RELEASE][admin@pfsense.brit-hotel-fumel.net]/root: php /usr/local/www/pfblockerng/pfblockerng.php ugc
                                        Country code update Start [ 05/25/20 07:42:27 ]
                                         Processing ISO IPv4 Continent/Country Data
                                         Processing ISO IPv6 Continent/Country Data [ 05/25/20 07:42:55 ]
                                         Creating pfBlockerNG Continent PHP files
                                         IPv4 Africa                     [ 05/25/20 07:43:05 ]
                                         IPv6 Africa                     [ 05/25/20 07:43:06 ]
                                         IPv4 Antarctica
                                         IPv6 Antarctica
                                         IPv4 Asia
                                         IPv6 Asia                       [ 05/25/20 07:43:09 ]
                                         IPv4 Europe                     [ 05/25/20 07:43:10 ]
                                         IPv6 Europe                     [ 05/25/20 07:43:19 ]
                                         IPv4 North America              [ 05/25/20 07:43:21 ]
                                         IPv6 North America              [ 05/25/20 07:43:27 ]
                                         IPv4 Oceania                    [ 05/25/20 07:43:29 ]
                                         IPv6 Oceania
                                         IPv4 South America
                                         IPv6 South America              [ 05/25/20 07:43:30 ]
                                         IPv4 Proxy and Satellite        [ 05/25/20 07:43:31 ]
                                         IPv6 Proxy and Satellite
                                         IPv4 Top Spammers
                                         IPv6 Top Spammers               [ 05/25/20 07:43:32 ]
                                         pfBlockerNG Reputation Tab
                                        Country Code Update Ended
                                        

                                        @serbus said in pfBlockerNG IP Reputation:

                                        Did you run a full update of pfbng? I think that file might be dynamically generated at some point during that process.

                                        Well .... @servus is right.
                                        I was wrong.
                                        This file "reputation" IS actually regenerated out of /usr/local/www/pfblockerng/pfblockerng.php ...

                                        @NollipfSense : Yes, I have an activated MaxiMind account.

                                        2728b5ee-17bb-4618-9abc-63157d3a2ad5-image.png

                                        @NollipfSense : How many files - what ype of files do you have here /usr/local/share/GeoIP/cc/ ?

                                        I have more the 1500 files - it depends probably on which regions I've selected, I guess.
                                        Some of them have a time stamp like 03/09/2019 - others 07/05/2020 - and the better part was downloaded just today : 25/05/2020 - 07h17.

                                        Also : /usr/local/share/GeoIP/ ? This directory gets filled with files from MaxMind - if you have an account with them.

                                        So : files actually get downloaded , No file system full ? Run a "fsck" just to be sure.

                                        Btw : The Diagnostic > Command propmpt : never use that one. It could hide stuff. Keyboard command belong on a real command line. It's one click away with Putty or any other SSH client. Better get used to it ^^

                                        No "help me" PM's please. Use the forum, the community will thank you.
                                        Edit : and where are the logs ??

                                        NollipfSenseN 1 Reply Last reply Reply Quote 0
                                        • NollipfSenseN
                                          NollipfSense @Gertjan
                                          last edited by

                                          @Gertjan said in pfBlockerNG IP Reputation:

                                          How many files - what ype of files do you have here /usr/local/share/GeoIP/cc/ ?

                                          Appeared empty!

                                          Screen Shot 2020-05-26 at 9.25.17 PM.png

                                          @Gertjan said in pfBlockerNG IP Reputation:

                                          Also : /usr/local/share/GeoIP/ ?

                                          Also, appeared empty!

                                          Screen Shot 2020-05-26 at 9.35.36 PM.png

                                          pfSense+ 23.09 Lenovo Thinkcentre M93P SFF Quadcore i7 dual Raid-ZFS 128GB-SSD 32GB-RAM PCI-Intel i350-t4 NIC, -Intel QAT 8950.
                                          pfSense+ 23.09 VM-Proxmox, Dell Precision Xeon-W2155 Nvme 500GB-ZFS 128GB-RAM PCIe-Intel i350-t4, Intel QAT-8950, P-cloud.

                                          1 Reply Last reply Reply Quote 0
                                          • S
                                            serbus
                                            last edited by

                                            Hello!

                                            php /usr/local/www/pfblockerng/pfblockerng.php dc

                                            should re-download the maxmind files. They should appear in the /usr/local/share/GeoIP folder.

                                            the "dc" command will also run the "ugc" functions after the download.

                                            John

                                            Lex parsimoniae

                                            NollipfSenseN 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.