Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    pfBlockerNG-devel feedback

    Scheduled Pinned Locked Moved pfBlockerNG
    102 Posts 26 Posters 100.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • L
      lordbob75
      last edited by

      I did not notice for a while, but it looks like ever since I upgraded to this version the DNSBL has been crashing and restarting every minute, along with the service watchdog.

      I've also got the out of sync error, but I've force reloaded a bunch of times and the log just says DNSBL is out of sync. Not sure what to look for in it.

      1 Reply Last reply Reply Quote 0
      • RonpfSR
        RonpfS
        last edited by RonpfS

        There is no need to place DNSBL under the System Watchdog.

        You need to post the log of a Force Reload All if you want to get help.

        One thing that can generate Out of Sync warnings is if you have Header/Label that are not unique.

        2.4.5-RELEASE-p1 (amd64)
        Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
        Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

        L 1 Reply Last reply Reply Quote 0
        • L
          lordbob75 @RonpfS
          last edited by

          @ronpfs ah, well then that should fix that part.

          I've attached the log to this post.
          0_1535239826092_pfblockerng.zip

          RonpfSR 1 Reply Last reply Reply Quote 0
          • RonpfSR
            RonpfS @lordbob75
            last edited by

            @lordbob75

            *** DNSBL update [ 850567 ] [ 824258 ] ... OUT OF SYNC ! *** [ 08/25/18 16:04:06 ]
            
            

            850567 - 824258 = 26309

            Searching for 26309 show that you load twice Malware_Domains

            
            [ Malware_Domains ]		 Reload [ 08/25/18 15:58:47 ] . completed ..
              ----------------------------------------------------------------------
              Orig.    Unique     # Dups     # White    # TOP1M    Final                
              ----------------------------------------------------------------------
              26446    26446      137        0          0          26309                
              ----------------------------------------------------------------------
            
            
            [ Malware_Domains ]		 Reload [ 08/25/18 15:59:21 ] . completed ..
              ----------------------------------------------------------------------
              Orig.    Unique     # Dups     # White    # TOP1M    Final                
              ----------------------------------------------------------------------
              26446    26446      137        0          0          26309                
              ----------------------------------------------------------------------
            

            2.4.5-RELEASE-p1 (amd64)
            Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
            Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

            L 1 Reply Last reply Reply Quote 0
            • L
              lordbob75 @RonpfS
              last edited by

              @ronpfs Awesome, thanks. I'll fix it. I'm not sure I understand how the number searched worked though. I'm not sure how to explain what I don't get about it.

                 26309 /var/db/pfblockerng/dnsbl/Malware_Domains.txt
              

              In that list, is that number like the start of where that list adds to the master list or something? If that makes sense?

              RonpfSR 1 Reply Last reply Reply Quote 0
              • RonpfSR
                RonpfS @lordbob75
                last edited by RonpfS

                @lordbob75 said in pfBlockerNG-devel feedback:

                that number

                That's the number of Domain Names computed after removing Whitelist, TOP1M, Duplicates from other lists, etc.

                2.4.5-RELEASE-p1 (amd64)
                Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                L 1 Reply Last reply Reply Quote 0
                • L
                  lordbob75 @RonpfS
                  last edited by lordbob75

                  @ronpfs Ok, that's what I figured but wanted to confirm. I appreciate the help!

                  Edit: removing the duplicate entry did indeed fix it, awesome.

                  1 Reply Last reply Reply Quote 0
                  • A
                    anttechs
                    last edited by

                    I have tried it and loved it and I can't wait for it to come out :)

                    Intel(R) Celeron(R) CPU J1900 @ 1.99GHz
                    Current: 1992 MHz, Max: 1993 MHz
                    4 CPUs: 1 package(s) x 4 core(s)
                    AES-NI CPU Crypto: No
                    8 Gig RAM
                    250GB SSD

                    https://ant-techs.is/ip-blocklists

                    1 Reply Last reply Reply Quote 0
                    • occamsrazorO
                      occamsrazor
                      last edited by occamsrazor

                      I just took the plunge and moved to -devel....... It's fantastic. Having all the preset feeds and their organization into groups makes everything so much easier.

                      One question though.... I'm confused where to put individual IP addresses and domains that I want to whitelist from ALL the IPV4 feeds.

                      For DNSBL, I put domains in the DNSBL Whitelist box and that seems to work.

                      For IPV4 on the previous version I had two custom Permit lists, which have got carrried over to the -devel version:

                      0_1535738552244_Screen Shot 2018-08-31 at 20.57.32.jpg

                      For domains that I want converted to IPs and then whitelisted, I put "Whois" in the source box and the domains in IPv4 Custom_List and this seems to work:

                      0_1535738698058_Screen Shot 2018-08-31 at 21.03.44.jpg

                      But for IPs that I want whitelisted I put the IPs in IPv4 Custom_List but I don't know what to put for Source and when I leave it blank I get this error:

                      0_1535738796693_Screen Shot 2018-08-31 at 20.58.31.jpg

                      Am I doing this all wrong or where should I be putting these?

                      pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                      Ubiquiti Unifi wired and wireless network, APC UPSs
                      Mac OSX and IOS devices, QNAP NAS

                      RonpfSR 2 Replies Last reply Reply Quote 0
                      • RonpfSR
                        RonpfS @occamsrazor
                        last edited by

                        @occamsrazor said in pfBlockerNG-devel feedback:

                        For domains that I want converted to IPs and then whitelisted, I put "Whois" in the source box and the domains in IPv4 Custom_List and this seems to work:

                        You have to change the Format to Whois, then you type a Domain Name in the Source Field.

                        2.4.5-RELEASE-p1 (amd64)
                        Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                        Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                        1 Reply Last reply Reply Quote 0
                        • RonpfSR
                          RonpfS @occamsrazor
                          last edited by

                          @occamsrazor said in pfBlockerNG-devel feedback:

                          But for IPs that I want whitelisted I put the IPs in IPv4 Custom_List but I don't know what to put for Source and when I leave it blank I get this error:

                          Change the State to Off

                          2.4.5-RELEASE-p1 (amd64)
                          Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                          Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                          occamsrazorO 1 Reply Last reply Reply Quote 0
                          • occamsrazorO
                            occamsrazor @RonpfS
                            last edited by

                            @ronpfs said in pfBlockerNG-devel feedback:

                            @occamsrazor said in pfBlockerNG-devel feedback:

                            But for IPs that I want whitelisted I put the IPs in IPv4 Custom_List but I don't know what to put for Source and when I leave it blank I get this error:

                            Change the State to Off

                            Ah OK. So if I put State to Off but sill have a list of IPs in the IPv4 Custom_List text entry box they will still get added?

                            @ronpfs said in pfBlockerNG-devel feedback:

                            @occamsrazor said in pfBlockerNG-devel feedback:

                            For domains that I want converted to IPs and then whitelisted, I put "Whois" in the source box and the domains in IPv4 Custom_List and this seems to work:

                            You have to change the Format to Whois, then you type a Domain Name in the Source Field.

                            If I do that I'd have to create a new "Format, State, Source, Header/Label" for each individual domain. Can I not have a list of domains in the IPv4 Custom_List box and check the "Enable Domain/AS" box", perhaps setting the State to OFF as suggested for the above?

                            Thanks....

                            pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                            Ubiquiti Unifi wired and wireless network, APC UPSs
                            Mac OSX and IOS devices, QNAP NAS

                            RonpfSR 1 Reply Last reply Reply Quote 0
                            • RonpfSR
                              RonpfS @occamsrazor
                              last edited by RonpfS

                              @occamsrazor said in pfBlockerNG-devel feedback:

                              Ah OK. So if I put State to Off but sill have a list of IPs in the IPv4 Custom_List text entry box they will still get added?

                              Yes.

                              @occamsrazor said in pfBlockerNG-devel feedback:

                              Can I not have a list of domains in the IPv4 Custom_List box and check the "Enable Domain/AS" box", perhaps setting the State to OFF as suggested for the above?

                              Yes you can do that as well.

                              You should also inspect the content of the tables in the Logs tab.

                              2.4.5-RELEASE-p1 (amd64)
                              Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                              Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                              occamsrazorO 1 Reply Last reply Reply Quote 0
                              • occamsrazorO
                                occamsrazor @RonpfS
                                last edited by occamsrazor

                                @ronpfs said in pfBlockerNG-devel feedback:

                                Yes you can do that as well.
                                You should also inspect the content of the tables in the Logs tab.

                                Nice. Thanks a lot for clearing that up. When I go to the top two items in the dropdown seen here I can see all the IPs including the ones converted from domains, so I think that is all working correctly....

                                0_1535744394594_Screen Shot 2018-08-31 at 22.38.02.jpg

                                One final (I hope) question. Is there a way to keep one single domain whitelist that gets used for both:
                                a) Conversion to IPs for IPV4 whitelisting
                                b) Use in DNSBL whitelisting
                                I get the impression the IPV4 and DNSBL functions operate very separately..... and that you would have to keep domain whitelist in the two places to be sure.

                                pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                                Ubiquiti Unifi wired and wireless network, APC UPSs
                                Mac OSX and IOS devices, QNAP NAS

                                RonpfSR 1 Reply Last reply Reply Quote 0
                                • RonpfSR
                                  RonpfS @occamsrazor
                                  last edited by RonpfS

                                  @occamsrazor
                                  IPV4 operates in the IP space. It can take domain names and convert them to IPs before building the tables.

                                  DNSBL operates in the DNS space, that is only with domain names.

                                  Instead of using Whitelist, why don't you suppress IPs instead?

                                  2.4.5-RELEASE-p1 (amd64)
                                  Intel Core2 Quad CPU Q8400 @ 2.66GHz 8GB
                                  Backup 0.5_5, Bandwidthd 0.7.4_4, Cron 0.3.7_5, pfBlockerNG-devel 3.0.0_16, Status_Traffic_Totals 2.3.1_1, System_Patches 1.2_5

                                  occamsrazorO 1 Reply Last reply Reply Quote 0
                                  • occamsrazorO
                                    occamsrazor @RonpfS
                                    last edited by

                                    @ronpfs said in pfBlockerNG-devel feedback:

                                    Instead of using Whitelist, why don't you suppress IPs instead?

                                    What would be the advantage of that way vs whitelist? In the IPV4 Suppression box I thought you could only enter ranges not individual IPs. But I guess you can enter them with /32 netmask, right?

                                    pfSense CE on Qotom Q355G4 8GB RAM/60GB SSD
                                    Ubiquiti Unifi wired and wireless network, APC UPSs
                                    Mac OSX and IOS devices, QNAP NAS

                                    1 Reply Last reply Reply Quote 0
                                    • JeGrJ
                                      JeGr LAYER 8 Moderator
                                      last edited by

                                      @BBcan177 just a quick question: I checked on pfBlockerNG devel on a 2.4.4 snapshot system. Still shows php56-5.6.34 as dependency. As 2.4.4 runs on php7.2 I'm wondering, why pfBNG requires usage of the old PHP version (in package manager listing)?

                                      Don't forget to upvote 👍 those who kindly offered their time and brainpower to help you!

                                      If you're interested, I'm available to discuss details of German-speaking paid support (for companies) if needed.

                                      BBcan177B 1 Reply Last reply Reply Quote 0
                                      • BBcan177B
                                        BBcan177 Moderator @JeGr
                                        last edited by

                                        @jegr said in pfBlockerNG-devel feedback:

                                        I checked on pfBlockerNG devel on a 2.4.4 snapshot system. Still shows php56-5.6.34 as dependency. As 2.4.4 runs on php7.2 I'm wondering, why pfBNG requires usage of the old PHP version (in package manager listing)?

                                        The pfSense devs manage that integration. Here is the commit to the makefile:
                                        https://github.com/pfsense/FreeBSD-ports/commit/54dd3d529ac6a55cd0c1e05f0c3956fb668d7cbd

                                        There seem to be some hiccups with this but I believe it to be part of the base pfSense code.

                                        "Experience is something you don't get until just after you need it."

                                        Website: http://pfBlockerNG.com
                                        Twitter: @BBcan177  #pfBlockerNG
                                        Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                        JeGrJ 1 Reply Last reply Reply Quote 0
                                        • JeGrJ
                                          JeGr LAYER 8 Moderator @BBcan177
                                          last edited by JeGr

                                          @bbcan177 no problem, just wanted to ask as that drew my attention :)

                                          Edit: My mistake, I set the system to "stable" after updating to 2.4.4-snapshots, to get it to 2.4.4-Release without any further snapshot. That switched Packages back to displaying 2.4.3 info, so the PHP version was old. Switching it back to snaps shows a correct 7.2.9 - my bad!

                                          Don't forget to upvote 👍 those who kindly offered their time and brainpower to help you!

                                          If you're interested, I'm available to discuss details of German-speaking paid support (for companies) if needed.

                                          1 Reply Last reply Reply Quote 0
                                          • BBcan177B
                                            BBcan177 Moderator
                                            last edited by BBcan177

                                            @jegr said in pfBlockerNG-devel feedback:

                                            @bbcan177 no problem, just wanted to ask as that drew my attention :)

                                            I did some tests and the only way I could get the PHP version to be out of sync was to set the 2.4.4 machine to use the pfSense 2.3.x branch ?

                                            EDIT: Haha... yes, I was typing as you made your edit !! :)

                                            "Experience is something you don't get until just after you need it."

                                            Website: http://pfBlockerNG.com
                                            Twitter: @BBcan177  #pfBlockerNG
                                            Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                            JeGrJ 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.