Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PfBlockerNG v2.0 w/DNSBL

    Scheduled Pinned Locked Moved
    pfBlockerNG
    192
    1.1k
    1.4m
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • BBcan177B
      BBcan177 Moderator
      last edited by

      @chain:

      I'm running DNSBL_DNSBLEasyList and have selected all the categories. I notice that I don't get any hit on these categories. is there a way to test if this is working correctly?

      Since DNSBL uses deduplication and as Easylists are the last to download, the most popular ADvert servers are being blocked by other Feeds… You can view the Easylist Domain list in the pfBNG Log tab and try to browse to any of those as a test.

      "Experience is something you don't get until just after you need it."

      Website: http://pfBlockerNG.com
      Twitter: @BBcan177  #pfBlockerNG
      Reddit: https://www.reddit.com/r/pfBlockerNG/new/

      1 Reply Last reply Reply Quote 0
      • S
        shull
        last edited by

        Please excuse the noob question, but how do you enable EasyLists?  Specifically, what do you put in the Header field?  Thanks!

        pfSenseHeader.JPG
        pfSenseHeader.JPG_thumb

        1 Reply Last reply Reply Quote 0
        • BBcan177B
          BBcan177 Moderator
          last edited by

          The header is just a label for the feed… So it needs to be unique...

          ie:

          EasyList
          EasyPrivacy

          "Experience is something you don't get until just after you need it."

          Website: http://pfBlockerNG.com
          Twitter: @BBcan177  #pfBlockerNG
          Reddit: https://www.reddit.com/r/pfBlockerNG/new/

          1 Reply Last reply Reply Quote 0
          • C
            chain
            last edited by

            here is additional list that can be add to DNSBL

            http://www.securemecca.com/Downloads/hosts.txt

            1 Reply Last reply Reply Quote 0
            • T
              todolist
              last edited by

              Thanks for pfBlockerNG. I make heavy use of it! I have recently enabled DNSBL and am having a strange issue: When I try to access the pfSense web GUI via hostname, I am redirected to the DNSBL VIP (10.10.10.1). When I "dig firewall.domain" the pfSense box (DNS server) returns the VIP first, and then the proper IP: 10.100.0.1.

              I have Unbound set to disable forwarding and enable DHCP registrations and I have a host override for "firewall.domain" pointing to it's proper IP 10.100.0.1. DNSBL "Alerts" tab shows the following:

              IF: Unknown
              Source: Unknown
              Domain/Referer|URI|Agent: firewall.domain Not available for HTTPS alerts
              List: no match

              Am I missing something in the Unbound configuration? Or is it a DNSBL setting I'm missing? All other local hosts are resolving without issue, it's just pfSense itself that exhibits this behavior.

              1 Reply Last reply Reply Quote 0
              • BBcan177B
                BBcan177 Moderator
                last edited by

                @todolist:

                When I try to access the pfSense web GUI via hostname, I am redirected to the DNSBL VIP (10.10.10.1). When I "dig firewall.domain" the pfSense box (DNS server) returns the VIP first, and then the proper IP: 10.100.0.1.

                I have Unbound set to disable forwarding and enable DHCP registrations and I have a host override for "firewall.domain" pointing to it's proper IP 10.100.0.1. DNSBL "Alerts" tab shows the following:

                IF: Unknown
                Source: Unknown
                Domain/Referer|URI|Agent: firewall.domain Not available for HTTPS alerts
                List: no match

                Am I missing something in the Unbound configuration? Or is it a DNSBL setting I'm missing? All other local hosts are resolving without issue, it's just pfSense itself that exhibits this behavior.

                Check your NAT and DNS Host overrides… Don't add anything manually that points to the DNSBL VIP, as that is done by the pkg automatically... Also there are some issues with the Unbound DHCP reg checkboxes... Most leave those disabled...

                If you still having issues, maybe try to post in the DNS/NAT forum sections, to see if others can offer any other advice.

                "Experience is something you don't get until just after you need it."

                Website: http://pfBlockerNG.com
                Twitter: @BBcan177  #pfBlockerNG
                Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                1 Reply Last reply Reply Quote 0
                • T
                  todolist
                  last edited by

                  Thanks BBcan177! What would cause the "IF" and "Source" alerts to be "Unknown" and the "List" entry to read "no match"? Is there a debug option I can enable? I've looked through the pfBlockerNG logs tab but maybe I missed a "verbose" option?

                  1 Reply Last reply Reply Quote 0
                  • BBcan177B
                    BBcan177 Moderator
                    last edited by

                    Unfortunately for HTTPS requests, the IF/SRC information is not available to log… If you want to see more information run a tcpdump or wireshark... There is some help text in the DNSBL tab...

                    "Experience is something you don't get until just after you need it."

                    Website: http://pfBlockerNG.com
                    Twitter: @BBcan177  #pfBlockerNG
                    Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                    1 Reply Last reply Reply Quote 0
                    • T
                      todolist
                      last edited by

                      @BBcan177:

                      Unfortunately for HTTPS requests, the IF/SRC information is not available to log… If you want to see more information run a tcpdump or wireshark... There is some help text in the DNSBL tab...

                      Understood. Thanks again for this package!

                      1 Reply Last reply Reply Quote 0
                      • D
                        DLFerguRD
                        last edited by

                        Thanks for your hard work BBcan177 DNSBL in now working on pfsense 2.3 :)

                        1 Reply Last reply Reply Quote 0
                        • C
                          cwilkinson
                          last edited by

                          Hello,

                          I have just installed this package on a fresh install of pfSense 2.2.6, NanoBSD 4GB.

                          I followed your basic instructions and everything works, but after a reboot of the box the DNS Resolver Service fails to start with DNSBL enabled.

                          I do not have the log info at the moment, but I remember it was looking for a config file on /var that was no longer there.

                          Please Advise,

                          Thanks

                          1 Reply Last reply Reply Quote 0
                          • H
                            hda
                            last edited by

                            Services-DNS Resolver Advanced: delete config entry (that file has been lost). Save. Start Resolver.
                            pfBlockerNG-Update: Force Update.

                            1 Reply Last reply Reply Quote 0
                            • C
                              cwilkinson
                              last edited by

                              I already know how to fix it like that but that requires manual intervention, after a reboot that's not very useful.

                              1 Reply Last reply Reply Quote 0
                              • C
                                cipherson
                                last edited by

                                Hey Guys,

                                The latest version of pfsense/pfBlockerNG seems to have issues with the "ET IQRisk" list

                                I just updated my pfsense to the latest 2.2.6-RELEASE built on Mon Dec 21.

                                I noticed in the pfBlockerNG that my Alias for IQRisk only have an IP count of 1.

                                I review all the settings and they seemed to be messed up. Following the steps on the Repuation tab it says:
                                "Select the ET IQRisk' format. The URL should use the .gz File Type. Enter your "ETPRO" code in URL. Further information can be found @ ET IQRisk IP Reputation"
                                This format type is not longer listed and the help URL is no longer valid.

                                Any thoughts on how to fix this? Did they remove support for this list?

                                Also posted via reddit on /r/PFSENSE

                                https://www.reddit.com/r/PFSENSE/comments/428ehb/latest_pfblockerng_et_iqrisk_format_missing/

                                1 Reply Last reply Reply Quote 0
                                • C
                                  cipherson
                                  last edited by

                                  **Update

                                  After some messing around an point this to the file after stripping out the IPs it still has issues.

                                  [ mine ] Downloading update .. 200 OK. completed .. Empty file, Adding '1.1.1.1' to avoid download failure.

                                  maybe the file is has to much data and the download is timing out? leaving the file empty and failing to add any IPs.

                                  1 Reply Last reply Reply Quote 0
                                  • BBcan177B
                                    BBcan177 Moderator
                                    last edited by

                                    Hi cipherson,

                                    Emerging Threats was bought out by Proofpoint last year. I had a developer subscription to this list, but since it was bought out by Proofpoint, they didn't renew it, so if they made any changes, I am unable to help support any changes.

                                    The previous URL used to be as follows (Changing the X's to your Proofpoint subscription id):
                                      https://rules.emergingthreatspro.com/XXXXXXXXXXXXXXXX/reputation/iprepdata.txt.gz

                                    If you enter that URL in the browser, does the file download? I would assume that the URL would have changed also.

                                    If the URL is ok, post some screenshots of the Reputation tab (ET IQRISK) and obfuscate your Subscription ID…

                                    "Experience is something you don't get until just after you need it."

                                    Website: http://pfBlockerNG.com
                                    Twitter: @BBcan177  #pfBlockerNG
                                    Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                    1 Reply Last reply Reply Quote 0
                                    • C
                                      cipherson
                                      last edited by

                                      Hey BBcan177

                                      I can download the file fine by hand and the URL structure is the same.

                                      The file format still also looks the same:

                                      ip, category, score

                                      I also downloaded the file, pulled out only the IP addresses and re-served the file on a local webserver just as an IP list and it has the same download issues.

                                      During the update it hangs on the download of this large file (6.9 MB) for about 90 seconds with the following:

                                      [ ETIQRisk ] Downloading update  .. 200 OK.

                                      Then says the file is empty:

                                      Empty file, Adding '1.1.1.1' to avoid download failure.

                                      So its not event getting to download the file correctly.

                                      Anyway to debug the pull script? maybe add more verbose logging?

                                      1 Reply Last reply Reply Quote 0
                                      • BBcan177B
                                        BBcan177 Moderator
                                        last edited by

                                        When you see "200 ok", that means that the file was downloaded successfully… So the issue is in the parsing of the file...

                                        How many Lists did you select in the Reputation Tab - IQRisk Select Menu?

                                        If you are using Country Blocking and other lists, it could also be that the IPs are duplicates which could report "1.1.1.1" which is an empty file placeholder... Maybe try to move the IQRisk as the first pfBNG Alias and execute a "Force Reload"...

                                        "Experience is something you don't get until just after you need it."

                                        Website: http://pfBlockerNG.com
                                        Twitter: @BBcan177  #pfBlockerNG
                                        Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                        1 Reply Last reply Reply Quote 0
                                        • C
                                          cipherson
                                          last edited by

                                          Currently 20 in the list.

                                          I lower it to 1 option and added the IQRISK to the top, disabled all CC and other IPv4 lists

                                          Going to try a reinstall on this plugin to see if it helps

                                          Output from Cron:

                                          ===[  Continent Process  ]============================================

                                          ===[  IPv4 Process  ]=================================================

                                          [ ETIQRisk ] Downloading update  .. 200 OK.. completed ..
                                            Empty file, Adding '1.1.1.1' to avoid download failure.

                                          ===[  Aliastables / Rules  ]==========================================

                                          No changes to Firewall rules, skipping Filter Reload

                                          Updating: pfB_ETIQRisk
                                          no changes.

                                          ===[ FINAL Processing ]=====================================

                                          cat: /var/db/pfblockerng/original/Block: No such file or directory
                                          cat: All_custom.orig: No such file or directory
                                            [ Original IP count  ]  [ 32 ]

                                          ===[ Deny List IP Counts ]===========================

                                          1 total
                                                1 /var/db/pfblockerng/deny/ETIQRisk.txt

                                          ====================[ Empty Lists w/1.1.1.1 ]==================

                                          ETIQRisk

                                          ====================[ Last Updated List Summary ]==============

                                          Jan 22 21:06 ETIQRisk

                                          IPv4 alias tables IP count
                                          –---------------------------
                                          1

                                          IPv6 alias tables IP count

                                          0

                                          Alias table IP Counts

                                          1 /var/db/aliastables/pfB_ETIQRisk.txt

                                          pfSense Table Stats

                                          table-entries hard limit  2000000
                                          Table Usage Count        3725

                                          UPDATE PROCESS ENDED [ 01/22/16 21:07:30 ]

                                          1 Reply Last reply Reply Quote 0
                                          • BBcan177B
                                            BBcan177 Moderator
                                            last edited by

                                            It's hard to troubleshoot without being able to test the file. I sent you a PM, if you are interested to do a TeamViewer session, I can see it live and be able to sort it out for you.

                                            "Experience is something you don't get until just after you need it."

                                            Website: http://pfBlockerNG.com
                                            Twitter: @BBcan177  #pfBlockerNG
                                            Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post