Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PfBlockerNG v2.0 w/DNSBL

    Scheduled Pinned Locked Moved
    pfBlockerNG
    192
    1.1k
    1.4m
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      docjay
      last edited by

      @BBcan177:

      @docjay:

      BBCAN,

      Hey- thanks for all of your hard work with this package!  I'm setting up a 2nd PFsense box for a client and I'm wanting to copy over my 'pfblockerNG' config.  Is there an easy way to do it other than doing it all by hand?

      thanks

      Jamie

      Did you try the "Sync" Tab in the package?

      LOL, nope.  Sorry, I didn't see it or think it would do what I would expect.  I'll give it a shot this evening!

      Thanks!

      1 Reply Last reply Reply Quote 0
      • BBcan177B
        BBcan177 Moderator
        last edited by

        @Merchant:

        update

        An obersevation: why use three different yoyo feeds:
        http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&mimetype=plaintext
        http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&startdate[day]=&startdate[month]=&startdate[year]=&useip=0.0.0.0
        http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&mimetype=plaintextoup

        Is there a reason why you seperated hpHosts, instead of using the single download for them all?
        http://hosts-file.net/download/hosts.zip

        http://hosts-file.net/fsa.txt
        http://hosts-file.net/hjk.txt
        http://hosts-file.net/pha.txt
        http://hosts-file.net/emd.txt
        http://hosts-file.net/exp.txt
        http://hosts-file.net/mmt.txt
        http://hosts-file.net/grm.txt
        http://hosts-file.net/hfs.txt

        As a note: Look at the pfblockerng.log, it will show a section "DNSBL Domain/IP Counts" which will show you which DNSBL Feeds have IPs… look for the .ip extension...

        But when i tried to open 10.10.10.1  in webbrowser i am getting pfsense login page instead of 1x1 image , so i guess that might b the problem

        Yes your problem is due to Squid… I don't use Squid, and can't really help you workaround this issue.... Others have had a similar issue, but haven't seen anyone reply with a solution yet...

        "Experience is something you don't get until just after you need it."

        Website: http://pfBlockerNG.com
        Twitter: @BBcan177  #pfBlockerNG
        Reddit: https://www.reddit.com/r/pfBlockerNG/new/

        1 Reply Last reply Reply Quote 0
        • D
          docjay
          last edited by

          @docjay:

          @BBcan177:

          @docjay:

          BBCAN,

          Hey- thanks for all of your hard work with this package!  I'm setting up a 2nd PFsense box for a client and I'm wanting to copy over my 'pfblockerNG' config.  Is there an easy way to do it other than doing it all by hand?

          thanks

          Jamie

          Did you try the "Sync" Tab in the package?

          LOL, nope.  Sorry, I didn't see it or think it would do what I would expect.  I'll give it a shot this evening!

          Thanks!

          I tried the sync tab and it worked bad ass!  I should have looked at it before, sorry for bothering you & thanks for thinking of this option!

          1 Reply Last reply Reply Quote 0
          • A
            Abhishek
            last edited by

            @BBcan177:

            @Merchant:

            update

            An obersevation: why use three different yoyo feeds:
            http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&mimetype=plaintext
            http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&startdate[day]=&startdate[month]=&startdate[year]=&useip=0.0.0.0
            http://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&mimetype=plaintextoup

            Is there a reason why you seperated hpHosts, instead of using the single download for them all?
            http://hosts-file.net/download/hosts.zip

            http://hosts-file.net/fsa.txt
            http://hosts-file.net/hjk.txt
            http://hosts-file.net/pha.txt
            http://hosts-file.net/emd.txt
            http://hosts-file.net/exp.txt
            http://hosts-file.net/mmt.txt
            http://hosts-file.net/grm.txt
            http://hosts-file.net/hfs.txt

            As a note: Look at the pfblockerng.log, it will show a section "DNSBL Domain/IP Counts" which will show you which DNSBL Feeds have IPs… look for the .ip extension...

            But when i tried to open 10.10.10.1  in webbrowser i am getting pfsense login page instead of 1x1 image , so i guess that might b the problem

            Yes your problem is due to Squid… I don't use Squid, and can't really help you workaround this issue.... Others have had a similar issue, but haven't seen anyone reply with a solution yet...

            1. thank you , i will update the host's list

            2. i will try modify my wpad so that host wont use proxy for 10.x.x.x network , will check today , thank you as  usual , u rocks :)

            update

            Updated my wpad and now its working :D , thank you  . its loading (1x1) 
            Now all websites are loading fast

            2.3-RC (amd64)
            built on Mon Apr 04 17:09:32 CDT 2016
            FreeBSD 10.3-RELEASE
            Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz

            darkstat 3.1.2_1
            Lightsquid 3.0.3_1
            mailreport 3.0_1
            pfBlockerNG 2.0.9_1  
            RRD_Summary 1.3.1_2
            snort 3.2.9.1_9  
            squid 0.4.16_1  
            squidGuard 1.14_1
            syslog-ng 1.1.2_2

            1 Reply Last reply Reply Quote 0
            • G
              GoldServe
              last edited by

              Has anyone noticed the dnsbl alert entries have the wrong time? Seems to be a few hours ahead from all the other firewall entries.

              1 Reply Last reply Reply Quote 0
              • A
                Abhishek
                last edited by

                @GoldServe:

                Has anyone noticed the dnsbl alert entries have the wrong time? Seems to be a few hours ahead from all the other firewall entries.

                mine is showing correct

                PFB1.png
                PFB1.png_thumb

                2.3-RC (amd64)
                built on Mon Apr 04 17:09:32 CDT 2016
                FreeBSD 10.3-RELEASE
                Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz

                darkstat 3.1.2_1
                Lightsquid 3.0.3_1
                mailreport 3.0_1
                pfBlockerNG 2.0.9_1  
                RRD_Summary 1.3.1_2
                snort 3.2.9.1_9  
                squid 0.4.16_1  
                squidGuard 1.14_1
                syslog-ng 1.1.2_2

                1 Reply Last reply Reply Quote 0
                • BBcan177B
                  BBcan177 Moderator
                  last edited by

                  @GoldServe:

                  Has anyone noticed the dnsbl alert entries have the wrong time? Seems to be a few hours ahead from all the other firewall entries.

                  Which DNSBL alerts? HTTP or HTTPS. For HTTP, it takes the request time from the remote Lan device. Could the clock be off on one of your desktops?

                  "Experience is something you don't get until just after you need it."

                  Website: http://pfBlockerNG.com
                  Twitter: @BBcan177  #pfBlockerNG
                  Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                  1 Reply Last reply Reply Quote 0
                  • G
                    GoldServe
                    last edited by

                    Seems like HTTP timestamps are wrong. Which remote Lan device? All my laptops and desktops are Macs and their times are all correct. I am running pfsense in ESXI 6…

                    1 Reply Last reply Reply Quote 0
                    • G
                      GoldServe
                      last edited by

                      I don't know if it matters but it seems like my /usr/local/etc/php.ini has this line set

                      date.timezone="Etc/UTC"

                      when clearly /etc/rc.php_ini_setup contains the following code:

                      unset TIMEZONE
# Fetch the timezone from /var/db/zoneinfo if present
if [ -f /var/db/zoneinfo ]; then
	TIMEZONE=$(cat /var/db/zoneinfo)
fi

if [ -z "${TIMEZONE}" ]; then
	# Second option is from config.xml
	TIMEZONE=$(/usr/local/sbin/read_xml_tag.sh string system/timezone)
fi

if [ -z "${TIMEZONE}" ]; then
	# Last option, use default value from $g or Etc/UTC
	TIMEZONE=$(/usr/local/sbin/read_global_var default_timezone "Etc/UTC")
fi

                      Anyone spot anything wrong? I verified the timezone is correct by running the script /usr/local/sbin/read_xml_tag.sh string system/timezone

                      1 Reply Last reply Reply Quote 0
                      • A
                        Abhishek
                        last edited by

                        Hi,

                        same situation in my environment. I changes from HTTPS WebUI to HTTP because WPAD is hosted on pfsense itself. But i defined all private IPs to go DIRECT and not using the proxy in the WPAD files. But unfortunately it does not work.

                        Further I disabled auto proxy configuration and hardcoded the proxy in my browser but DNSBL still does only work with HTTP (pfsense WebUI page) but not with HTTPS. Further it does not log anything :-(

                        PS:
                        Anybody here who could suggest a good DNSBL which focuses on command and control server and such stuff?

                        can u post ur wpad file content ,  ( Look my wpad file , for me after instructing wpad to give Direct connection to 10.x.x..x now its working okay

                        @Nachtfalke:

                        @killmasta93:

                        FOR PEOPLE WITH GIF ISSUES READ THIS

                        If your running WPAD and have on your navigator to auto detect proxy you WILL get the webGUI of pfSense instead of the GIF but disable the auto detect proxy on the navigator you then will see the GIF…It seems that WPAD overrides everything even when it comes to OpenVPN also...

                        Thanks for that information. I am using WPAD with squid3 proxy. But I only get the WebUI with http websites. Is it working for you with httpS websites, too?
                        Can you describe if you configued something sepcidal to get pfblocker-NG + squid (http + https) working?

                        For me it looks like it is not working fpr https and it ios not working for http and https to see the bad websites in the "Alerts" tab of pfblopcker-ng.

                        Regards

                        @Nachtfalke:

                        @killmasta93:

                        Well I have pfBlockerNG working just for IP I had to disable DNSBL because WPAD was overriding everything. Because WPAD files are hosted on pfSense I had to revert to HTTP on the webGUI of pfSense. But by disabling auto detect proxy then works DNSBL but then WPAD wont work BUT transparent proxy will. I guess having WPAD and DNSBL wont work at the same time. UNLESS somehow on the wpad.dat a way to direct or ignore the 10.10.10.1 something that i wish it can do with OpenVPN. You get the HTTPS sites i guess because WPAD overlaps that but the http that would be the transparent proxy which DNSBL does not have an issue. Also depends if your webGUI is HTTPS or HTTP

                        I also had issue with squid with wpad initially and  with BBcan177 help i resolved the issue with my setup

                        i updated my wpad.pac file to make direct connected to 10.10.10.1

                        
 function FindProxyForURL(url,host)
 {

    if (isInNet( host, "192.168.0.0", "255.255.255.0" )) 
        { return "DIRECT"; }
	 if (isInNet( host, "10.10.10.1", "255.255.255.0" )) 
        { return "DIRECT"; }	
	return "PROXY 192.168.0.1:3128";
 }

                        now i am able to use proxy with wpad and also get 1x1 gif while blocking

                        2.3-RC (amd64)
                        built on Mon Apr 04 17:09:32 CDT 2016
                        FreeBSD 10.3-RELEASE
                        Intel(R) Core(TM)2 Duo CPU E4500 @ 2.20GHz

                        darkstat 3.1.2_1
                        Lightsquid 3.0.3_1
                        mailreport 3.0_1
                        pfBlockerNG 2.0.9_1  
                        RRD_Summary 1.3.1_2
                        snort 3.2.9.1_9  
                        squid 0.4.16_1  
                        squidGuard 1.14_1
                        syslog-ng 1.1.2_2

                        1 Reply Last reply Reply Quote 0
                        • B
                          bluepr0
                          last edited by

                          Hello! I just noticed today that pfBlocker is not "working" anymore. It's actually enabled and it was working fine blocking ads, now it seems nothing changed (I'm sure I haven't changed any settings) but I'm not getting ads blocked

                          Here you can see it's enabled

                          Any ideas on what's going on? There's no errors in the logs either :(

                          It seems the latest blocked URLS were from April 19

                          DNSBL Reject HTTPS,Apr 19 18:15:10,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:10,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:11,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:15:44,ui.skype.com
DNSBL Reject HTTPS,Apr 19 18:16:44,ui.skype.com
DNSBL Reject HTTPS,Apr 19 18:17:44,ui.skype.com
DNSBL Reject HTTPS,Apr 19 18:18:44,ui.skype.com
DNSBL Reject HTTPS,Apr 19 18:19:44,ui.skype.com
DNSBL Reject HTTPS,Apr 19 18:20:44,ui.skype.com
DNSBL Reject HTTPS,Apr 19 18:20:51,ssl.google-analytics.com
DNSBL Reject HTTPS,Apr 19 18:20:51,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:51,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:51,analytics.query.yahoo.com
DNSBL Reject HTTPS,Apr 19 18:20:51,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:51,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:52,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:52,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:52,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:52,e.crashlytics.com
DNSBL Reject HTTPS,Apr 19 18:20:52,e.crashlytics.com
                          1 Reply Last reply Reply Quote 0
                          • BBcan177B
                            BBcan177 Moderator
                            last edited by

                            @bluepr0:

                            Hello! I just noticed today that pfBlocker is not "working" anymore. It's actually enabled and it was working fine blocking ads, now it seems nothing changed (I'm sure I haven't changed any settings) but I'm not getting ads blocked

                            Ensure that the LAN devices have only pfSense set as their DNS server. Can you ping the DNSBL VIP address? Can you browse to the DNSBL VIP address?

                            "Experience is something you don't get until just after you need it."

                            Website: http://pfBlockerNG.com
                            Twitter: @BBcan177  #pfBlockerNG
                            Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                            1 Reply Last reply Reply Quote 0
                            • BBcan177B
                              BBcan177 Moderator
                              last edited by

                              @Merchant:

                              I also had issue with squid with wpad initially and  with BBcan177 help i resolved the issue with my setup

                              i updated my wpad.pac file to make direct connected to 10.10.10.1

                              
 function FindProxyForURL(url,host)
 {
    if (isInNet( host, "192.168.0.0", "255.255.255.0" )) 
        { return "DIRECT"; }
    if (isInNet( host, "10.10.10.1", "255.255.255.0" )) 
        { return "DIRECT"; }	
    return "PROXY 192.168.0.1:3128";
 }

                              now i am able to use proxy with wpad and also get 1x1 gif while blocking

                              Thanks Merchant, I hope the other users that had the same issue can get this resolved also…  8)

                              "Experience is something you don't get until just after you need it."

                              Website: http://pfBlockerNG.com
                              Twitter: @BBcan177  #pfBlockerNG
                              Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                              1 Reply Last reply Reply Quote 0
                              • B
                                bluepr0
                                last edited by

                                @BBcan177:

                                @bluepr0:

                                Hello! I just noticed today that pfBlocker is not "working" anymore. It's actually enabled and it was working fine blocking ads, now it seems nothing changed (I'm sure I haven't changed any settings) but I'm not getting ads blocked

                                Ensure that the LAN devices have only pfSense set as their DNS server. Can you ping the DNSBL VIP address? Can you browse to the DNSBL VIP address?

                                Hello BBcan177,

                                I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

                                But as I said, I get ping

                                1 Reply Last reply Reply Quote 0
                                • BBcan177B
                                  BBcan177 Moderator
                                  last edited by

                                  @bluepr0:

                                  I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

                                  Do you have a multi-segmented LAN? ie -vlans etc… If so, there is an option in the DNSBL Tab, to create a Floating Permit rule. Select all the Lan segments that need access to the VIP...

                                  When you browse to the VIP, it should return the 1x1... Have you tried a different browser? or other LAN device?

                                  "Experience is something you don't get until just after you need it."

                                  Website: http://pfBlockerNG.com
                                  Twitter: @BBcan177  #pfBlockerNG
                                  Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                  1 Reply Last reply Reply Quote 0
                                  • B
                                    bluepr0
                                    last edited by

                                    @BBcan177:

                                    @bluepr0:

                                    I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

                                    Do you have a multi-segmented LAN? ie -vlans etc… If so, there is an option in the DNSBL Tab, to create a Floating Permit rule. Select all the Lan segments that need access to the VIP...

                                    When you browse to the VIP, it should return the 1x1... Have you tried a different browser? or other LAN device?

                                    Nop, I don't have VLANs.

                                    Tried with Chrome but I'm getting same result

                                    But I can still ping the IP. It seems a bit weird that I'm getting 265ms though, it's just a small LAN with a 8 port switch

                                    Thanks again!

                                    1 Reply Last reply Reply Quote 0
                                    • BBcan177B
                                      BBcan177 Moderator
                                      last edited by

                                      Are you using Squid (See posts above)?

                                      If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

                                      "Experience is something you don't get until just after you need it."

                                      Website: http://pfBlockerNG.com
                                      Twitter: @BBcan177  #pfBlockerNG
                                      Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                      1 Reply Last reply Reply Quote 0
                                      • BBcan177B
                                        BBcan177 Moderator
                                        last edited by

                                        There is a new version of pfBlockerNG v2.0.11 for pfSense 2.3, which was merged today. Pull Request #114 here.

                                        Changelog:

                                        • Fix issues with de-installation (Not sure why anyone would de-install anyways :) )

                                        • Fix an issue with 'States Removal', so that it only acts on 'Block|Reject' rules.

                                        "Experience is something you don't get until just after you need it."

                                        Website: http://pfBlockerNG.com
                                        Twitter: @BBcan177  #pfBlockerNG
                                        Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                        1 Reply Last reply Reply Quote 0
                                        • B
                                          bluepr0
                                          last edited by

                                          @BBcan177:

                                          Are you using Squid (See posts above)?

                                          If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

                                          Yep, I'm using Squid. I will try to setup this wpad thing, is this guide still valid? https://doc.pfsense.org/index.php/WPAD_Autoconfigure_for_Squid

                                          1 Reply Last reply Reply Quote 0
                                          • BBcan177B
                                            BBcan177 Moderator
                                            last edited by

                                            @bluepr0:

                                            @BBcan177:

                                            Are you using Squid (See posts above)?

                                            If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

                                            Yep, I'm using Squid. I will try to setup this wpad thing, is this guide still valid? https://doc.pfsense.org/index.php/WPAD_Autoconfigure_for_Squid

                                            I don't use Squid… Try changing wpad as suggested above by user "Merchant"

                                            "Experience is something you don't get until just after you need it."

                                            Website: http://pfBlockerNG.com
                                            Twitter: @BBcan177  #pfBlockerNG
                                            Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post