PfBlockerNG v2.0 w/DNSBL

BBcan177 · Apr 21, 2016, 5:12 PM

I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

Do you have a multi-segmented LAN? ie -vlans etc… If so, there is an option in the DNSBL Tab, to create a Floating Permit rule. Select all the Lan segments that need access to the VIP...

When you browse to the VIP, it should return the 1x1... Have you tried a different browser? or other LAN device?

bluepr0 · Apr 21, 2016, 5:19 PM

@BBcan177:

@bluepr0:

I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

Do you have a multi-segmented LAN? ie -vlans etc… If so, there is an option in the DNSBL Tab, to create a Floating Permit rule. Select all the Lan segments that need access to the VIP...

When you browse to the VIP, it should return the 1x1... Have you tried a different browser? or other LAN device?

Nop, I don't have VLANs.

Tried with Chrome but I'm getting same result

But I can still ping the IP. It seems a bit weird that I'm getting 265ms though, it's just a small LAN with a 8 port switch

Thanks again!

BBcan177 · Apr 21, 2016, 5:21 PM

Are you using Squid (See posts above)?

If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

BBcan177 · Apr 21, 2016, 5:26 PM

There is a new version of pfBlockerNG v2.0.11 for pfSense 2.3, which was merged today. Pull Request #114 here.

Changelog:

Fix issues with de-installation (Not sure why anyone would de-install anyways :) )
Fix an issue with 'States Removal', so that it only acts on 'Block|Reject' rules.

bluepr0 · Apr 21, 2016, 5:39 PM

@BBcan177:

Are you using Squid (See posts above)?

If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

Yep, I'm using Squid. I will try to setup this wpad thing, is this guide still valid? https://doc.pfsense.org/index.php/WPAD_Autoconfigure_for_Squid

BBcan177 · Apr 21, 2016, 5:40 PM

@bluepr0:

@BBcan177:

Are you using Squid (See posts above)?

If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

Yep, I'm using Squid. I will try to setup this wpad thing, is this guide still valid? https://doc.pfsense.org/index.php/WPAD_Autoconfigure_for_Squid

I don't use Squid… Try changing wpad as suggested above by user "Merchant"

bluepr0 · Apr 21, 2016, 5:42 PM

@BBcan177:

@bluepr0:

@BBcan177:

Are you using Squid (See posts above)?

If you can't browse to the DNSBL VIP, then it will always be slow, and you will not get any Alert logging…

Yep, I'm using Squid. I will try to setup this wpad thing, is this guide still valid? https://doc.pfsense.org/index.php/WPAD_Autoconfigure_for_Squid

I don't use Squid… Try changing wpad as suggested above by user "Merchant"

Umm but I'm a bit lost about changing WPAD, I couldn't find anything related to pfsense and WPAD other than the guide I pasted above (https://doc.pfsense.org/index.php/WPAD_Autoconfigure_for_Squid) or is there an option in pfBlocker for WPAD?

Abhishek · Apr 21, 2016, 5:48 PM

@bluepr0:

@BBcan177:

@bluepr0:

I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

Do you have a multi-segmented LAN? ie -vlans etc… If so, there is an option in the DNSBL Tab, to create a Floating Permit rule. Select all the Lan segments that need access to the VIP...

When you browse to the VIP, it should return the 1x1... Have you tried a different browser? or other LAN device?

Nop, I don't have VLANs.

Tried with Chrome but I'm getting same result

But I can still ping the IP. It seems a bit weird that I'm getting 265ms though, it's just a small LAN with a 8 port switch

Thanks again!

pic shows you opened as http

can u try opening https://10.10.10.1 ?

bluepr0 · Apr 21, 2016, 5:50 PM

@Merchant:

@bluepr0:

@BBcan177:

@bluepr0:

I can ping the IP without problems, and all my devices are using my pfsense IP as DNS (as before) so it shouldn't be a problem there. However, if by "browse the DNSBL IP" you mean that I should get a reply when trying to open it from a browser then no, I get an error

Do you have a multi-segmented LAN? ie -vlans etc… If so, there is an option in the DNSBL Tab, to create a Floating Permit rule. Select all the Lan segments that need access to the VIP...

When you browse to the VIP, it should return the 1x1... Have you tried a different browser? or other LAN device?

Nop, I don't have VLANs.

Tried with Chrome but I'm getting same result

But I can still ping the IP. It seems a bit weird that I'm getting 265ms though, it's just a small LAN with a 8 port switch

Thanks again!

pic shows you opened as http

can u try opening https://10.10.10.1 ?

same result, sadly!

There's one thing I don't get, though! This was working flawlessly, Squid + pfBlocker (even on 2.3) as I upgraded a week ago… why it stopped working now without touching anything? o.O

Edit to add screenshot

Abhishek · Apr 24, 2016, 9:29 AM

can u click details ? see if there is option to add exception


https://www.websense.com/content/support/library/web/v76/pac_file_best_practices/PAC_best_pract.aspx

bluepr0 · Apr 21, 2016, 6:02 PM

@Merchant:

can u click details ? see if there is option to add exception

nop :(

pdrass · Apr 22, 2016, 1:16 AM

It seems like this is one massive question board for the one plugin so I'm going to ask:

I have 2.2.6-RELEASE (amd64) > in the "alerts" area of pfblockerng I don't see anything logged in the dnsbl area
I have 2.2.5-RELEASE (amd64) > in the "alerts" area of pfblockerng I see everything including https notifications of limited info but ads are still blocked

…so, is there a bug in the 2.2.6 release with respect to logging somehow?

They're 2 separate FW's but I went through the settings and they match perfectly. I also made sure the Windows server was in fact querying for DNS to the firewall and not anything else by blocking the server's IP > it then couldn't resolve external DNS hosts like google.com, yahoo.com but I could ping IP's (so not using DNS). Once I unblocked it form the firewall, DNS worked again so I KNOW it's "working" like:

hosts > query >> server >>> query firewall >>>> query public DNS + root servers

I also turned on unbound logging up to 5 or whatever the highest debug level and nothing jumped out at me...it's all "working" except for the alerts tab not showing what's blocked. I also compared a known ad site (an online newspaper) from the 2 different sites and both pages are exactly the same in IE so I think what's happening is that it's dnsbl'ing the ads just not showing them in the alerts tab.

Let me know if you find anything.

Thanks!

BBcan177 · Apr 22, 2016, 1:17 AM

There is a redmine issue for pfBlockerNG, and I'm hoping someone listening in this thread will PM me if they are experiencing this issue. I haven't been able to replicate this issue, so am reaching out to get some more specific details…

implode(): Invalid arguments passed in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 4638

https://redmine.pfsense.org/issues/6229

Thanks!

BBcan177 · Apr 22, 2016, 1:20 AM

@pdrass:

…so, is there a bug in the 2.2.6 release with respect to logging somehow?

Do you have squid at this location? Is it a multi-segmented Lan? Can you ping and browse to the DNSBL VIP address? I posted above for a similar issue…

killmasta93 · Apr 23, 2016, 5:23 PM

I also had issue with squid with wpad initially and with BBcan177 help i resolved the issue with my setup

i updated my wpad.pac file to make direct connected to 10.10.10.1

So I have this on wpad.da, wpad.dat and proxy.pac

function FindProxyForURL(url,host)
 {

    if (isInNet( host, "192.168.3.0", "255.255.255.0" )) 
        { return "DIRECT"; }
	 if (isInNet( host, "10.10.10.1", "255.255.255.0" )) 
        { return "DIRECT"; }	
	return "PROXY 192.168.3.254:3128";

Yes it works the GIF BUT does not show on alert on pfBlockerNG 2.0.5 odd? Also in theory if the GIF shows should start blocking ads? I also stoped Squidguard to see if it was blocking but no go :(

on a side note, the line of code is saying to ignore 10.10.10.1 and go though? I have been trying with OpenVPN no luck for WPAD to ignore the OpenVPN server of another pfSense box.

Also my previous wpad.da, wpad.dat and proxy.pac
What is the difference from the above vs this one?

function FindProxyForURL(url, host) 
{ 
    if (isPlainHostName(host) ||
        shExpMatch(host, "*.local") ||
        isInNet(dnsResolve(host), "192.168.3.0",  "255.255.255.0"))
        return "DIRECT";

    return "PROXY 192.168.3.254:3128";
}

Abhishek · Apr 24, 2016, 9:26 AM


on a side note, the line of code is saying to ignore 10.10.10.1 and go though? I have been trying with OpenVPN no luck for WPAD to ignore the OpenVPN server of another pfSense box.


Also my previous wpad.da, wpad.dat and proxy.pac
What is the difference from the above vs this one?


function FindProxyForURL(url,host)
 {

    if (isInNet( host, "192.168.3.0", "255.255.255.0" ))  { return "DIRECT"; }
   if (isInNet( host, "10.10.10.1", "255.255.255.0" ))    { return "DIRECT"; }	
	return "PROXY 192.168.3.254:3128";

both wpad means same , if u r trying to connect to 192.168.3.0 or 10.10.10.1 using http or https it will go directly without forwarding that traffic to proxy server (192.168.3.254:3124) and last line saying all other http/https traffic should b forwarded to 192.168.3.254

killmasta93 · Apr 25, 2016, 1:19 AM

I guess your right Whats odd it wont work for OpenVPN :( but i guess my issue was that I have my DNS server forwarders with 8.8.8.8 i needed to point to pfSense and pfSense to itself and 8.8.8.8 but Not sure if that takes a tab bit longer to navigate?

EDIT: your right for the OpenVPN it worked i was putting the NET of the VPN server while it was the LAN server on which i want to connect i feel so dumb…

Abhishek · Apr 25, 2016, 5:07 AM

PfblockerNG working but not showing in pfblockerNG Alerts , i have posted a pic showing firefox dev console header showing ( Via:"1.1 localhost (squid)" ) also ping reply to that domain returning 10.10.10.1

![PFblockerNG (1).PNG](/public/imported_attachments/1/PFblockerNG (1).PNG)
![PFblockerNG (1).PNG_thumb](/public/imported_attachments/1/PFblockerNG (1).PNG_thumb)
![PFblockerNG (2).png](/public/imported_attachments/1/PFblockerNG (2).png)
![PFblockerNG (2).png_thumb](/public/imported_attachments/1/PFblockerNG (2).png_thumb)
![PFblockerNG (3).PNG](/public/imported_attachments/1/PFblockerNG (3).PNG)
![PFblockerNG (3).PNG_thumb](/public/imported_attachments/1/PFblockerNG (3).PNG_thumb)

killmasta93 · Apr 25, 2016, 2:02 PM

Try this, First go to pfblockerNG then to DNSBL and add a custom block list and add a site just for testing purposes. in my case i added kat.cr save and reload pfblockerNG

Then open putty and login to pfSense and chose option 8 for shell

make sure that kat.cr is on the conf

grep "kat.cr" /var/unbound/pfb_dnsbl.conf

if it shows that it is then go to step 2

after that you see its on the conf

ping kat.cr you should get reply 10.10.10.1 if you dont then make sure your DNS is pointing to pfSense

Nachtfalke · Apr 25, 2016, 9:11 PM

@Merchant:

Hi,

same situation in my environment. I changes from HTTPS WebUI to HTTP because WPAD is hosted on pfsense itself. But i defined all private IPs to go DIRECT and not using the proxy in the WPAD files. But unfortunately it does not work.

Further I disabled auto proxy configuration and hardcoded the proxy in my browser but DNSBL still does only work with HTTP (pfsense WebUI page) but not with HTTPS. Further it does not log anything :-(

PS:
Anybody here who could suggest a good DNSBL which focuses on command and control server and such stuff?

can u post ur wpad file content , ( Look my wpad file , for me after instructing wpad to give Direct connection to 10.x.x..x now its working okay

@Nachtfalke:

@killmasta93:

FOR PEOPLE WITH GIF ISSUES READ THIS

If your running WPAD and have on your navigator to auto detect proxy you WILL get the webGUI of pfSense instead of the GIF but disable the auto detect proxy on the navigator you then will see the GIF…It seems that WPAD overrides everything even when it comes to OpenVPN also...

Thanks for that information. I am using WPAD with squid3 proxy. But I only get the WebUI with http websites. Is it working for you with httpS websites, too?
Can you describe if you configued something sepcidal to get pfblocker-NG + squid (http + https) working?

For me it looks like it is not working fpr https and it ios not working for http and https to see the bad websites in the "Alerts" tab of pfblopcker-ng.

Regards

@Nachtfalke:

@killmasta93:

Well I have pfBlockerNG working just for IP I had to disable DNSBL because WPAD was overriding everything. Because WPAD files are hosted on pfSense I had to revert to HTTP on the webGUI of pfSense. But by disabling auto detect proxy then works DNSBL but then WPAD wont work BUT transparent proxy will. I guess having WPAD and DNSBL wont work at the same time. UNLESS somehow on the wpad.dat a way to direct or ignore the 10.10.10.1 something that i wish it can do with OpenVPN. You get the HTTPS sites i guess because WPAD overlaps that but the http that would be the transparent proxy which DNSBL does not have an issue. Also depends if your webGUI is HTTPS or HTTP

I also had issue with squid with wpad initially and with BBcan177 help i resolved the issue with my setup

i updated my wpad.pac file to make direct connected to 10.10.10.1
 function FindProxyForURL(url,host)
 {
	
    if (isInNet( host, "192.168.0.0", "255.255.255.0" )) 
        { return "DIRECT"; }
	 if (isInNet( host, "10.10.10.1", "255.255.255.0" )) 
        { return "DIRECT"; }	
	return "PROXY 192.168.0.1:3128";
 }
 
 
 
 
now i am able to use proxy with wpad and also get 1x1 gif while blocking

Hi Merchant,

thank you for taking time on trying to resolve this issue.

Here is my proxy.pac, wpad.da and wpad.dat - all three files are the same:


function FindProxyForURL(url, host) {

    // Normalize the URL for pattern macthing
    url = url.toLowerCase();
    host = host.toLowerCase();

    // diese Ziel-IPs, Domains oder Hosts gehen DIRECT
    if (shExpMatch(host, "192.168.*.*") ||
        shExpMatch(host, "*.microsoft.com") ||
        shExpMatch(host, "*.windowsupdates.com") ||
        shExpMatch(host, "127.0.0.1") ||
        shExpMatch(host, "ap.bundesbank.de") ||
        shExpMatch(host, "10.*.*.*") ||
        shExpMatch(host, "10.123.123.123") ||
        shExpMatch(host, "localhost"))
    {
    return "DIRECT";
    }

    if (isInNet( host, "10.123.123.0", "255.255.255.0" ))
        { return "DIRECT"; }

    // diese URLs gehen DIRECT ohne Proxy.
    // if (shExpMatch(url, "https://www.vrbank-mkb.de/*") ||
    //     shExpMatch(url, "https://www.cortalconsors.de/*") ||
    //     shExpMatch(url, "https://www.consorsbank.de/*"))
    // {
    // return "DIRECT";
    // }

// Fuer alle anderen Requests den Proxy zurueckgeben
return "PROXY 192.168.10.1:3128";
}

My LAN is on 192.168.10.0/24
My WAN is on 192.168.178.0/24
My DNSBL VIP is on 10.123.123.123

SQUID is running in non-transparent mode and I am using WPAD and "Auto Configuration" configured on my Chrome browser on my client 192.168.10.10

pinging a URL "c06.smaato.net" which is on a blocklist works. See screenshot "ping_OK"

Accessing the same website via chrome (http or https) ist NOT working - see screenshot "chrome_DNS":
I cleared the DNS cache on windows with "ipconfig /dnsflush" and I cleared the brwosers dns cache like you can see in the screenshot.

PS:
Some questions:

Question1 - Unbound interfaces:
Can we compare the unbound DNS configuration - Which interfaces do you have for incoming and outgoing?
I have only "LAN and loopback for incoming" and only "WAN for outgoing". Nothing else.

Question 2 - squid listening interfaces:
Which interfaces do you have on squid?
I have "LAN and loopback" configured as listening interfaces.

Question 3 - DNS configuration on squid:
I did NOT configre any alternate squid DNS Servers.

Question 4 - DNS Servers for pfsense:
In pfsense "General setup" I have configured one external DNS Server which is my upstream router (Fritz!Box).
I have unchecked "DNS Server Override"
I have unchecked "Disable DNS Forwarder"

I would really appreciate any advice if possible :-)

–-- edit ----
Added "loopback" interface as listening interface for unbound. Missed this.