PfBlockerNG v2.0 w/DNSBL

pdrass

It seems like this is one massive question board for the one plugin so I'm going to ask:

I have 2.2.6-RELEASE (amd64) > in the "alerts" area of pfblockerng I don't see anything logged in the dnsbl area
I have 2.2.5-RELEASE (amd64) > in the "alerts" area of pfblockerng I see everything including https notifications of limited info but ads are still blocked

…so, is there a bug in the 2.2.6 release with respect to logging somehow?

They're 2 separate FW's but I went through the settings and they match perfectly. I also made sure the Windows server was in fact querying for DNS to the firewall and not anything else by blocking the server's IP > it then couldn't resolve external DNS hosts like google.com, yahoo.com but I could ping IP's (so not using DNS). Once I unblocked it form the firewall, DNS worked again so I KNOW it's "working" like:

hosts > query >> server >>> query firewall >>>> query public DNS + root servers

I also turned on unbound logging up to 5 or whatever the highest debug level and nothing jumped out at me...it's all "working" except for the alerts tab not showing what's blocked. I also compared a known ad site (an online newspaper) from the 2 different sites and both pages are exactly the same in IE so I think what's happening is that it's dnsbl'ing the ads just not showing them in the alerts tab.

Let me know if you find anything.

Thanks!

BBcan177

There is a redmine issue for pfBlockerNG, and I'm hoping someone listening in this thread will PM me if they are experiencing this issue. I haven't been able to replicate this issue, so am reaching out to get some more specific details…

implode(): Invalid arguments passed in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 4638

https://redmine.pfsense.org/issues/6229

Thanks!

BBcan177

@pdrass:

…so, is there a bug in the 2.2.6 release with respect to logging somehow?

Do you have squid at this location? Is it a multi-segmented Lan? Can you ping and browse to the DNSBL VIP address? I posted above for a similar issue…

killmasta93

I also had issue with squid with wpad initially and with BBcan177 help i resolved the issue with my setup

i updated my wpad.pac file to make direct connected to 10.10.10.1

So I have this on wpad.da, wpad.dat and proxy.pac

function FindProxyForURL(url,host)
 {

    if (isInNet( host, "192.168.3.0", "255.255.255.0" )) 
        { return "DIRECT"; }
	 if (isInNet( host, "10.10.10.1", "255.255.255.0" )) 
        { return "DIRECT"; }	
	return "PROXY 192.168.3.254:3128";

Yes it works the GIF BUT does not show on alert on pfBlockerNG 2.0.5 odd? Also in theory if the GIF shows should start blocking ads? I also stoped Squidguard to see if it was blocking but no go :(

on a side note, the line of code is saying to ignore 10.10.10.1 and go though? I have been trying with OpenVPN no luck for WPAD to ignore the OpenVPN server of another pfSense box.

Also my previous wpad.da, wpad.dat and proxy.pac
What is the difference from the above vs this one?

function FindProxyForURL(url, host) 
{ 
    if (isPlainHostName(host) ||
        shExpMatch(host, "*.local") ||
        isInNet(dnsResolve(host), "192.168.3.0",  "255.255.255.0"))
        return "DIRECT";

    return "PROXY 192.168.3.254:3128";
}

Abhishek


on a side note, the line of code is saying to ignore 10.10.10.1 and go though? I have been trying with OpenVPN no luck for WPAD to ignore the OpenVPN server of another pfSense box.


Also my previous wpad.da, wpad.dat and proxy.pac
What is the difference from the above vs this one?


function FindProxyForURL(url,host)
 {

    if (isInNet( host, "192.168.3.0", "255.255.255.0" ))  { return "DIRECT"; }
   if (isInNet( host, "10.10.10.1", "255.255.255.0" ))    { return "DIRECT"; }	
	return "PROXY 192.168.3.254:3128";

both wpad means same , if u r trying to connect to 192.168.3.0 or 10.10.10.1 using http or https it will go directly without forwarding that traffic to proxy server (192.168.3.254:3124) and last line saying all other http/https traffic should b forwarded to 192.168.3.254

killmasta93

I guess your right Whats odd it wont work for OpenVPN :( but i guess my issue was that I have my DNS server forwarders with 8.8.8.8 i needed to point to pfSense and pfSense to itself and 8.8.8.8 but Not sure if that takes a tab bit longer to navigate?

EDIT: your right for the OpenVPN it worked i was putting the NET of the VPN server while it was the LAN server on which i want to connect i feel so dumb…

Abhishek

PfblockerNG working but not showing in pfblockerNG Alerts , i have posted a pic showing firefox dev console header showing ( Via:"1.1 localhost (squid)" ) also ping reply to that domain returning 10.10.10.1

![PFblockerNG (1).PNG](/public/imported_attachments/1/PFblockerNG (1).PNG)
![PFblockerNG (1).PNG_thumb](/public/imported_attachments/1/PFblockerNG (1).PNG_thumb)
![PFblockerNG (2).png](/public/imported_attachments/1/PFblockerNG (2).png)
![PFblockerNG (2).png_thumb](/public/imported_attachments/1/PFblockerNG (2).png_thumb)
![PFblockerNG (3).PNG](/public/imported_attachments/1/PFblockerNG (3).PNG)
![PFblockerNG (3).PNG_thumb](/public/imported_attachments/1/PFblockerNG (3).PNG_thumb)

killmasta93

Try this, First go to pfblockerNG then to DNSBL and add a custom block list and add a site just for testing purposes. in my case i added kat.cr save and reload pfblockerNG

Then open putty and login to pfSense and chose option 8 for shell

make sure that kat.cr is on the conf

grep "kat.cr" /var/unbound/pfb_dnsbl.conf

if it shows that it is then go to step 2

after that you see its on the conf

ping kat.cr you should get reply 10.10.10.1 if you dont then make sure your DNS is pointing to pfSense

Nachtfalke

@Merchant:

Hi,

same situation in my environment. I changes from HTTPS WebUI to HTTP because WPAD is hosted on pfsense itself. But i defined all private IPs to go DIRECT and not using the proxy in the WPAD files. But unfortunately it does not work.

Further I disabled auto proxy configuration and hardcoded the proxy in my browser but DNSBL still does only work with HTTP (pfsense WebUI page) but not with HTTPS. Further it does not log anything :-(

PS:
Anybody here who could suggest a good DNSBL which focuses on command and control server and such stuff?

can u post ur wpad file content , ( Look my wpad file , for me after instructing wpad to give Direct connection to 10.x.x..x now its working okay

@Nachtfalke:

@killmasta93:

FOR PEOPLE WITH GIF ISSUES READ THIS

If your running WPAD and have on your navigator to auto detect proxy you WILL get the webGUI of pfSense instead of the GIF but disable the auto detect proxy on the navigator you then will see the GIF…It seems that WPAD overrides everything even when it comes to OpenVPN also...

Thanks for that information. I am using WPAD with squid3 proxy. But I only get the WebUI with http websites. Is it working for you with httpS websites, too?
Can you describe if you configued something sepcidal to get pfblocker-NG + squid (http + https) working?

For me it looks like it is not working fpr https and it ios not working for http and https to see the bad websites in the "Alerts" tab of pfblopcker-ng.

Regards

@Nachtfalke:

@killmasta93:

Well I have pfBlockerNG working just for IP I had to disable DNSBL because WPAD was overriding everything. Because WPAD files are hosted on pfSense I had to revert to HTTP on the webGUI of pfSense. But by disabling auto detect proxy then works DNSBL but then WPAD wont work BUT transparent proxy will. I guess having WPAD and DNSBL wont work at the same time. UNLESS somehow on the wpad.dat a way to direct or ignore the 10.10.10.1 something that i wish it can do with OpenVPN. You get the HTTPS sites i guess because WPAD overlaps that but the http that would be the transparent proxy which DNSBL does not have an issue. Also depends if your webGUI is HTTPS or HTTP

I also had issue with squid with wpad initially and with BBcan177 help i resolved the issue with my setup

i updated my wpad.pac file to make direct connected to 10.10.10.1
 function FindProxyForURL(url,host)
 {
	
    if (isInNet( host, "192.168.0.0", "255.255.255.0" )) 
        { return "DIRECT"; }
	 if (isInNet( host, "10.10.10.1", "255.255.255.0" )) 
        { return "DIRECT"; }	
	return "PROXY 192.168.0.1:3128";
 }
 
 
 
 
now i am able to use proxy with wpad and also get 1x1 gif while blocking

Hi Merchant,

thank you for taking time on trying to resolve this issue.

Here is my proxy.pac, wpad.da and wpad.dat - all three files are the same:


function FindProxyForURL(url, host) {

    // Normalize the URL for pattern macthing
    url = url.toLowerCase();
    host = host.toLowerCase();

    // diese Ziel-IPs, Domains oder Hosts gehen DIRECT
    if (shExpMatch(host, "192.168.*.*") ||
        shExpMatch(host, "*.microsoft.com") ||
        shExpMatch(host, "*.windowsupdates.com") ||
        shExpMatch(host, "127.0.0.1") ||
        shExpMatch(host, "ap.bundesbank.de") ||
        shExpMatch(host, "10.*.*.*") ||
        shExpMatch(host, "10.123.123.123") ||
        shExpMatch(host, "localhost"))
    {
    return "DIRECT";
    }

    if (isInNet( host, "10.123.123.0", "255.255.255.0" ))
        { return "DIRECT"; }

    // diese URLs gehen DIRECT ohne Proxy.
    // if (shExpMatch(url, "https://www.vrbank-mkb.de/*") ||
    //     shExpMatch(url, "https://www.cortalconsors.de/*") ||
    //     shExpMatch(url, "https://www.consorsbank.de/*"))
    // {
    // return "DIRECT";
    // }

// Fuer alle anderen Requests den Proxy zurueckgeben
return "PROXY 192.168.10.1:3128";
}

My LAN is on 192.168.10.0/24
My WAN is on 192.168.178.0/24
My DNSBL VIP is on 10.123.123.123

SQUID is running in non-transparent mode and I am using WPAD and "Auto Configuration" configured on my Chrome browser on my client 192.168.10.10

pinging a URL "c06.smaato.net" which is on a blocklist works. See screenshot "ping_OK"

Accessing the same website via chrome (http or https) ist NOT working - see screenshot "chrome_DNS":
I cleared the DNS cache on windows with "ipconfig /dnsflush" and I cleared the brwosers dns cache like you can see in the screenshot.

PS:
Some questions:

Question1 - Unbound interfaces:
Can we compare the unbound DNS configuration - Which interfaces do you have for incoming and outgoing?
I have only "LAN and loopback for incoming" and only "WAN for outgoing". Nothing else.

Question 2 - squid listening interfaces:
Which interfaces do you have on squid?
I have "LAN and loopback" configured as listening interfaces.

Question 3 - DNS configuration on squid:
I did NOT configre any alternate squid DNS Servers.

Question 4 - DNS Servers for pfsense:
In pfsense "General setup" I have configured one external DNS Server which is my upstream router (Fritz!Box).
I have unchecked "DNS Server Override"
I have unchecked "Disable DNS Forwarder"

I would really appreciate any advice if possible :-)

–-- edit ----
Added "loopback" interface as listening interface for unbound. Missed this.

ping_OK.png_thumb

chrome_DNS.png_thumb

JasonJoel

Anyone else experience that pfBlockerNG doesn't work on 2.3 if using floating rules? After the last update, I noticed all my rule counts were ZERO hits on the pfBlocker widget. So I tried going to a website on a blocked country, and it did not block.

Then tried:
1. Disabled the floating rules option (saved), forced an update, and then tried the website again and it was blocked.
2. Then re-enabled floating rules (saved), forced an update, tried the website again and it was NOT blocked.
3. Disabled the floating rules option (saved), forced an update, and then tried the website again and it was blocked.

So, seems on my system at least the floating rules simply do not work. I can't tell if this is a 2.3 issue or a pfBlocker issue though.

Jason Bottjen

cmaxwell04

Help please,

I'm having a strage problem in pfsense 2.3. Whenever I enable pfBlockerNG DNSBL it stops DNS Resolver, and I have to start it manually. when I rebot pfsense 2.3 I have to manualy start DNS Resolver. if I desable DNSBL, DNS Resolver will always run automaticaly.

thanks

BBcan177

@Nachtfalke:

function FindProxyForURL(url, host) {

// Normalize the URL for pattern macthing
url = url.toLowerCase();
host = host.toLowerCase();

// diese Ziel-IPs, Domains oder Hosts gehen DIRECT
if (shExpMatch(host, "192.168..") ||
shExpMatch(host, ".microsoft.com") ||
shExpMatch(host, ".windowsupdates.com") ||
shExpMatch(host, "127.0.0.1") ||
shExpMatch(host, "ap.bundesbank.de") ||
shExpMatch(host, "10...*") ||
shExpMatch(host, "10.123.123.123") ||
shExpMatch(host, "localhost"))
{
return "DIRECT";
}

if (isInNet( host, "10.123.123.0", "255.255.255.0" ))
{ return "DIRECT"; }

// diese URLs gehen DIRECT ohne Proxy.
// if (shExpMatch(url, "https://www.vrbank-mkb.de/") ||
// shExpMatch(url, "https://www.cortalconsors.de/") ||
// shExpMatch(url, "https://www.consorsbank.de/*"))
// {
// return "DIRECT";
// }

// Fuer alle anderen Requests den Proxy zurueckgeben
return "PROXY 192.168.10.1:3128";
}

My DNSBL VIP is on 10.123.123.123

Hi Nachtfalke,

I don't use Squid, but a quick google search, do you think that "host" should be changed to "url" instead in this line below?

shExpMatch(host, "10.123.123.123") ||

BBcan177

@JasonJoel:

Anyone else experience that pfBlockerNG doesn't work on 2.3 if using floating rules?

Hi Jason,

Do you have any Floating rules above the pfBNG floating rules? Maybe send a screenshot? also edit one of those rules and send a screenshot…

BBcan177

@cmaxwell04:

Help please,

I'm having a strage problem in pfsense 2.3. Whenever I enable pfBlockerNG DNSBL it stops DNS Resolver, and I have to start it manually. when I rebot pfsense 2.3 I have to manualy start DNS Resolver. if I desable DNSBL, DNS Resolver will always run automaticaly.

thanks

Hi cmaxwell04,

Can you review the pfblockerng.log and see if there are any error messages in regards to DNSBL. Try to Re-Enable DNSBL, and try to send any relevant error messages… Do you see any errors in the resolver.log or system.log?

Nachtfalke

@BBcan177:

@Nachtfalke:

function FindProxyForURL(url, host) {

// Normalize the URL for pattern macthing
url = url.toLowerCase();
host = host.toLowerCase();

// diese Ziel-IPs, Domains oder Hosts gehen DIRECT
if (shExpMatch(host, "192.168..") ||
shExpMatch(host, ".microsoft.com") ||
shExpMatch(host, ".windowsupdates.com") ||
shExpMatch(host, "127.0.0.1") ||
shExpMatch(host, "ap.bundesbank.de") ||
shExpMatch(host, "10...*") ||
shExpMatch(host, "10.123.123.123") ||
shExpMatch(host, "localhost"))
{
return "DIRECT";
}

if (isInNet( host, "10.123.123.0", "255.255.255.0" ))
{ return "DIRECT"; }

// diese URLs gehen DIRECT ohne Proxy.
// if (shExpMatch(url, "https://www.vrbank-mkb.de/") ||
// shExpMatch(url, "https://www.cortalconsors.de/") ||
// shExpMatch(url, "https://www.consorsbank.de/*"))
// {
// return "DIRECT";
// }

// Fuer alle anderen Requests den Proxy zurueckgeben
return "PROXY 192.168.10.1:3128";
}

My DNSBL VIP is on 10.123.123.123

Hi Nachtfalke,

I don't use Squid, but a quick google search, do you think that "host" should be changed to "url" instead in this line below?

shExpMatch(host, "10.123.123.123") ||

Nothing changed. I deleted these file because I added the part Merchant posted in this thread:


function FindProxyForURL(url, host) {

    // Normalize the URL for pattern macthing
    url = url.toLowerCase();
    host = host.toLowerCase();

    // diese Ziel-IPs, Domains oder Hosts gehen DIRECT
    if (shExpMatch(host, "192.168.*.*") ||
        shExpMatch(host, "*.microsoft.com") ||
        shExpMatch(host, "*.windowsupdates.com") ||
        shExpMatch(host, "ap.bundesbank.de") ||
        shExpMatch(host, "localhost"))
    {
    return "DIRECT";
    }

    if (isInNet( host, "10.123.123.0", "255.255.255.0" ))
        { return "DIRECT"; }

    // diese URLs gehen DIRECT ohne Proxy.
    // if (shExpMatch(url, "https://www.vrbank-mkb.de/*") ||
    //     shExpMatch(url, "https://www.cortalconsors.de/*") ||
    //     shExpMatch(url, "https://www.consorsbank.de/*"))
    // {
    // return "DIRECT";
    // }

// Fuer alle anderen Requests den Proxy zurueckgeben
return "PROXY 192.168.10.1:3128";
}

BBcan177

@Nachtfalke:

shExpMatch(host, "10.123.123.123") ||

Nothing changed. I deleted these file because I added the part Merchant posted in this thread:

I think you need to change that line from "host" to "url"… I believe that your desktop is the host, and the url is where you want to goto... So the DNSBL VIP is not the host, but the url... As i said, I don't use squid, so just an assumption...

shExpMatch(url, "10.123.123.123") ||

JasonJoel

@BBcan177:

@JasonJoel:

Anyone else experience that pfBlockerNG doesn't work on 2.3 if using floating rules?

Hi Jason,

Do you have any Floating rules above the pfBNG floating rules? Maybe send a screenshot? also edit one of those rules and send a screenshot…

The only other floating rule is the DNSBL rule, and it works I think.

I block the country China in pfBlocker. With it set to not use floating rules www.edu.cn is blocked as expected. It gets blocked, and the pfB_Top_v4 hit count increases.

If I go back and enable floating rules, the rules get made (as shown in the attached pictures), and the aliases do have IPs in them. But if I again go to www.edu.cn, it does not get blocked… I really don't get it, as the floating rule looks the same to me as the rule that gets created in the interface when not using floating rules in pfBlocker...

Pic 1 shows my floating rules when pfBlocker is set to not use floating rules.
Pic 2 shows that pfB_Top-v4 hit count increases when going to www.edu.cn, as expected
Pic 3 shows floating rules when floating rules in pfBlocker is enabled
Pic 4 shows that after trying to go to www.edu.cn again, nothing is blocked
Pic 5 shows that if I manually make the exact same rule, it DOES work... ????????

Jason

![1-Floating Rules.png](/public/imported_attachments/1/1-Floating Rules.png)
![1-Floating Rules.png_thumb](/public/imported_attachments/1/1-Floating Rules.png_thumb)
![2-Widget showing pfB_Top_v4 hits.PNG](/public/imported_attachments/1/2-Widget showing pfB_Top_v4 hits.PNG)
![2-Widget showing pfB_Top_v4 hits.PNG_thumb](/public/imported_attachments/1/2-Widget showing pfB_Top_v4 hits.PNG_thumb)
![3-Floating Rules Enabled on pfBlockerNG.PNG](/public/imported_attachments/1/3-Floating Rules Enabled on pfBlockerNG.PNG)
![3-Floating Rules Enabled on pfBlockerNG.PNG_thumb](/public/imported_attachments/1/3-Floating Rules Enabled on pfBlockerNG.PNG_thumb)
![4-Widget showing nothing is getting blocked.PNG](/public/imported_attachments/1/4-Widget showing nothing is getting blocked.PNG)
![4-Widget showing nothing is getting blocked.PNG_thumb](/public/imported_attachments/1/4-Widget showing nothing is getting blocked.PNG_thumb)
![5-Manually created floating rule works.PNG_thumb](/public/imported_attachments/1/5-Manually created floating rule works.PNG_thumb)
![5-Manually created floating rule works.PNG](/public/imported_attachments/1/5-Manually created floating rule works.PNG)

BBcan177

Hi Jason,

When you edit those Floating rules, do your interfaces get added correctly? Looks fine at first glance… I tested it on my machine, and all seems to be working with/without floating rules...

JasonJoel

@BBcan177:

Hi Jason,

When you edit those Floating rules, do your interfaces get added correctly? Looks fine at first glance… I tested it on my machine, and all seems to be working with/without floating rules...

Yes they do.

HOWEVER, I discovered the issue!! The rule direction is marked as "OUT" - which is never going to match on traffic initiated internally going to the internet. Shouldn't that be "ANY"? I checked and all of my pfBlocker created floating rules are direction "OUT" for some reason…

Screen attached.

Jason

![6-Floating rule detail.PNG](/public/imported_attachments/1/6-Floating rule detail.PNG)
![6-Floating rule detail.PNG_thumb](/public/imported_attachments/1/6-Floating rule detail.PNG_thumb)

BBcan177

@JasonJoel:

The rule direction is marked as "OUT". Shouldn't that be "ANY"? I checked and all of my pfBlocker created floating rules are direction "OUT" for some reason…

Did you define the "Adv. In/Outbound settings" in each pfBNG Alias settings? Specifically the "Gateway" setting?

It should normally be left at "default"; at which time, the Floating Rules "Direction" setting is set to "any".

You can run this command to find out what the pfBNG aliases gateway settings are defined as:

grep "<agateway" conf="" config.xml<="" pre=""></agateway">