PfBlockerNG
-
I'm getting this error in the update log
===[ DNSBL Process ]================================================ Missing DNSBL stats and/or Unbound DNSBL conf file - Rebuilding
Its not an error… Its just a notice to say that its rebuilding the database. Possibly due to a "Force Reload" or re-enabling pfBlockerNG... or adding/removing a DNSBL Alias/Feeds...
-
@BBcan177, this is going to take some explaining. :) This feature affects other services, but let's just use AWS as an example.
AWS controls (among many, many others) the entire
54.240.128.0/18
range, which means that all/24
ranges from54.240.128.0/24
-54.240.191.0/24
are included. Since AWS allows others to use their servers, it's highly likely that many of those/24
ranges are going to be flagged.Let's say that
128
,129
,140
,141
,142
,143
,144
get flagged in a particular/24
. As far as AWS is concerned, there's no correlation which implies that130
,139
or145
are the same individual or group. This is especially true for CloudFront where the IP assignments mean nothing.So the entire
/24
net gets blacklisted when, in actuality, for these particular subnets, the relationships between IPs on the same/24
subnet is almost zero.What I'd like would be for a way to say: "Hey, go ahead and parse out something like this: https://ip-ranges.amazonaws.com/ip-ranges.json and, if the IPs are within those ranges, still blacklist them, but don't add them to the list for reputation processing."
Thoughts?
-
What I'd like would be for a way to say: "Hey, go ahead and parse out something like this: https://ip-ranges.amazonaws.com/ip-ranges.json and, if the IPs are within those ranges, still blacklist them, but don't add them to the list for reputation processing."
Hi abujammy, Its best to use the Country code exclusion for Reputation and add "USA" to the list of exclusions.
-
Wow! BBcan177. Wow.
I've been gone for such a long time, I come back and pfBlockerNG is a hit! This is so cool. I'm so glad that you stepped up and helped move this idea. Thanks to Marcello Coutinho for helping me get pfBlocker (back when it was IP blocklist and country Block) off the ground from it's first inception back when it was release 0.1.
This is absolutely awesome. And you gave throwback credit to me and Marcello Coutinho.
Well done! This is why I love the pfsense community. We all work together to make our worlds better.
-
Wow! BBcan177. Wow.
I've been gone for such a long time, I come back and pfBlockerNG is a hit! This is so cool. I'm so glad that you stepped up and helped move this idea. Thanks to Marcello Coutinho for helping me get pfBlocker (back when it was IP blocklist and country Block) off the ground from it's first inception back when it was release 0.1.
This is absolutely awesome. And you gave throwback credit to me and Marcello Coutinho.
Well done! This is why I love the pfsense community. We all work together to make our worlds better.
Thanks… Most don't realize all the effort that goes into developing and maintaining a package with an ever changing landscape... ;) welcome back...
-
Hello,
what did you prefere as blocked iplist?
did you have some web service that you know where i can buy access to some blocklist that i can insert by URL and forget it?
did you know also some of this service for Whitelist (like googlebot and similar)
tnx for your help.Peppe
-
Is it possible to block a list of dynamic IP's but only specific ports?
We get a lot of spam H.323 calls originating from AWS (185+ EC2 IP ranges) and DigitalOcean (10+ IP ranges) and others. We'd like to automate the blacklisting but only on port's 1503 and 1720.
Expert Mode Question: Most of the originator calls are named "unknown" or "cisco" and it would be great to parse those out and block those, though I'm betting that's beyond the scope of pfBlockerNG.
-
Hello,
what did you prefere as blocked iplist?
did you have some web service that you know where i can buy access to some blocklist that i can insert by URL and forget it?
did you know also some of this service for Whitelist (like googlebot and similar)
tnx for your help.Peppe
Here is link to a script to import ~50 blocklists…
https://forum.pfsense.org/index.php?topic=86212.msg549973#msg549973I think there are some Whitelists available... But I don't have those URLs myself... Google search and/or hopefully other users can share some URLs for whitelisting...
-
Is it possible to block a list of dynamic IP's but only specific ports?
We get a lot of spam H.323 calls originating from AWS (185+ EC2 IP ranges) and DigitalOcean (10+ IP ranges) and others. We'd like to automate the blacklisting but only on port's 1503 and 1720.
Expert Mode Question: Most of the originator calls are named "unknown" or "cisco" and it would be great to parse those out and block those, though I'm betting that's beyond the scope of pfBlockerNG.
You can use the "Adv. Inbound Firewall" rule settings to protect only certain ports/Dest IPs etc… I will be adding "Adv. Outbound Firewall" rule settings in the next release. You can also use "Alias" type rules, and manually create the firewall rules to suit more complex setups...
-
pfBlockcerNG IPv4-lists: Changes from script: as of 2016-01-18
Re: https://forum.pfsense.org/index.php?topic=86212.msg510369;topicseen#msg510369
After perusing the log from the CRON run for pfBlockerNG_import.php script as listed here, it appears that there are a couple changes that might reduce errors that I have documented below.
Might want to delete the "no access," "discontinued" and "not found" or change status to "off."
Cheers,
Todd
*Startlist
- Abuse_Spyeye
from: https://spyeyetracker.abuse.ch/blocklist.php?download=ipblocklist
to: discontinued
as per: https://spyeyetracker.abuse.ch/ :
SpyEye Tracker has been disconntinued. More information will follow soon on https://www.abuse.ch
Thanks for all your support!
- Snort_BL
from: https://labs.snort.org/feeds/ip-filter.blf
to: http://talosintel.com/feeds/ip-filter.blf
as per: http://blog.snort.org/2015/09/ip-blacklist-feed-has-moved-locations.html :
Wednesday, September 2, 2015
IP Blacklist feed has moved locations!
For those of you using the IP Blacklist feed on labs.snort.org, we've had to move the URL to the new link.
You can find it at the following URL: http://talosintel.com/feeds/ip-filter.blf
- Infiltrated
from: http://www.infiltrated.net/blacklisted
to: no access
as per: http://www.infiltrated.net/blacklisted
Forbidden
You don't have permission to access /blacklisted on this server.
- Geospy
from: http://www.geopsy.org/blacklist.html
to: not found
as per: http://www.geopsy.org/blacklist.html
Not Found
The requested URL /blacklist.html was not found on this server.
*Endlist
- Abuse_Spyeye
-
Is it possible to import "Easylist Germany" to "DNSBL Easylist" from AdBlock Plus into pfBlockerNG?
Easylist Germany: https://easylist.adblockplus.org/de/
-
@BBCan17
I am having trouble viewing the pfblockerNG alerts.On the main index page, I can see (for example) X packets for "pfB_NAmericav4" (I created an inbound rule/alias to block everything inbound on WAN that's not from United States).
I can see that it blocked 475 packets.
Clicking on it bring me to the alerts page, which says "Found 29 Alert Entries - Insufficient Firewall Alerts found."
Why does it only find 29 of the 475 blocked packets?
I've disabled remote logging for the moment to hopefully eliminate a variable. I've also
-disenable/re-enable pfbng
-force update
-force cron
-force reload
-clear logs (from firewall settings tab)pics below
-
I am having trouble viewing the pfblockerNG alerts.
Why does it only find 29 of the 475 blocked packets?Hi oddworld19,
The Alerts Tab takes its info from the pfSense Firewall Log. So if the Firewall log doesn't contain those Alerts, it won't show in the pfBNG Alerts Tab.
You should disable the "Log Firewall Default Block" option. They are filling your log with unneeded data. You could keep the last two "Bogons" and "Private" as those shouldn't fill your logs as much.
Then clear your firewall logs. Followed by Disable and Re-Enable of pfBlockerNG to clear the widget packet Counts and see how it goes from there.
There is a also known issue that I reported to the Devs, but haven't had a response. But that is only specific if you define Ports in the firewall rules. From your post, it doesn't look like you have this issue.
https://forum.pfsense.org/index.php?topic=99929
update:
The Widget has a customization setting to define the "Max packets for Alerts Tab pivot"… Make sure this is set to meet with your requirements.
-
The "IPv4 Custom list" seem to be inactive in pfBlockerNG. It worked fine before. I have several IPs I want to block manually in that list but it is not working. Force update and force reload has no effect. The custom list does not appear on the dashboard either. Anyone familiar with this?
-
@Ip:
The "IPv4 Custom list" seem to be inactive in pfBlockerNG. It worked fine before. I have several IPs I want to block manually in that list but it is not working. Force update and force reload has no effect. The custom list does not appear on the dashboard either. Anyone familiar with this?
Can you post a screenshot of the Alias? Did you select the "List Action" and define the "Alias" name?
-
@Ip:
The "IPv4 Custom list" seem to be inactive in pfBlockerNG. It worked fine before. I have several IPs I want to block manually in that list but it is not working. Force update and force reload has no effect. The custom list does not appear on the dashboard either. Anyone familiar with this?
Can you post a screenshot of the Alias? Did you select the "List Action" and define the "Alias" name?
Well, the alias name is kind of personal ;). Contains one space but no "pfBlocker" or "pfB_". List action is "Deny Both".
-
@Ip:
@Ip:
The "IPv4 Custom list" seem to be inactive in pfBlockerNG. It worked fine before. I have several IPs I want to block manually in that list but it is not working. Force update and force reload has no effect. The custom list does not appear on the dashboard either. Anyone familiar with this?
Can you post a screenshot of the Alias? Did you select the "List Action" and define the "Alias" name?
Well, the alias name is kind of personal ;). Contains one space but no "pfBlocker" or "pfB_". List action is "Deny Both".
Its probably not going to create the alias if its just a "single space" as the Alias name… Give it a proper name and it should be fine. It can't contain and special or International characters.
-
@Ip:
@Ip:
The "IPv4 Custom list" seem to be inactive in pfBlockerNG. It worked fine before. I have several IPs I want to block manually in that list but it is not working. Force update and force reload has no effect. The custom list does not appear on the dashboard either. Anyone familiar with this?
Can you post a screenshot of the Alias? Did you select the "List Action" and define the "Alias" name?
Well, the alias name is kind of personal ;). Contains one space but no "pfBlocker" or "pfB_". List action is "Deny Both".
Its probably not going to create the alias if its just a "single space" as the Alias name… Give it a proper name and it should be fine. It can't contain and special or International characters.
I renamed it abc123 and now it appears as pfB_abc123 on my dashboard. Thanks!
-
Is spam404, one of the DNSBL feeds, gone?
-
Is spam404, one of the DNSBL feeds, gone?
Would have been best to post this in pfBNG v2.0 thread:
Looks like they moved the Spam404 feed to Github:
https://raw.githubusercontent.com/Dawsey21/Lists/master/main-blacklist.txt -
-
Hello ,
is there a possibility to add the negate rule on ports also ? I don't want to block some ports , aka in the top 20 country list . I modified the xml and the inc file but it seems to ignore the option. Is there an other file that I must change that makes the option work ? Thx.
-
Hello ,
is there a possibility to add the negate rule on ports also ? I don't want to block some ports , aka in the top 20 country list . I modified the xml and the inc file but it seems to ignore the option. Is there an other file that I must change that makes the option work ? Thx.
Sure I can add that to the next release… I will also be adding "Adv. Outbound" settings with other additional options...
Here is a screenshot of what to expect:
http://i.imgur.com/XWqznm2.png -
Hello ,
is there a possibility to add the negate rule on ports also ? I don't want to block some ports , aka in the top 20 country list . I modified the xml and the inc file but it seems to ignore the option. Is there an other file that I must change that makes the option work ? Thx.
Sure I can add that to the next release… I will also be adding "Adv. Outbound" settings with other additional options...
Here is a screenshot of what to expect:
http://i.imgur.com/XWqznm2.pngHi CIURI,
I don't think there is an option to use "!" negate a Ports Alias in pfSense… You can edit an existing pfBNG Rule and see if you see it any different?
-
Hi all,
I find my dropbox syncing is blocked.
In logs I see
IBlock_BT_Hijack list contains 162.125.0.0/24 which is used dropbox.
How should I proceed to get dropbox working again.
Thanks.
-
Hi all,
I find my dropbox syncing is blocked.
In logs I see
IBlock_BT_Hijack list contains 162.125.0.0/24 which is used dropbox.
How should I proceed to get dropbox working again.
Thanks.
You need to create a Permit Outbound pass rule for the IP of you seedbox
or get an IP outside that range from your provider. -
Hi all,
I find my dropbox syncing is blocked.
In logs I see
IBlock_BT_Hijack list contains 162.125.0.0/24 which is used dropbox.
How should I proceed to get dropbox working again.
Thanks.
You need to create a Permit Outbound pass rule for the IP of you seedbox
or get an IP outside that range from your provider.Just to be clear when I say dropbox I mean as in Dropbox the company
Their client desktop app is trying to connect out to 162.125.17.0/24 and 162.125.32.0/24I've enabled suppression and manually added both above networks to pfBlockerNGSuppress Alias. And then "reloaded"
What I do not understand is your reference to a seedbox. I am not sure if I have one of those or not … and yes I feel silly saying this.
How/Where do I create this Permit outbound pass rule. And how does pfBlockerNGSuppress tie in?I went ahead and creating a pass outbound in floating rules and moved it to the very top of the list. I am not sure if this is what you meant or if it is correct.
-
Seedbox … Dropbox, whatever rock you boat :P
Did you read the section in the picture.
It tell you NOT to use pfBlockerNGSuppress Alias in FW rules :o
It tell you that suppression ONLY work for /32 or /24 networks.
IBlock_BT_Hijack specify 162.125.0.0/16, so the "+" icon is not available in the Alerts Tab,
Putting 162.125.17.0/24 and 162.125.32.0/24 in pfBlockerNGSuppress is useless.So move the 2 networks to a new alias pfBlockerWhiteList
Create a FW rule on LAN pass pfBlockerWhiteList
or on the floating tab selecting all LANs interfaces
-
Seedbox … Dropbox, whatever rock you boat :P
Did you read the section in the picture.
It tell you NOT to use pfBlockerNGSuppress Alias in FW rules :o
It tell you that suppression ONLY work for /32 or /24 networks.
IBlock_BT_Hijack specify 162.125.0.0/16, so the "+" icon is not available in the Alerts Tab,
Putting 162.125.17.0/24 and 162.125.32.0/24 in pfBlockerNGSuppress is useless.So move the 2 networks to a new alias pfBlockerWhiteList
Create a FW rule on LAN pass pfBlockerWhiteList
or on the floating tab selecting all LANs interfacesAha! Ok I have done this now. But I am still blocked.
So an extra question.
You said set it up as pass outbound meaning the LAN sending to internet.From pfSense Point of view this is inbound right (packets flying off the network into pfsense)? So I have to re-set to direction=in? I initially had it to direction=out and was still being blocked.
I will monitor and see, but you can correct me if i am worng.
Update
–-------
It seems the above in the case. If I set direction=out, I can't ping dropbox network IPs. When set to direction=in, I can.
Have to wait and see now if it stays connected.Update 2
Ok I think that sloved it thanks very much Ron. I now know how to suppress an IP blocked by pfBNG.
-
Whoa there pfsenseboonie, before you run off I am still confused. :o
Not sure if you are blocking inbound direction with PFBlockerng but that would then make sense. ??? but wrong.
If you are NOT running any open ports to services like a Web Server behind the firewall then you DO NOT need to block Inbound. The firewall is already by Default doing that. That would also probably explain the ping sent to Dropseed errr box whatever not getting back in to you. Really only need to block Outbound and save the firewall much needed processor resources for other tasks.
RonpfS was correct in telling you to allow outbound.
If you set only Outbound blocking and let the firewall default handle the inbound blocking it then makes sense to allow out to Dropbox so your machine will initiate the handshake with dropbox and the firewall will allow the return response back in.
Outbound is LAN to WEB…....Inbound is WEB to LAN ;) Keep it simple. -
@webtyro:
Not sure if you are blocking inbound direction with PFBlockerng but that would then make sense. ??? but wrong.
If you are NOT running any open ports to services like a Web Server behind the firewall then you DO NOT need to block Inbound. The firewall is already by Default doing that. That would also probably explain the ping sent to Dropseed errr box whatever not getting back in to you. Really only need to block Outbound and save the firewall much needed processor resources for other tasks.Hey there,
Yes thats correct I have open ports on the wan interface, so only blocking with pfBNG on those specific ports. -
Good. Was not sure. ::) Late night, sleeping at the keyboard again.
-
Is it possible to add the country based easylist feeds like german easylist etc.?
-
Is it possible to add the country based easylist feeds like german easylist etc.?
Yes its something that I'd like to add when I find some time… :)
The issue with EasyLists, is that only certain categories in the list can be used... If you can download that German Feed, and see which categories can be blocked that would be a good help... (Same applies for other Languages...)
For EasyList, its only collecting 1.AdServers 2. AdServers Popup 3. Adult AdServers 4. Adult AdServer Popup categories...
-
I'm running the last 2.3 and getting a lot those errors:
FreeBSD 10.3-RELEASE #5 05adf0a(RELENG_2_3_0): Mon Apr 11 18:56:05 CDT 2016 root@ce23-i386-builder:/builder/pfsense-230/tmp/obj/builder/pfsense-230/tmp/FreeBSD-src/sys/pfSense Crash report details: PHP Errors: [13-Apr-2016 14:00:00 America/Santiago] PHP Stack trace: [13-Apr-2016 14:00:00 America/Santiago] PHP 1\. {main}() /usr/local/www/pfblockerng/pfblockerng.php:0 [13-Apr-2016 14:00:00 America/Santiago] PHP 2\. pfblockerng_sync_cron() /usr/local/www/pfblockerng/pfblockerng.php:94 [13-Apr-2016 14:00:00 America/Santiago] PHP 3\. sync_package_pfblockerng() /usr/local/www/pfblockerng/pfblockerng.php:387
-
I'm running the last 2.3 and getting a lot those errors:
Hi, Those errors don't point to the issue unfortunately… Could you take a look at the file /tmp/PHP_errors.log and see if it shows any other clues?
It looks like the pfBlockerNG Cron task is being called, but there is no specific error indicated? Also take a look at the pfblockerng.log file around the timestamps of these errors, and see if they report any additional clues…
-
Yes the recent changes in pfense 2.3 from Lighttpd to NGINX broke the DNSBL feature… I will be submitting a PR to fix this up soon....
Any news on this front I upgraded to 2.3 and I think this blew up. It came up without DNS working and I removed the DNSBL stuff to get a working config. Reading the forum now for status.
Cheers!
-
Yes the recent changes in pfense 2.3 from Lighttpd to NGINX broke the DNSBL feature… I will be submitting a PR to fix this up soon....
Any news on this front I upgraded to 2.3 and I think this blew up. It came up without DNS working and I removed the DNSBL stuff to get a working config. Reading the forum now for status.
Cheers!
Hey Dan, if I recall, you are using a Nano or Ramdisk correct?
If that is the case, when you did your update, Unbound had the Adv. Options with the "server:include: /var/unbound/pfb_dnsbl.conf" line but since the /var folder is wiped out, Unbound crashes due to this missing file.
You can run a "Force Update" in pfBNG to get it working again.
For others with this issue (Nano/RamDisk). Best to disable the pfBNG package before an Update or a configuration Restore (IE: Make sure the backup configuration has pfBNG disabled)
-
I'm running the last 2.3 and getting a lot those errors:
Hi, Those errors don't point to the issue unfortunately… Could you take a look at the file /tmp/PHP_errors.log and see if it shows any other clues?
It looks like the pfBlockerNG Cron task is being called, but there is no specific error indicated? Also take a look at the pfblockerng.log file around the timestamps of these errors, and see if they report any additional clues…
-rw-r--r-- 1 root wheel 0 Apr 14 12:26 PHP_errors.log
===[ DNSBL Process ]================================================ Warning: Invalid argument supplied for foreach() in /usr/local/pkg/pfblockerng/pfblockerng.inc on line 3057 Call Stack: 0.0019 211244 1\. {main}() /usr/local/www/pfblockerng/pfblockerng.php:0 0.0902 6447240 2\. pfblockerng_sync_cron() /usr/local/www/pfblockerng/pfblockerng.php:94 0.0904 6450620 3\. sync_package_pfblockerng() /usr/local/www/pfblockerng/pfblockerng.php:387 Clearing all DNSBL Feeds... completed Validating database... completed Restarting Unbound ... completed DNSBL update [ 0 ]... completed ------------------------------------------
-
Part of coding apoint the error:
// Save alias statistics to file (Remove any feeds that are not referenced) $handle = @fopen("{$pfb['dnsbl_info']}", 'w'); fwrite($handle, "# Keeping this file open in a file editor will interrupt DNSBL!\n");
foreach ($dnsbl_info as $alias) {
if (in_array($alias[0], $alias_dnsbl_all)) { fputcsv($handle, $alias); } } @fclose($handle);