PfBlockerNG v2.0 w/DNSBL

hda · Jan 19, 2016, 7:54 PM

Services-DNS Resolver Advanced: delete config entry (that file has been lost). Save. Start Resolver.
pfBlockerNG-Update: Force Update.

cwilkinson · Jan 19, 2016, 10:41 PM

I already know how to fix it like that but that requires manual intervention, after a reboot that's not very useful.

cipherson · Jan 23, 2016, 12:36 AM

Hey Guys,

The latest version of pfsense/pfBlockerNG seems to have issues with the "ET IQRisk" list

I just updated my pfsense to the latest 2.2.6-RELEASE built on Mon Dec 21.

I noticed in the pfBlockerNG that my Alias for IQRisk only have an IP count of 1.

I review all the settings and they seemed to be messed up. Following the steps on the Repuation tab it says:
"Select the ET IQRisk' format. The URL should use the .gz File Type. Enter your "ETPRO" code in URL. Further information can be found @ ET IQRisk IP Reputation"
This format type is not longer listed and the help URL is no longer valid.

Any thoughts on how to fix this? Did they remove support for this list?

Also posted via reddit on /r/PFSENSE

https://www.reddit.com/r/PFSENSE/comments/428ehb/latest_pfblockerng_et_iqrisk_format_missing/

cipherson · Jan 23, 2016, 1:06 AM

**Update

After some messing around an point this to the file after stripping out the IPs it still has issues.

[ mine ] Downloading update .. 200 OK. completed .. Empty file, Adding '1.1.1.1' to avoid download failure.

maybe the file is has to much data and the download is timing out? leaving the file empty and failing to add any IPs.

BBcan177 · Jan 23, 2016, 1:23 AM

Hi cipherson,

Emerging Threats was bought out by Proofpoint last year. I had a developer subscription to this list, but since it was bought out by Proofpoint, they didn't renew it, so if they made any changes, I am unable to help support any changes.

The previous URL used to be as follows (Changing the X's to your Proofpoint subscription id):
https://rules.emergingthreatspro.com/XXXXXXXXXXXXXXXX/reputation/iprepdata.txt.gz

If you enter that URL in the browser, does the file download? I would assume that the URL would have changed also.

If the URL is ok, post some screenshots of the Reputation tab (ET IQRISK) and obfuscate your Subscription ID…

cipherson · Jan 23, 2016, 1:31 AM

Hey BBcan177

I can download the file fine by hand and the URL structure is the same.

The file format still also looks the same:

ip, category, score

I also downloaded the file, pulled out only the IP addresses and re-served the file on a local webserver just as an IP list and it has the same download issues.

During the update it hangs on the download of this large file (6.9 MB) for about 90 seconds with the following:

[ ETIQRisk ] Downloading update .. 200 OK.

Then says the file is empty:

Empty file, Adding '1.1.1.1' to avoid download failure.

So its not event getting to download the file correctly.

Anyway to debug the pull script? maybe add more verbose logging?

BBcan177 · Jan 23, 2016, 1:44 AM

When you see "200 ok", that means that the file was downloaded successfully… So the issue is in the parsing of the file...

How many Lists did you select in the Reputation Tab - IQRisk Select Menu?

If you are using Country Blocking and other lists, it could also be that the IPs are duplicates which could report "1.1.1.1" which is an empty file placeholder... Maybe try to move the IQRisk as the first pfBNG Alias and execute a "Force Reload"...

cipherson · Jan 23, 2016, 2:08 AM

Currently 20 in the list.

I lower it to 1 option and added the IQRISK to the top, disabled all CC and other IPv4 lists

Going to try a reinstall on this plugin to see if it helps

Output from Cron:

===[ Continent Process ]============================================

===[ IPv4 Process ]=================================================

[ ETIQRisk ] Downloading update .. 200 OK.. completed ..
Empty file, Adding '1.1.1.1' to avoid download failure.

===[ Aliastables / Rules ]==========================================

No changes to Firewall rules, skipping Filter Reload

Updating: pfB_ETIQRisk
no changes.

===[ FINAL Processing ]=====================================

cat: /var/db/pfblockerng/original/Block: No such file or directory
cat: All_custom.orig: No such file or directory
[ Original IP count ] [ 32 ]

===[ Deny List IP Counts ]===========================

1 total
1 /var/db/pfblockerng/deny/ETIQRisk.txt

====================[ Empty Lists w/1.1.1.1 ]==================

ETIQRisk

====================[ Last Updated List Summary ]==============

Jan 22 21:06 ETIQRisk

IPv4 alias tables IP count
–---------------------------
1

IPv6 alias tables IP count

0

Alias table IP Counts

1 /var/db/aliastables/pfB_ETIQRisk.txt

pfSense Table Stats

table-entries hard limit 2000000
Table Usage Count 3725

UPDATE PROCESS ENDED [ 01/22/16 21:07:30 ]

BBcan177 · Jan 23, 2016, 2:14 AM

It's hard to troubleshoot without being able to test the file. I sent you a PM, if you are interested to do a TeamViewer session, I can see it live and be able to sort it out for you.

cipherson · Jan 23, 2016, 5:17 PM

BBcan177 has fixed this issue!

jarrad · Jan 26, 2016, 1:24 PM

Hi all

I seem to have a misconfiguration with the DNSBL. Specifically when Google tries to throw ads at me from their subsidiary Doubleclick I keep getting invalid certificate errors. Inspecting the certificate shows it looks like a generic certificate with all the default values you would expect from someone just hitting "OK" or something.

I've had a search around and I can't seem to find what's causing it.

Any suggestions?

heliop100 · Jan 26, 2016, 8:41 PM

Hi

Today I have one MX host blocked. E-mail on queue, not ping, not telnet.
The host was smtp.one2one.com.br (192.99.8.87)
I look for it on pfBlockerNG (v2.04) alerts, on system logs/firewall, and on states.
not found.
but when I disable pfBlockerNG I was able to send the messages. (ping, telnet)

Now I enable pfBloquerNG again, and that IP are blocked again.

How can I supress that IP?
Thanks.

RonpfS · Jan 26, 2016, 11:42 PM

Did you enable DNSBL ? Maybe it is the domain that is blocked. You should be able to see it in the pfBlockerNG: Alerts.

If it is the IP that is blocked, you should normally see it in pfBlockerNG: Alerts as well as in the Status: System logs: Firewall

Do you have Suppression enabled in the pfBlockerNG: General Settings? Read the instructions there and update the pfBlockerNGSuppress Alias to include that ip.

heliop100 · Jan 27, 2016, 1:03 PM

@RonpfS:

Did you enable DNSBL ? Maybe it is the domain that is blocked. You should be able to see it in the pfBlockerNG: Alerts.

Hi, no, no DNSBL.

@RonpfS:

If it is the IP that is blocked, you should normally see it in pfBlockerNG: Alerts as well as in the Status: System logs: Firewall

I know that, but the blocked IP are none on ALERTS or System Logs/Firewall

RonpfS · Jan 27, 2016, 5:08 PM

@heliop100:

I know that, but the blocked IP are none on ALERTS or System Logs/Firewall

Did you enable logging in the pfBlockerNG: IPv4 Alias/List Configuration: Edit form for each Alias?

heliop100 · Jan 27, 2016, 6:21 PM

Found the problem
I have one pfB_Mail ipv4 list that block 192.99.0.0/16 and one allow list with the 192.99.8.87 IP
With version 1 it was working, but after v 2.04 update the IP was blocked.
I change the rules order and now are working.
Thanks.

heliop100 · Jan 28, 2016, 9:39 PM

Hi,

Is it possible to use DNSBL and block sites for a IP range (for exemple 192.168.0.100-192.168.0.120)?

Thanks.

BBcan177 · Jan 30, 2016, 7:28 PM

@heliop100:

Hi,

Is it possible to use DNSBL and block sites for a IP range (for exemple 192.168.0.100-192.168.0.120)?

Thanks.

To bypass DNSBL, set those particular LAN devices to use a different DNS Server, or goto the Alerts Tab and suppress the domains that you want to allow.

dgarsys · Feb 2, 2016, 11:53 PM

OK - I'm feeling like an idiot.

I've gone through the thread on this, read posted instructions, un and re-installed pfblocker, made sure pfsense was current, made sure squid and squidguard were current, and even completely wiped to factory and reinstalled and reconfigure the pfsense, and while I can get pfblocker to isntall and configure and download lists without errors, and the auto-generated firewall rules SEEM to be updated with IP addresses, the service persists in showing itself as "down" instead of running.

Am I missing something? I'm not using the DNS features - just the IP block ones and country based block lists.

capedcrsdr · Feb 3, 2016, 12:27 AM

Greetings,

I am new to PFblockerNg, but started running based on a recommendation from a friend. I am using a Supermicro D525 server with PFsense 2.2.6 64-bit.

Issues:
1. The first time I installed and configured PFBlocker, the following issues showed up:
- No entries were added under either the Firewall or Aliases –> URLs.
- On reboot of the firewall, NTPD did not automatically start. (Neither did pfBlockerNG DNSBL Web Server)
2. Uninstalled
3. Reinstalled and reconfigured the package.
4. Issues encountered this time:
- Firewall and Aliases --> URLs rules were added
- NTPD <u>does not automatically</u> startup when firewall is rebooted and must be started manually

Does anyone have any ideas on how to address these issues? My configuration matches the configuration being used on a WatchGuard X700 running pfsense 2.2.4 32-bit.

I am not sure if there are additional logs that I need to provide for troubleshooting purposes?

Thanks!
capedcrsdr