IP-Blocklist

tommyboy180

Hello,

I have install Ip-Blocklist package ver:0.3.1 on my pfsense ver: 1.2.3-RELEASE
I have setting more ip list ( http://iblocklist.charlieprice.org/files/bt_spyware.gz , http://iblocklist.charlieprice.org/files/tbg_bogon.gz etc etc.. )

All it's OK from the gui interface install and update.

The problem it's for automic list update :

i have comment out lines 3-14 of this file : /usr/local/etc/rc.d/IP-Blocklist.sh
i have do a cron to execute daly : /usr/local/etc/rc.d/IP-Blocklist.sh

The problem is when i execute this batch : /usr/local/etc/rc.d/IP-Blocklist.sh it juste update firewall rules and note my list.

This script not downlad all .gz file and not take a list live update.

Only this script update all lists : ipblocklist.php
And i have add this line to not have memory error : ini_set("memory_limit","128M");

Do you have a solution to automatic realy uptade the lists ?
Without solution, i have think to execute the ipblocklist.php with php command line.
Excuse my english .

Best regards.

I think you have a couple options. You can invoke the php via command line with or you can put the fetch code into the .sh on your own. The php code downloads the lists since it's easy to use a loop in php, but by all means put the fetch loop into the shell code.

The memory error is normal. You can safely ignore it. It only happens when you use large lists. You can cut down the size of your lists, increase your php mem size, or just ignore it. Even with the error the script will still execute properly.

djnicofun

Hello,

I have the error: /usr/bin/perl: not found when you execute : /usr/local/etc/rc.d/IP-Blocklist.sh ( Or Save/update by webGui )

i have find a simply solution :

ln -s /usr/local/bin/perl /usr/bin/perl

Regards.

djnicofun

Hello,

Another little bug:

If you want downlaod a list file as : http://list.iblocklist.com/?list=rynxmrknfjysesjtjlxy&id=xxxxxxx&pin=xxxxxxxxx does not work !
Exemple if you are a http://www.iblocklist.com/ subscriber you have the same url for your block list.

Solution:
File : /usr/local/www/packages/ipblocklist/ipblocklist.php
exec("/usr/bin/fetch -o lists $line"); –-> replace by --> exec("/usr/bin/fetch -o lists "$line"");

Best reagards.

tommyboy180

@djnicofun:

Hello,

Another little bug:

If you want downlaod a list file as : http://list.iblocklist.com/?list=rynxmrknfjysesjtjlxy&id=xxxxxxx&pin=xxxxxxxxx does not work !
Exemple if you are a http://www.iblocklist.com/ subscriber you have the same url for your block list.

Solution:
File : /usr/local/www/packages/ipblocklist/ipblocklist.php
exec("/usr/bin/fetch -o lists $line"); –-> replace by --> exec("/usr/bin/fetch -o lists "$line"");

Best reagards.

Awesome! I will update ASAP. As far as the perl location, some people have this problem, most don't. I guess I can add both locations for compatability but that's not ideal. Did you get it working?

wm408

Tommyboy,

Is getting the embedded running in a VM a bi$#h? If it is… Ill loan you a box to test on. Let me know.

tommyboy180

@wm408:

Tommyboy,

Is getting the embedded running in a VM a bi$#h? If it is… Ill loan you a box to test on. Let me know.

I got it running in VMware but it doesn't detect my virtual NICs for some reason. User NoahVail was supposed to send me a laptop for dev but he hasn't.
I still have plans for fix the package for embedded users so don't worry.

hawks_nest

Tommyboy, I have been using IP-Blocklist for a few weeks and it works great. BTW, I am also using your file manager and country blocker package. All awesome programs. I have one issue, it appears that the level1 lists block banking sites (for me it is tnx.banking.pcfinancial.ca) as well as meta data retrieval from tMDB.org and theTVDB.com for meta <browser>for my mediabrowser in win7 media center. They all work fine if I turn off IP-Blocklist. I tried to create a whitelist with the ip addresses of these sites but still no luck. Can you please give me a little more detail on how to create a whitelist, the format, and which directory to place it in. Also how to see if it is working.

Thanks</browser>

tommyboy180

@hawks_nest:

Tommyboy, I have been using IP-Blocklist for a few weeks and it works great. BTW, I am also using your file manager and country blocker package. All awesome programs. I have one issue, it appears that the level1 lists block banking sites (for me it is tnx.banking.pcfinancial.ca) as well as meta data retrieval from tMDB.org and theTVDB.com for meta <browser>for my mediabrowser in win7 media center. They all work fine if I turn off IP-Blocklist. I tried to create a whitelist with the ip addresses of these sites but still no luck. Can you please give me a little more detail on how to create a whitelist, the format, and which directory to place it in. Also how to see if it is working.

Thanks</browser>

Hey. I had the same problems as well. Keep trying to whitelist that range. Make sure you're using CIDR formatting on the whiltelist range.
Also, don't forget to re-Save/Update after you create your whitelist. The rules need to be regenerated or else your sites will still be blocked.

Let me know how it turns out. Take care.

hawks_nest

Thanks, I just re-loaded the rules and it is working great. Thanks for this great package. ;D

Slab

@wm408:

Did we ever resolve the IP Blocklist service having this:

Current Status = NOT running

You are blocking 0 Networks/IPs

Even though the "Enable IP-Blocklist" is checked? It seems to happen after some period of time… haven't figured out how long, usually I check each day and it seems consistent.

I'm using embedded, don't know if its specific to this. (1.2.3-release)

Hi …sorry to resurrect this, but it seems that I am having the exact same problem on the non-embedded version of pfSense. I am running 2.0-RC1-i386 (no snapshots/updates applied). I was able to confirm that last night the status showed running, and this morning it shows not running. "Enable IP-Blocklist" is always checked. If I click 'Save' it changes the status to running again. This has happened several times over the course of the last three days (new install), and I haven't determined if there is a fixed time frame when the status changes.

I am running a vanilla install with only the IP-Blocklist and Snort packages added. Thanks...

tommyboy180

@Slab:

@wm408:

Did we ever resolve the IP Blocklist service having this:

Current Status = NOT running

You are blocking 0 Networks/IPs

Even though the "Enable IP-Blocklist" is checked? It seems to happen after some period of time… haven't figured out how long, usually I check each day and it seems consistent.

I'm using embedded, don't know if its specific to this. (1.2.3-release)

Hi …sorry to resurrect this, but it seems that I am having the exact same problem on the non-embedded version of pfSense. I am running 2.0-RC1-i386 (no snapshots/updates applied). I was able to confirm that last night the status showed running, and this morning it shows not running. "Enable IP-Blocklist" is always checked. If I click 'Save' it changes the status to running again. This has happened several times over the course of the last three days (new install), and I haven't determined if there is a fixed time frame when the status changes.

I am running a vanilla install with only the IP-Blocklist and Snort packages added. Thanks...

I'll look into this today hopefully.

seggerman

Tommyboy, all

it seems as if IPblocklist is working for everybody except for me :-[ … I currently have two issues:

email settings
see: ipblocklist_1.png

I've set all parameters, but when I hit "test" I get the error
[code]Warning: fsockopen(): unable to connect to none://smtp.1und1.de:25 (Unable to find the socket transport "none" - did you forget to enable it when you configured PHP?) in /usr/local/www/packages/ipblocklist/class.smtp.php on line 122 Mailer Error: SMTP Error: Could not connect to SMTP host.

I solved this problem by commenting

//$mail->SMTPSecure = "none";

in the email_send.php file

Interface settings:
I have in the interfaces.txt file "any", so all interfaces should be activated. Looking at the interfaces tab I get:
see: ipblocklist_if.png

strangely only the LAN interface is available. Going into the ipblocklist_if.php file I modified a few lines of code

                   $portinfo): ?>
$comma_array=implode(",",$iface);
echo "$portname - $comma_array 
";
?>

so that I can see exactly the $iface definitions and I get:
see: ipblocklist_if_new.png

the checking of the interface goes against the physical interface address, instead of pppoe0
The question is if the blocking of the IP-addresses still occur even if the interface tab is "messed up".

I'm currently running on Current version: 2.0-RC1 - Built On: Sat Mar 12 01:18:33 EST 2011

Hope someone can help me out.

Cheers + Regards

Alexander

ipblocklist_if_new.png_thumb

ipblocklist_if.png_thumb

ipblocklist_1.png_thumb

tommyboy180

seggerman,

Hopefully I can get into it more. Right now I don't have a 2.0 RC1 install. I'm working on getting mine going. Soon I will be able to fully support your issue.

EDIT:

I just got 2.0RC1 running. 2.0-RC1 (i386) built on Tue Mar 15 08:53:58 EDT 2011.

I installed the package and everything is good. I would try re-moving the package and re-installing. See if that helps.

Slab

@Slab:

Hi …sorry to resurrect this, but it seems that I am having the exact same problem on the non-embedded version of pfSense. I am running 2.0-RC1-i386 (no snapshots/updates applied). I was able to confirm that last night the status showed running, and this morning it shows not running. "Enable IP-Blocklist" is always checked. If I click 'Save' it changes the status to running again. This has happened several times over the course of the last three days (new install), and I haven't determined if there is a fixed time frame when the status changes.

I am running a vanilla install with only the IP-Blocklist and Snort packages added. Thanks...

After a bit of experimentation, I've been able to isolate what appears to cause IP-Blocklist to change to a disabled state. It happens every time the pfSense filter gets reloaded (at least it does with my install). If I select 'Filter Reload' in the Status menu (and then press the 'Reload Filter' button), IP-Blocklist will change to a disabled state. Presumably this will happen when the filter periodically/automatically reloads. Thx…

tommyboy180

@Slab:

@Slab:

Hi …sorry to resurrect this, but it seems that I am having the exact same problem on the non-embedded version of pfSense. I am running 2.0-RC1-i386 (no snapshots/updates applied). I was able to confirm that last night the status showed running, and this morning it shows not running. "Enable IP-Blocklist" is always checked. If I click 'Save' it changes the status to running again. This has happened several times over the course of the last three days (new install), and I haven't determined if there is a fixed time frame when the status changes.

I am running a vanilla install with only the IP-Blocklist and Snort packages added. Thanks...

After a bit of experimentation, I've been able to isolate what appears to cause IP-Blocklist to change to a disabled state. It happens every time the pfSense filter gets reloaded (at least it does with my install). If I select 'Filter Reload' in the Status menu (and then press the 'Reload Filter' button), IP-Blocklist will change to a disabled state. Presumably this will happen when the filter periodically/automatically reloads. Thx…

Correct. This is one of the down sides to the package as it 'injects' the pfctl tables into the firewall rules. This is the way the package has always been. I have been looking for a way to make the package more resilient however I have not found that method as of yet. Perhaps I need to start talking to some of the senior devs to find this solution.

bubba

Hello, I'm a pfsense newbie. I recently converted because I came across this forum and loved the idea of the ipblocklist add-on. ok so I installed on a hard drive using pfsense-2.0-RC1-i389-20110226-1530.iso.gz. Install wouldn't boot so my final solution was to create 2 partitians and then for some reason it finally worked. (which is why I'm scared to have to reinstall pfsense). First thing I did after I got pfsense up and running was install the ipblock package but whatever I try I cannot get it enabled.

I have not installed any other packages besides ipblocklist
I can add list url using the http://iblocklist….gz links
But when I check enable ip-blocklist and save/update nothing happens
If it's not running usually a reboot will fix "current status = running" but I'm always blocking 0 and enable doesn't stay checked.
I know this is an issue as I see it discussed here, I have tried:
reinstalling the package
uninstall, reboot, install the package
edit a firewall rule, save, enable ip-blocklist
edit a firewall rule, save, reboot, enable ip-blocklist
Ran pfsense updates to the current update
uninstall, reinstall ip-blocklist package after running the updates.
Reboot, resave, etc.

Is there anything else I can try...I really want to get this working. Should I reinstall pfsense?
Thanks!

Supermule

Using FF or IE??

@bubba:

Hello, I'm a pfsense newbie. I recently converted because I came across this forum and loved the idea of the ipblocklist add-on. ok so I installed on a hard drive using pfsense-2.0-RC1-i389-20110226-1530.iso.gz. Install wouldn't boot so my final solution was to create 2 partitians and then for some reason it finally worked. (which is why I'm scared to have to reinstall pfsense). First thing I did after I got pfsense up and running was install the ipblock package but whatever I try I cannot get it enabled.

I have not installed any other packages besides ipblocklist
I can add list url using the http://iblocklist….gz links
But when I check enable ip-blocklist and save/update nothing happens
If it's not running usually a reboot will fix "current status = running" but I'm always blocking 0 and enable doesn't stay checked.
I know this is an issue as I see it discussed here, I have tried:
reinstalling the package
uninstall, reboot, install the package
edit a firewall rule, save, enable ip-blocklist
edit a firewall rule, save, reboot, enable ip-blocklist
Ran pfsense updates to the current update
uninstall, reinstall ip-blocklist package after running the updates.
Reboot, resave, etc.

Is there anything else I can try...I really want to get this working. Should I reinstall pfsense?
Thanks!

bubba

ahhhh no kidding! IE. I just went into FF and it's working beautifully! wow thanks! ;D

@Supermule:

Using FF or IE??

@bubba:

Hello, I'm a pfsense newbie. I recently converted because I came across this forum and loved the idea of the ipblocklist add-on. ok so I installed on a hard drive using pfsense-2.0-RC1-i389-20110226-1530.iso.gz. Install wouldn't boot so my final solution was to create 2 partitians and then for some reason it finally worked. (which is why I'm scared to have to reinstall pfsense). First thing I did after I got pfsense up and running was install the ipblock package but whatever I try I cannot get it enabled.

I have not installed any other packages besides ipblocklist
I can add list url using the http://iblocklist….gz links
But when I check enable ip-blocklist and save/update nothing happens
If it's not running usually a reboot will fix "current status = running" but I'm always blocking 0 and enable doesn't stay checked.
I know this is an issue as I see it discussed here, I have tried:
reinstalling the package
uninstall, reboot, install the package
edit a firewall rule, save, enable ip-blocklist
edit a firewall rule, save, reboot, enable ip-blocklist
Ran pfsense updates to the current update
uninstall, reinstall ip-blocklist package after running the updates.
Reboot, resave, etc.

Is there anything else I can try...I really want to get this working. Should I reinstall pfsense?
Thanks!

bubba

ok maybe another dumb question but…
I'm running peerblock on my computer right now. It only has the 3 default lists running (p2p, spyware, ads) and says it is blocking 776,905,708 IPs

My pfsense firewall with ipblocklist is also running and it says "you are blocking 351,073 network/IPs"
I have the following lists:
http://iblocklist.dbnservers.net/files/bt_spyware.gz
http://iblocklist.rlcassidy.net/files/bt_ads.gz
http://ibl.gamechaser.net/files/bt_level2.gz
http://iblocklist.rlcassidy.net/files/bt_level3.gz
http://iblocklist.dbnservers.net/files/bt_level1.gz

So what I don't understand is why is peerblock still getting activity, and also why are the ip numbers so much lower in ipblock when I'm using the same lists plus more.

Thanks in advance!

Slab

@bubba:

ok maybe another dumb question but…
I'm running peerblock on my computer right now. It only has the 3 default lists running (p2p, spyware, ads) and says it is blocking 776,905,708 IPs

My pfsense firewall with ipblocklist is also running and it says "you are blocking 351,073 network/IPs"
I have the following lists:
http://iblocklist.dbnservers.net/files/bt_spyware.gz
http://iblocklist.rlcassidy.net/files/bt_ads.gz
http://ibl.gamechaser.net/files/bt_level2.gz
http://iblocklist.rlcassidy.net/files/bt_level3.gz
http://iblocklist.dbnservers.net/files/bt_level1.gz

So what I don't understand is why is peerblock still getting activity, and also why are the ip numbers so much lower in ipblock when I'm using the same lists plus more.

Thanks in advance!

Just a guess …but perhaps peerblock is giving you the total IP addresses in each subnet that is blocked in addition to any individual IP addresses that may be blocked, while IP-Blocklist is only counting each subnet (not the address totals within each subnet) plus any individual IP addresses that may be blocked...