IP-Blocklist

rclare70

Using Multi pal Nat Routes,

WAN
LAN
OPT1 - Running a Hot Public WiFi zone, the previously attached replacement bash script fixed the issues for me.

for the index.html?list=bt_level1, style files, I created a work around for my own use age, if this helps anyone:

I made a Sub directory on my web sever (Cloud hosted) and restricted this access down to my pfSense gateway IP.
created the following bash script.:

cd /var/www/pg2
rm -rf bt_level1.gz && wget http://list.iblocklist.com/?list=bt_level1 && mv index.html?list=bt_level1 bt_level1.gz
rm -rf bt_level2.gz && wget http://list.iblocklist.com/?list=bt_level2 && mv index.html?list=bt_level2 bt_level2.gz
rm -rf bt_level3.gz && wget http://list.iblocklist.com/?list=bt_level3 && mv index.html?list=bt_level3 bt_level3.gz

scheduled this to run on a weekly basis, and then have pfSense query the Remote Web server,

but there is no reason why this can't be changed to function local on the pfSense box.
Have it fetch the index.html?list=bt_level1 file, store it locally on the web-server, rename the file, and then re-query it's own web-sever from the ipblocklist interface, which should end up in the index.html?list=bt_level1 style links working without the need for the intermediate server, however for my needs I prefer to have the mirror pre-fetching occurring in a hosted environment.

If there is any interest I'll happily attempt to create something to run this all locally on the pfSense Box.

tommyboy180

If only pfsense came with wget to begin with then you wouldn't have to do this. Since fetch doesn't work well with these dynamic links it becomes a problem. Maybe I will consider adding wget after I get file uploads going.

Guest

I came across your forum after reviewing our server logs at Country IP Blocks. We noticed the discussion included Country IP Blocks Access Control Lists in a PG2 format. As a courtesy we have created these lists from our Country IP Blocks Database. The data is in a format that looks like this:

AZERBAIJAN:46.18.64.0-46.18.71.255
…
UNITED STATES:3.0.0.0-3.255.255.255
...
CHINA:1.12.0.0-1.15.255.255

A reminder, our database is updated daily.

We can output our data in any format needed.

You can get your PG2 formatted list here: http://www.countryipblocks.net/networking/pg2-formatted-acess-control-lists/

Thanks,

Stewart White

tommyboy180

@countryipblocks:

I came across your forum after reviewing our server logs at Country IP Blocks. We noticed the discussion included Country IP Blocks Access Control Lists in a PG2 format. As a courtesy we have created these lists from our Country IP Blocks Database. The data is in a format that looks like this:

AZERBAIJAN:46.18.64.0-46.18.71.255
…
UNITED STATES:3.0.0.0-3.255.255.255
...
CHINA:1.12.0.0-1.15.255.255

A reminder, our database is updated daily.

We can output our data in any format needed.

You can get your PG2 formatted list here: http://www.countryipblocks.net/networking/pg2-formatted-acess-control-lists/

Thanks,

Stewart White

Excellent! Thank you for taking the time to post!

Guest

@tommyboy180:

Excellent! Thank you for taking the time to post!

You're welcome. We'll keep the data flowing, just let us know your needs.

tommyboy180

@countryipblocks:

@tommyboy180:

Excellent! Thank you for taking the time to post!

You're welcome. We'll keep the data flowing, just let us know your needs.

I had a question for you. What do you think about the countryblock package for pfsense? It downloads countrylists from your site directly. A while ago we had a small discussion over the semi automated process and your rules within the FAQ. At the time we determined that it does not break your rules, however now that you're here you could comment and give me a final say.

Guest

@tommyboy180:

I had a question for you. What do you think about the countryblock package for pfsense? It downloads countrylists from your site directly. A while ago we had a small discussion over the semi automated process and your rules within the FAQ. At the time we determined that it does not break your rules, however now that you're here you could comment and give me a final say.

I appreciate the question. I haven't seen your pfsense package yet. Could you provide me with a little info?

We arecurrently in the process of deciding how we want to deliver our, the formats, etc. One of the issues we are struggling with is the automated connections. When we started the website in 2007 we decided not to allow users to use automated tools to update. Our concern was an increase in traffic without the benefit of having the traffic originate through the site pages.

In 2008, I decided to change this rule and allow reasonable automation. We now get thousands of automated requests each day. I feel this is a good thing for those who use our data, but still leaves us paying exorbitant server and network costs in order to handle the growth.

We responded to these increased costs by placing some limited display ads on the website, but of course if the site is bypassed and the data download is automated the ads are missed.

In your case I think we can probably offer our assistance. We would appreciate credits and links back to the website.

We could probably collaborate on the project and create data expressly for your needs.

We recently added change logs to the site. This enables users to make daily modifications as opposed to downloading all or most of the countries.

Let's talk about what you would like to accomplish.

tommyboy180

@countryipblocks:

@tommyboy180:

I had a question for you. What do you think about the countryblock package for pfsense? It downloads countrylists from your site directly. A while ago we had a small discussion over the semi automated process and your rules within the FAQ. At the time we determined that it does not break your rules, however now that you're here you could comment and give me a final say.

I appreciate the question. I haven't seen your pfsense package yet. Could you provide me with a little info?

We arecurrently in the process of deciding how we want to deliver our, the formats, etc. One of the issues we are struggling with is the automated connections. When we started the website in 2007 we decided not to allow users to use automated tools to update. Our concern was an increase in traffic without the benefit of having the traffic originate through the site pages.

In 2008, I decided to change this rule and allow reasonable automation. We now get thousands of automated requests each day. I feel this is a good thing for those who use our data, but still leaves us paying exorbitant server and network costs in order to handle the growth.

We responded to these increased costs by placing some limited display ads on the website, but of course if the site is bypassed and the data download is automated the ads are missed.

In your case I think we can probably offer our assistance. We would appreciate credits and links back to the website.

We could probably collaborate on the project and create data expressly for your needs.

We recently added change logs to the site. This enables users to make daily modifications as opposed to downloading all or most of the countries.

Let's talk about what you would like to accomplish.

I sent you a PM with more info. Thank you!

tommyboy180

Troubleshooting guide:

Some people have been having issues getting the package to run. Before you think you need to rebuild pfsense try a simple test first.
Go to Firewall -> Rules and pick a random entry. Click the edit button. Don't make any changes! Now click save.
Go back to your package. Ensure Enable is checked and Click save. Your package should be running now.

ThinkSmart

Hey,

i can install the package but i can't load the blacklists into it. So if i use the examples (level1, level2, level3) or other blacklists from here they are at the list, but it says there were no blocked ips or networks.

I've tried it with pfsense 1.2.3. and 2.0BETA5. The tipp above me doesn't make changes. Thanks.

tommyboy180

@ThinkSmart:

Hey,

i can install the package but i can't load the blacklists into it. So if i use the examples (level1, level2, level3) or other blacklists from here they are at the list, but it says there were no blocked ips or networks.

I've tried it with pfsense 1.2.3. and 2.0BETA5. The tipp above me doesn't make changes. Thanks.

Take a look at the first post in this topic for the FAQ. If you still have problems let me know.

ThinkSmart

Take a look at the Pictures, after adding the Link in the Textbox and pressing + and save/update, there where no changes. :/

packages.jpg_thumb

ip-blocklist.jpg_thumb

Wolfsokin

Try loading the url of that blocklist in a browser and see what you get. I get a 404 file not found.

:edit to add

try using the url to this blocklist and see if it works. This list works for me so I know the url is good.

http://list.iblocklist.com/files/tzmtqbbsgbtfxainogvm.gz

kalons

Hi, tommyboy180

I don't think it is working, now my pfsense working on transparent bridging mode.
I installed the IP-blocklist without any error.
I add URL list such as "http://www.google.com" for test. And click "block outbound?" as well.
But I still can logon the website.
And I check the Rules under firewall. There is no any change for my original setting there.
Would you please to check that?
Thx!

kalons

@tommyboy180:

Troubleshooting guide:

Some people have been having issues getting the package to run. Before you think you need to rebuild pfsense try a simple test first.
Go to Firewall -> Rules and pick a random entry. Click the edit button. Don't make any changes! Now click save.
Go back to your package. Ensure Enable is checked and Click save. Your package should be running now.

Hi Tommy,

I try this way many times but still not working.

tommyboy180

@kalons:

Hi, tommyboy180

I don't think it is working, now my pfsense working on transparent bridging mode.
I installed the IP-blocklist without any error.
I add URL list such as "http://www.google.com" for test. And click "block outbound?" as well.
But I still can logon the website.
And I check the Rules under firewall. There is no any change for my original setting there.
Would you please to check that?
Thx!

Please re-read the FAQ items on post #1. You don't add domain names as the url you add lists in the url list.

rajkedda

Hi countryipblocks,
I am trying to access your site to download the country ip blocks. I keep getting forbidden, but i access your site from different location, it works fine. By any chance my WAN IP is blocked on your network?

Link I am trying is http://www.countryipblocks.net/networking/pg2-formatted-acess-control-lists/

Guest

Our servers have some auto-defense characteristics to prevent multiple high volume data downloads during a single day. Let me know the IP address you are using (send me a private message) and I will investigate.

Spock75

Is it possible to add description after the link in "Current List(s):" ?

I use iblocklist.com and many of the links look like this "ghlzqtqxnzctvvajwwag.gz"

tommyboy180

@Spock75:

Is it possible to add description after the link in "Current List(s):" ?

I use iblocklist.com and many of the links look like this "ghlzqtqxnzctvvajwwag.gz"

Thanks for the idea! It's now in my to-do list.