pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!
-
@NogBadTheBad Maybe because im using 2.4.x development version? (2.4.5?)
-
Their cloudflare antiddos such pain. Doesn't know why but it has half hour to register. Auch
-
Maybe.
-
They mention "up to 25 keys"...do you happen to know if we need a separate key for each router, if we have more than one?
-
@teamits it's more about control over your account API usage. So it up to you to decide how much control you need. 1 key per software or 1 key per hardware instance or one key for all. If you directly know where you use it fine. When time is come to rotate the keys you want not to miss where you was used them :)
-
So I went ahead and installed pfBlockerNG 2.1.4_19 on my pfsense 2.4.4-RELEASE-p3 machine and signed up for an account with MaxMind and obtained a license key. I started downloading from MaxMind and am running into an issue with extracting data from the tarred database.
UPDATE PROCESS START [ 01/02/20 15:29:54 ] ===[ DNSBL Process ]================================================ DNSBL: Flush DNSBL_IP Clearing all DNSBL Feeds... completed Validating database... completed Reloading Unbound.... completed DNSBL update [ 0 | PASSED ]... completed [ 01/02/20 15:29:55 ] ------------------------------------------ ===[ Continent Process ]============================================ MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ... Download Process Starting [ 01/02/20 15:29:55 ] /usr/local/share/GeoIP/GeoLite2-Country.tar.gz 200 OK . /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip 200 OK .tar: Failed to set default locale tar: Failed to set default locale Download Process Ended [ 01/02/20 15:29:56 ] Country code update Start [ MAXMIND UPDATE FAIL, Language File Missing, using previous Country code database ] Creating pfBlockerNG Continent XML files IPv4 Africa grep: /usr/local/share/GeoIP/cc/Africa_v4.txt: No such file or directory IPv6 Africa grep: /usr/local/share/GeoIP/cc/Africa_v6.txt: No such file or directory IPv4 Antarctica grep: /usr/local/share/GeoIP/cc/Antarctica_v4.txt: No such file or directory IPv6 Antarctica grep: /usr/local/share/GeoIP/cc/Antarctica_v6.txt: No such file or directory IPv4 Asia grep: /usr/local/share/GeoIP/cc/Asia_v4.txt: No such file or directory IPv6 Asia grep: /usr/local/share/GeoIP/cc/Asia_v6.txt: No such file or directory IPv4 Europe grep: /usr/local/share/GeoIP/cc/Europe_v4.txt: No such file or directory IPv6 Europe grep: /usr/local/share/GeoIP/cc/Europe_v6.txt: No such file or directory IPv4 North America grep: /usr/local/share/GeoIP/cc/North_America_v4.txt: No such file or directory IPv6 North America grep: /usr/local/share/GeoIP/cc/North_America_v6.txt: No such file or directory IPv4 Oceania grep: /usr/local/share/GeoIP/cc/Oceania_v4.txt: No such file or directory IPv6 Oceania grep: /usr/local/share/GeoIP/cc/Oceania_v6.txt: No such file or directory IPv4 South America grep: /usr/local/share/GeoIP/cc/South_America_v4.txt: No such file or directory IPv6 South America grep: /usr/local/share/GeoIP/cc/South_America_v6.txt: No such file or directory IPv4 Proxy and Satellite grep: /usr/local/share/GeoIP/cc/Proxy_and_Satellite_v4.txt: No such file or directory IPv6 Proxy and Satellite grep: /usr/local/share/GeoIP/cc/Proxy_and_Satellite_v6.txt: No such file or directory IPv4 TOP 20 grep: /usr/local/share/GeoIP/cc/Top_20_v4.info: No such file or directory IPv6 TOP 20 grep: /usr/local/share/GeoIP/cc/Top_20_v6.info: No such file or directory pfBlockerNG Reputation Tab Country Code Update Ended ===[ Aliastables / Rules ]========================================== No changes to Firewall rules, skipping Filter Reload No Changes to Aliases, Skipping pfctl Update UPDATE PROCESS ENDED [ 01/02/20 15:29:56 ][2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP: ls -la total 24332 drwxr-xr-x 3 root wheel 512 Jan 2 14:49 . drwxr-xr-x 44 root wheel 1024 Jan 2 14:42 .. -rw-r--r-- 1 root wheel 16645188 Dec 31 08:32 GeoLite2-Country-CSV.zip.orig -rw-r--r-- 1 root wheel 1981295 Jan 2 15:29 GeoLite2-Country-CSV.zip.raw -rw-r--r-- 1 root wheel 4034560 Dec 31 08:32 GeoLite2-Country.tar.gz.orig -rw-r--r-- 1 root wheel 2044326 Jan 2 15:29 GeoLite2-Country.tar.gz.raw drwxr-xr-x 2 root wheel 512 Jan 2 14:42 cc [2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP: cd cc [2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP/cc: ls -la total 8 drwxr-xr-x 2 root wheel 512 Jan 2 14:42 . drwxr-xr-x 3 root wheel 512 Jan 2 14:49 .. [2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP/cc:It appears the files have been downloaded but not untarred. The error appears to have to do with setting up the default locale for the tar command. The language on pfsense is set to English and so is MaxMind localization language. What do I need to do to fix this?
~Doug
-
@dougs
Can you try uninstalling pfBlockerNG and trying pfBlockerNG-devel? -
@BBcan177
Uninstalled pfBlockerNG and installed pfBlockerNG-devel 2.2.5_28. Ran update as follows:UPDATE PROCESS START [ 01/02/20 16:36:16 ] ===[ DNSBL Process ]================================================ Saving DNSBL database... completed Clearing all DNSBL Feeds completed Reloading Unbound Resolver..... completed DNSBL update [ 0 | PASSED ]... completed ------------------------------------------------------------------------ ===[ GeoIP Process ]============================================ MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ... Download Process Starting [ 01/02/20 16:36:16 ] /usr/local/share/GeoIP/GeoLite2-Country.tar.gz 200 OK /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip 200 OK Download Process Ended [ 01/02/20 16:36:17 ] Country code update Start Processing ISO IPv4 Continent/Country Data Processing ISO IPv6 Continent/Country Data [ 01/02/20 16:36:23 ] Creating pfBlockerNG Continent PHP files IPv4 Africa [ 01/02/20 16:36:24 ] IPv6 Africa [ 01/02/20 16:36:25 ] IPv4 Antarctica IPv6 Antarctica IPv4 Asia IPv6 Asia IPv4 Europe IPv6 Europe [ 01/02/20 16:36:27 ] IPv4 North America IPv6 North America [ 01/02/20 16:36:28 ] IPv4 Oceania IPv6 Oceania [ 01/02/20 16:36:29 ] IPv4 South America IPv6 South America IPv4 Proxy and Satellite IPv6 Proxy and Satellite IPv4 Top Spammers IPv6 Top Spammers pfBlockerNG Reputation Tab Country Code Update Ended ===[ IPv4 Process ]================================================= [ DNSBLIP_v4 ] Downloading update [ 01/02/20 16:36:29 ] . [ DNSBLIP_v4 ] file_get_contents(/var/db/pfblockerng/DNSBLIP_v4.txt): failed to open stream: No such file or directory [ pfB_DNSBLIP_v4 - DNSBLIP_v4 ] Download FAIL Local File Failure The Following List has been REMOVED [ DNSBLIP_v4 ] ===[ Aliastables / Rules ]========================================== No changes to Firewall rules, skipping Filter Reload No Changes to Aliases, Skipping pfctl Update UPDATE PROCESS ENDEDLooks like an error with DNSBLIP?
~Doug
-
OK I found the issue with pfBlockerNG and the "tar" error.
I posted a fix here (v. 2.1.4_20)
https://github.com/pfsense/FreeBSD-ports/pull/742/filesWould still recommend that everyone move to pfBlockerNG-devel. Will be ending pfBlockerNG version soon.
The DNSBL Error might be fixed with a "Force Reload - All"
-
Let's to note that another one great DB exist ip2location company.
Like in MaxMind for end user there are free DB to download. -
Thank you so much!
-
@mcury said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
I just updated, already put my license key and it's working.
How do you know it worked?
I am on pfBlockerNG-devel 2.2.5_28, added MaxMind License Key, ran update and reload, but when look at
ls -lah /usr/local/share/GeoIP/
my files dated Dec 3 2019Did it work ?
-
@chudak Probably "working" in that it no longer throws the error. MaxMind updates their data first Tuesday of every month, but pfBNG doesn't until the following Thursday in case there's a delay. Check again on the 9th. If I'm incorrect please let me know.
-
@provels
Will do, thx -
@chudak said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@mcury said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
I just updated, already put my license key and it's working.
How do you know it worked?
I am on pfBlockerNG-devel 2.2.5_28, added MaxMind License Key, ran update and reload, but when look at
ls -lah /usr/local/share/GeoIP/
my files dated Dec 3 2019Did it work ?
You can run the following from the command prompt to see if it updates:
"php /usr/local/www/pfblockerng/pfblockerng.php dc", copy and paste without the quotes. -
@chudak I'm using 2.4.4p3 with pfBlocker-NG-devel 2.2.5_28
Check if the files downloaded from maxmind are located at:
ls -lah /usr/local/share/GeoIP/
Check the logs during the maxmind download, as you can see, it downloaded a 4MB database file.
**Saving configuration [ 01/05/20 12:32:23 ]** MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ... Download Process Starting [ 01/05/20 12:32:24 ] /usr/local/share/GeoIP/GeoLite2-Country.tar.gz 200 OK /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip 200 OK Download Process Ended [ 01/05/20 12:32:28 ] Country code update Start Processing ISO IPv4 Continent/Country Data [ 01/05/20 12:32:31 ] Processing ISO IPv6 Continent/Country Data [ 01/05/20 12:33:08 ] Creating pfBlockerNG Continent PHP files IPv4 Africa [ 01/05/20 12:33:18 ] IPv6 Africa [ 01/05/20 12:33:19 ] IPv4 Antarctica IPv6 Antarctica IPv4 Asia IPv6 Asia [ 01/05/20 12:33:22 ] IPv4 Europe [ 01/05/20 12:33:23 ] IPv6 Europe [ 01/05/20 12:33:33 ] IPv4 North America [ 01/05/20 12:33:35 ] IPv6 North America [ 01/05/20 12:33:42 ] IPv4 Oceania [ 01/05/20 12:33:44 ] IPv6 Oceania IPv4 South America IPv6 South America [ 01/05/20 12:33:45 ] IPv4 Proxy and Satellite [ 01/05/20 12:33:46 ] IPv6 Proxy and Satellite IPv4 Top Spammers IPv6 Top Spammers pfBlockerNG Reputation Tab Country Code Update Ended -
@jdeloach said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@chudak said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@mcury said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
I just updated, already put my license key and it's working.
How do you know it worked?
I am on pfBlockerNG-devel 2.2.5_28, added MaxMind License Key, ran update and reload, but when look at
ls -lah /usr/local/share/GeoIP/
my files dated Dec 3 2019Did it work ?
You can run the following from the command prompt to see if it updates:
"php /usr/local/www/pfblockerng/pfblockerng.php dc", copy and paste without the quotes.yup that worked, thx !
-
@BBcan177 , on pfBlockerNG, v2.1.4_20, it looks like if I open the plugin page (Firewall/pfBlockerNG) the MaxMind License Key field is blank. maxmind_key is populated in the saved config file, which I saved after entering it...I'm thinking maybe it's not populating correctly on the page?
(saw your comment about upgrading/moving to -devel in all cases, just haven't gotten to that yet)
-
@jdeloach said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
You can run the following from the command prompt to see if it updates:
"php /usr/local/www/pfblockerng/pfblockerng.php dc", copy and paste without the quotes.confirmed: running 2.4.4-RELEASE-p3 -> pfBlockerNG 2.1.4_20 (updated, paste the MaxMind "License Key") worked!
Thank you very much!
-
I'll just add that I updated the package, filled in the key and ran an update. All went smoothly.
Steve
-
@dougs said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@BBcan177
Uninstalled pfBlockerNG and installed pfBlockerNG-devel 2.2.5_28. Ran update as follows:UPDATE PROCESS START [ 01/02/20 16:36:16 ] ===[ DNSBL Process ]================================================ Saving DNSBL database... completed Clearing all DNSBL Feeds completed Reloading Unbound Resolver..... completed DNSBL update [ 0 | PASSED ]... completed ------------------------------------------------------------------------ ===[ GeoIP Process ]============================================ MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ... Download Process Starting [ 01/02/20 16:36:16 ] /usr/local/share/GeoIP/GeoLite2-Country.tar.gz 200 OK /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip 200 OK Download Process Ended [ 01/02/20 16:36:17 ] Country code update Start Processing ISO IPv4 Continent/Country Data Processing ISO IPv6 Continent/Country Data [ 01/02/20 16:36:23 ] Creating pfBlockerNG Continent PHP files IPv4 Africa [ 01/02/20 16:36:24 ] IPv6 Africa [ 01/02/20 16:36:25 ] IPv4 Antarctica IPv6 Antarctica IPv4 Asia IPv6 Asia IPv4 Europe IPv6 Europe [ 01/02/20 16:36:27 ] IPv4 North America IPv6 North America [ 01/02/20 16:36:28 ] IPv4 Oceania IPv6 Oceania [ 01/02/20 16:36:29 ] IPv4 South America IPv6 South America IPv4 Proxy and Satellite IPv6 Proxy and Satellite IPv4 Top Spammers IPv6 Top Spammers pfBlockerNG Reputation Tab Country Code Update Ended ===[ IPv4 Process ]================================================= [ DNSBLIP_v4 ] Downloading update [ 01/02/20 16:36:29 ] . [ DNSBLIP_v4 ] file_get_contents(/var/db/pfblockerng/DNSBLIP_v4.txt): failed to open stream: No such file or directory [ pfB_DNSBLIP_v4 - DNSBLIP_v4 ] Download FAIL Local File Failure The Following List has been REMOVED [ DNSBLIP_v4 ] ===[ Aliastables / Rules ]========================================== No changes to Firewall rules, skipping Filter Reload No Changes to Aliases, Skipping pfctl Update UPDATE PROCESS ENDEDLooks like an error with DNSBLIP?
~Doug
Having the same issue
-
@bjurkovski said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@dougs said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@BBcan177
Uninstalled pfBlockerNG and installed pfBlockerNG-devel 2.2.5_28. Ran update as follows:Looks like an error with DNSBLIP?
~Doug
Having the same issue
Maybe an Force Update can help?
Something else - I switched from pfblockerng to pfblockerng-devel an there is a increase of RAM usage from about 13% - is it also in your case?Thanks,
fireodo -
@teamits said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
@BBcan177 , on pfBlockerNG, v2.1.4_20, it looks like if I open the plugin page (Firewall/pfBlockerNG) the MaxMind License Key field is blank. maxmind_key is populated in the saved config file, which I saved after entering it
I checked several times yesterday and the field had the key in it each time I logged in. On a hunch waited until overnight again, and this morning the field is blank in the GUI. Seems so unlikely but is there some way it could disappear overnight? If I export the config file this morning it's missing, compared to my last export 3 days ago:
<enable_log/>
<skipfeed>0</skipfeed>
<log_maxlines>20000</log_maxlines>
<maxmind_key>****</maxmind_key>
<maxmind_locale>en</maxmind_locale>
<database_cc/>
<inbound_interface>wan</inbound_interface>vs
<enable_log/>
<maxmind_locale>en</maxmind_locale>
<database_cc/>
<skipfeed>0</skipfeed>
<log_maxlines>20000</log_maxlines>
<inbound_interface>wan</inbound_interface>FWIW this is on an SG-4860 and it hasn't restarted in months.
-
Hi,
just a quiston: If Idon't want to use GeoIP and set "Disable MaxMind CSV database Updates" checkbox I'm already get an notification every hour that "MaxMind need a license". Is there a way to block this spam without disabling the notification or uninistalling pfBlockerNG?
Cheers
Marco -
@MarcO42
You need to disable the "Action" settings in the GeoIP tab and any IPv4/6 aliases that use the "GeoIP" state for the notifications to stop. -
Instead of sign up Maxmind, can we use IP2Location database as replacement?
-
@christopa1999 said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:
Instead of sign up Maxmind, can we use IP2Location database as replacement?
Why avoid registration?
Just using MaxMind at this moment and after IP2locations integration ready, - just choose. ;) -
i followed the procedure and saved the registration key in our pfsense box, however, after ~1h I started to receive the email notifications again. when I checked back the box, the license key was missing. tried to put it again & save, same result. tried to generate a new key, no change.
does anyone know what might be wrong, please?
-
@jt Did you do a Reload/Force?
-
@jt
When you hit "save" did you get an error message... you probably didn't use the correct License key. Its only alpha-numeric with no spaces etc... -
@BBcan177 And the license key, not the token like the other guy did...
-
i did do reload
i didn't get any error message
i did fill the license key, paste as plain text, the long number, not the short one (token)still getting notifications :/
-
@jt So your Key is a 16 char mixed-case alpha-numeric something like this?
dkhLGtU8fBz3v1nN
If so, I'd suggest getting a new Key. -
@provels yes, 16char mixed case alpha-numeric.
i did exactly that today - got a new key. same result.
funnily enough, out of 4 pfsense boxes we run, just a single one started to ask for the license.. :/ -
@jt Maybe do a reinstall of the package. I've got nothing else.
-
@jt What you describe sounds a bit like what I posted except my key disappeared overnight, and we got the notification on the update. Do you have the cron update set to run hourly maybe? Ours was daily.
I "solved" it by moving to pfBlockerNG-devel. (used the same key) -
I updated pfblockerng but where do put the key??
-
@nafeasonto Firewall/pfBlockerNG/IP/MaxMind GeoIP configuration/MaxMind License Key
-
I don't use MaxMind's list, yet I am getting several messages via WGUI that file did not download...should I disable?
-
@BBcan177 Well, I disabled but that's only the monthly...still getting notification and lots of it.
