Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!

    pfBlockerNG
    31
    105
    78.2k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • dragoangelD
      dragoangel @SteveITS
      last edited by dragoangel

      @teamits it's more about control over your account API usage. So it up to you to decide how much control you need. 1 key per software or 1 key per hardware instance or one key for all. If you directly know where you use it fine. When time is come to rotate the keys you want not to miss where you was used them :)

      Latest stable pfSense on 2x XG-7100 and 1x Intel Xeon Server, running mutiWAN, he.net IPv6, pfBlockerNG-devel, HAProxy-devel, Syslog-ng, Zabbix-agent, OpenVPN, IPsec site-to-site, DNS-over-TLS...
      Unifi AP-AC-LR with EAP RADIUS, US-24

      1 Reply Last reply Reply Quote 0
      • D
        dougs
        last edited by

        So I went ahead and installed pfBlockerNG 2.1.4_19 on my pfsense 2.4.4-RELEASE-p3 machine and signed up for an account with MaxMind and obtained a license key. I started downloading from MaxMind and am running into an issue with extracting data from the tarred database.

         UPDATE PROCESS START [ 01/02/20 15:29:54 ]

===[  DNSBL Process  ]================================================

  DNSBL: Flush DNSBL_IP
Clearing all DNSBL Feeds...  completed
Validating database... completed
Reloading Unbound.... completed
DNSBL update [ 0 | PASSED  ]... completed [ 01/02/20 15:29:55 ]
------------------------------------------

===[  Continent Process  ]============================================

MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ...

Download Process Starting [ 01/02/20 15:29:55 ]
 /usr/local/share/GeoIP/GeoLite2-Country.tar.gz		200 OK
. /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip		200 OK
.tar: Failed to set default locale
tar: Failed to set default locale

Download Process Ended [ 01/02/20 15:29:56 ]

Country code update Start
 [ MAXMIND UPDATE FAIL, Language File Missing, using previous Country code database ]
 Creating pfBlockerNG Continent XML files
 IPv4 Africa			
grep: /usr/local/share/GeoIP/cc/Africa_v4.txt: No such file or directory
 IPv6 Africa			
grep: /usr/local/share/GeoIP/cc/Africa_v6.txt: No such file or directory
 IPv4 Antarctica		
grep: /usr/local/share/GeoIP/cc/Antarctica_v4.txt: No such file or directory
 IPv6 Antarctica		
grep: /usr/local/share/GeoIP/cc/Antarctica_v6.txt: No such file or directory
 IPv4 Asia			
grep: /usr/local/share/GeoIP/cc/Asia_v4.txt: No such file or directory
 IPv6 Asia			
grep: /usr/local/share/GeoIP/cc/Asia_v6.txt: No such file or directory
 IPv4 Europe			
grep: /usr/local/share/GeoIP/cc/Europe_v4.txt: No such file or directory
 IPv6 Europe			
grep: /usr/local/share/GeoIP/cc/Europe_v6.txt: No such file or directory
 IPv4 North America		
grep: /usr/local/share/GeoIP/cc/North_America_v4.txt: No such file or directory
 IPv6 North America		
grep: /usr/local/share/GeoIP/cc/North_America_v6.txt: No such file or directory
 IPv4 Oceania			
grep: /usr/local/share/GeoIP/cc/Oceania_v4.txt: No such file or directory
 IPv6 Oceania			
grep: /usr/local/share/GeoIP/cc/Oceania_v6.txt: No such file or directory
 IPv4 South America		
grep: /usr/local/share/GeoIP/cc/South_America_v4.txt: No such file or directory
 IPv6 South America		
grep: /usr/local/share/GeoIP/cc/South_America_v6.txt: No such file or directory
 IPv4 Proxy and Satellite	
grep: /usr/local/share/GeoIP/cc/Proxy_and_Satellite_v4.txt: No such file or directory
 IPv6 Proxy and Satellite	
grep: /usr/local/share/GeoIP/cc/Proxy_and_Satellite_v6.txt: No such file or directory
 IPv4 TOP 20			
grep: /usr/local/share/GeoIP/cc/Top_20_v4.info: No such file or directory
 IPv6 TOP 20			
grep: /usr/local/share/GeoIP/cc/Top_20_v6.info: No such file or directory
 pfBlockerNG Reputation Tab
Country Code Update Ended



===[  Aliastables / Rules  ]==========================================

No changes to Firewall rules, skipping Filter Reload
No Changes to Aliases, Skipping pfctl Update

 UPDATE PROCESS ENDED [ 01/02/20 15:29:56 ]

        [2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP: ls -la
total 24332
drwxr-xr-x   3 root  wheel       512 Jan  2 14:49 .
drwxr-xr-x  44 root  wheel      1024 Jan  2 14:42 ..
-rw-r--r--   1 root  wheel  16645188 Dec 31 08:32 GeoLite2-Country-CSV.zip.orig
-rw-r--r--   1 root  wheel   1981295 Jan  2 15:29 GeoLite2-Country-CSV.zip.raw
-rw-r--r--   1 root  wheel   4034560 Dec 31 08:32 GeoLite2-Country.tar.gz.orig
-rw-r--r--   1 root  wheel   2044326 Jan  2 15:29 GeoLite2-Country.tar.gz.raw
drwxr-xr-x   2 root  wheel       512 Jan  2 14:42 cc
[2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP: cd cc
[2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP/cc: ls -la
total 8
drwxr-xr-x  2 root  wheel  512 Jan  2 14:42 .
drwxr-xr-x  3 root  wheel  512 Jan  2 14:49 ..
[2.4.4-RELEASE][admin@host.example.org]/usr/local/share/GeoIP/cc:

        It appears the files have been downloaded but not untarred. The error appears to have to do with setting up the default locale for the tar command. The language on pfsense is set to English and so is MaxMind localization language. What do I need to do to fix this?

        ~Doug

        BBcan177B 1 Reply Last reply Reply Quote 0
        • BBcan177B
          BBcan177 Moderator @dougs
          last edited by

          @dougs
          Can you try uninstalling pfBlockerNG and trying pfBlockerNG-devel?

          "Experience is something you don't get until just after you need it."

          Website: http://pfBlockerNG.com
          Twitter: @BBcan177  #pfBlockerNG
          Reddit: https://www.reddit.com/r/pfBlockerNG/new/

          D 1 Reply Last reply Reply Quote 0
          • D
            dougs @BBcan177
            last edited by

            @BBcan177
            Uninstalled pfBlockerNG and installed pfBlockerNG-devel 2.2.5_28. Ran update as follows:

             UPDATE PROCESS START [ 01/02/20 16:36:16 ]

===[  DNSBL Process  ]================================================

Saving DNSBL database... completed

Clearing all DNSBL Feeds completed
Reloading Unbound Resolver..... completed
DNSBL update [ 0 | PASSED  ]... completed
------------------------------------------------------------------------

===[  GeoIP Process  ]============================================

MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ...

Download Process Starting [ 01/02/20 16:36:16 ]
 /usr/local/share/GeoIP/GeoLite2-Country.tar.gz		200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip		200 OK
Download Process Ended [ 01/02/20 16:36:17 ]

Country code update Start
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 01/02/20 16:36:23 ]
 Creating pfBlockerNG Continent PHP files
 IPv4 Africa			 [ 01/02/20 16:36:24 ]
 IPv6 Africa			 [ 01/02/20 16:36:25 ]
 IPv4 Antarctica		
 IPv6 Antarctica		
 IPv4 Asia			
 IPv6 Asia			
 IPv4 Europe			
 IPv6 Europe			 [ 01/02/20 16:36:27 ]
 IPv4 North America		
 IPv6 North America		 [ 01/02/20 16:36:28 ]
 IPv4 Oceania			
 IPv6 Oceania			 [ 01/02/20 16:36:29 ]
 IPv4 South America		
 IPv6 South America		
 IPv4 Proxy and Satellite	
 IPv6 Proxy and Satellite	
 IPv4 Top Spammers		
 IPv6 Top Spammers		
 pfBlockerNG Reputation Tab
Country Code Update Ended



===[  IPv4 Process  ]=================================================

[ DNSBLIP_v4 ]			 Downloading update [ 01/02/20 16:36:29 ] .
[ DNSBLIP_v4 ] file_get_contents(/var/db/pfblockerng/DNSBLIP_v4.txt): failed to open stream: No such file or directory


 [ pfB_DNSBLIP_v4 - DNSBLIP_v4 ] Download FAIL
   Local File Failure


The Following List has been REMOVED [ DNSBLIP_v4 ]


===[  Aliastables / Rules  ]==========================================

No changes to Firewall rules, skipping Filter Reload
No Changes to Aliases, Skipping pfctl Update

 UPDATE PROCESS ENDED

            Looks like an error with DNSBLIP?

            ~Doug

            B 1 Reply Last reply Reply Quote 1
            • BBcan177B
              BBcan177 Moderator
              last edited by

              OK I found the issue with pfBlockerNG and the "tar" error.

              I posted a fix here (v. 2.1.4_20)
              https://github.com/pfsense/FreeBSD-ports/pull/742/files

              Would still recommend that everyone move to pfBlockerNG-devel. Will be ending pfBlockerNG version soon.

              The DNSBL Error might be fixed with a "Force Reload - All"

              "Experience is something you don't get until just after you need it."

              Website: http://pfBlockerNG.com
              Twitter: @BBcan177  #pfBlockerNG
              Reddit: https://www.reddit.com/r/pfBlockerNG/new/

              1 Reply Last reply Reply Quote 1
              • Sergei_ShablovskyS
                Sergei_Shablovsky
                last edited by

                Let's to note that another one great DB exist ip2location company.
                Like in MaxMind for end user there are free DB to download.

                —
                CLOSE SKY FOR UKRAINE https://youtu.be/_tU1i8VAdCo !
                Help Ukraine to resist, save civilians people’s lives !
                (Take an active part in public protests, push on Your country’s politics, congressmans, mass media, leaders of opinion.)

                1 Reply Last reply Reply Quote 0
                • M
                  Making_sense_of_pfSense
                  last edited by

                  Thank you so much!

                  Running pfSense Community Edition 2.7.2 on a Qotom Mini PC.

                  1 Reply Last reply Reply Quote 0
                  • chudakC
                    chudak @mcury
                    last edited by

                    @mcury said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                    I just updated, already put my license key and it's working.

                    How do you know it worked?

                    I am on pfBlockerNG-devel 2.2.5_28, added MaxMind License Key, ran update and reload, but when look at
                    ls -lah /usr/local/share/GeoIP/
                    my files dated Dec 3 2019

                    Did it work ?

                    provelsP J M 3 Replies Last reply Reply Quote 0
                    • provelsP
                      provels @chudak
                      last edited by provels

                      @chudak Probably "working" in that it no longer throws the error. MaxMind updates their data first Tuesday of every month, but pfBNG doesn't until the following Thursday in case there's a delay. Check again on the 9th. If I'm incorrect please let me know.

                      Peder

                      MAIN - pfSense+ 24.11-RELEASE - Adlink MXE-5401, i7, 16 GB RAM, 64 GB SSD. 500 GB HDD for SyslogNG
                      BACKUP - pfSense+ 23.01-RELEASE - Hyper-V Virtual Machine, Gen 1, 2 v-CPUs, 3 GB RAM, 8GB VHDX (Dynamic)

                      chudakC 1 Reply Last reply Reply Quote 0
                      • chudakC
                        chudak @provels
                        last edited by

                        @provels
                        Will do, thx

                        1 Reply Last reply Reply Quote 0
                        • J
                          jdeloach @chudak
                          last edited by

                          @chudak said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                          @mcury said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                          I just updated, already put my license key and it's working.

                          How do you know it worked?

                          I am on pfBlockerNG-devel 2.2.5_28, added MaxMind License Key, ran update and reload, but when look at
                          ls -lah /usr/local/share/GeoIP/
                          my files dated Dec 3 2019

                          Did it work ?

                          You can run the following from the command prompt to see if it updates:
                          "php /usr/local/www/pfblockerng/pfblockerng.php dc", copy and paste without the quotes.

                          chudakC J 2 Replies Last reply Reply Quote 4
                          • M
                            mcury @chudak
                            last edited by

                            @chudak I'm using 2.4.4p3 with pfBlocker-NG-devel 2.2.5_28

                            Check if the files downloaded from maxmind are located at:

                            ls -lah /usr/local/share/GeoIP/

                            Check the logs during the maxmind download, as you can see, it downloaded a 4MB database file.

                            **Saving configuration [ 01/05/20 12:32:23 ]**

MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ...

Download Process Starting [ 01/05/20 12:32:24 ]
 /usr/local/share/GeoIP/GeoLite2-Country.tar.gz		200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip		200 OK
Download Process Ended [ 01/05/20 12:32:28 ]

Country code update Start
 Processing ISO IPv4 Continent/Country Data [ 01/05/20 12:32:31 ]
 Processing ISO IPv6 Continent/Country Data [ 01/05/20 12:33:08 ]
 Creating pfBlockerNG Continent PHP files
 IPv4 Africa			 [ 01/05/20 12:33:18 ]
 IPv6 Africa			 [ 01/05/20 12:33:19 ]
 IPv4 Antarctica		
 IPv6 Antarctica		
 IPv4 Asia			
 IPv6 Asia			 [ 01/05/20 12:33:22 ]
 IPv4 Europe			 [ 01/05/20 12:33:23 ]
 IPv6 Europe			 [ 01/05/20 12:33:33 ]
 IPv4 North America		 [ 01/05/20 12:33:35 ]
 IPv6 North America		 [ 01/05/20 12:33:42 ]
 IPv4 Oceania			 [ 01/05/20 12:33:44 ]
 IPv6 Oceania			
 IPv4 South America		
 IPv6 South America		 [ 01/05/20 12:33:45 ]
 IPv4 Proxy and Satellite	 [ 01/05/20 12:33:46 ]
 IPv6 Proxy and Satellite	
 IPv4 Top Spammers		
 IPv6 Top Spammers		
 pfBlockerNG Reputation Tab
Country Code Update Ended

                            dead on arrival, nowhere to be found.

                            1 Reply Last reply Reply Quote 1
                            • chudakC
                              chudak @jdeloach
                              last edited by

                              @jdeloach said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                              @chudak said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                              @mcury said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                              I just updated, already put my license key and it's working.

                              How do you know it worked?

                              I am on pfBlockerNG-devel 2.2.5_28, added MaxMind License Key, ran update and reload, but when look at
                              ls -lah /usr/local/share/GeoIP/
                              my files dated Dec 3 2019

                              Did it work ?

                              You can run the following from the command prompt to see if it updates:
                              "php /usr/local/www/pfblockerng/pfblockerng.php dc", copy and paste without the quotes.

                              yup that worked, thx !

                              1 Reply Last reply Reply Quote 0
                              • S
                                SteveITS Galactic Empire
                                last edited by

                                @BBcan177 , on pfBlockerNG, v2.1.4_20, it looks like if I open the plugin page (Firewall/pfBlockerNG) the MaxMind License Key field is blank. maxmind_key is populated in the saved config file, which I saved after entering it...I'm thinking maybe it's not populating correctly on the page?

                                (saw your comment about upgrading/moving to -devel in all cases, just haven't gotten to that yet)

                                Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
                                When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
                                Upvote 👍 helpful posts!

                                S 1 Reply Last reply Reply Quote 0
                                • J
                                  jan.kerstan @jdeloach
                                  last edited by

                                  @jdeloach said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                                  You can run the following from the command prompt to see if it updates:
                                  "php /usr/local/www/pfblockerng/pfblockerng.php dc", copy and paste without the quotes.

                                  confirmed: running 2.4.4-RELEASE-p3 -> pfBlockerNG 2.1.4_20 (updated, paste the MaxMind "License Key") worked!

                                  Thank you very much!

                                  1 Reply Last reply Reply Quote 0
                                  • stephenw10S
                                    stephenw10 Netgate Administrator
                                    last edited by stephenw10

                                    I'll just add that I updated the package, filled in the key and ran an update. All went smoothly. 👍

                                    Steve

                                    1 Reply Last reply Reply Quote 0
                                    • B
                                      bjurkovski @dougs
                                      last edited by

                                      @dougs said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                                      @BBcan177
                                      Uninstalled pfBlockerNG and installed pfBlockerNG-devel 2.2.5_28. Ran update as follows:

                                       UPDATE PROCESS START [ 01/02/20 16:36:16 ]

===[  DNSBL Process  ]================================================

Saving DNSBL database... completed

Clearing all DNSBL Feeds completed
Reloading Unbound Resolver..... completed
DNSBL update [ 0 | PASSED  ]... completed
------------------------------------------------------------------------

===[  GeoIP Process  ]============================================

MaxMind Database downloading and processing ( approx 4MB ) ... Please wait ...

Download Process Starting [ 01/02/20 16:36:16 ]
 /usr/local/share/GeoIP/GeoLite2-Country.tar.gz		200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip		200 OK
Download Process Ended [ 01/02/20 16:36:17 ]

Country code update Start
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 01/02/20 16:36:23 ]
 Creating pfBlockerNG Continent PHP files
 IPv4 Africa			 [ 01/02/20 16:36:24 ]
 IPv6 Africa			 [ 01/02/20 16:36:25 ]
 IPv4 Antarctica		
 IPv6 Antarctica		
 IPv4 Asia			
 IPv6 Asia			
 IPv4 Europe			
 IPv6 Europe			 [ 01/02/20 16:36:27 ]
 IPv4 North America		
 IPv6 North America		 [ 01/02/20 16:36:28 ]
 IPv4 Oceania			
 IPv6 Oceania			 [ 01/02/20 16:36:29 ]
 IPv4 South America		
 IPv6 South America		
 IPv4 Proxy and Satellite	
 IPv6 Proxy and Satellite	
 IPv4 Top Spammers		
 IPv6 Top Spammers		
 pfBlockerNG Reputation Tab
Country Code Update Ended



===[  IPv4 Process  ]=================================================

[ DNSBLIP_v4 ]			 Downloading update [ 01/02/20 16:36:29 ] .
[ DNSBLIP_v4 ] file_get_contents(/var/db/pfblockerng/DNSBLIP_v4.txt): failed to open stream: No such file or directory


 [ pfB_DNSBLIP_v4 - DNSBLIP_v4 ] Download FAIL
   Local File Failure


The Following List has been REMOVED [ DNSBLIP_v4 ]


===[  Aliastables / Rules  ]==========================================

No changes to Firewall rules, skipping Filter Reload
No Changes to Aliases, Skipping pfctl Update

 UPDATE PROCESS ENDED

                                      Looks like an error with DNSBLIP?

                                      ~Doug

                                      Having the same issue

                                      fireodoF 1 Reply Last reply Reply Quote 0
                                      • fireodoF
                                        fireodo @bjurkovski
                                        last edited by

                                        @bjurkovski said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                                        @dougs said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                                        @BBcan177
                                        Uninstalled pfBlockerNG and installed pfBlockerNG-devel 2.2.5_28. Ran update as follows:

                                        Looks like an error with DNSBLIP?

                                        ~Doug

                                        Having the same issue

                                        Maybe an Force Update can help?
                                        Something else - I switched from pfblockerng to pfblockerng-devel an there is a increase of RAM usage from about 13% - is it also in your case?

                                        Thanks,
                                        fireodo

                                        Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                        SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                        pfsense 2.7.2 CE
                                        Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                                        1 Reply Last reply Reply Quote 0
                                        • S
                                          SteveITS Galactic Empire @SteveITS
                                          last edited by SteveITS

                                          @teamits said in pfBlockerNG MaxMind Registration required to continue to use the GeoIP functionality!:

                                          @BBcan177 , on pfBlockerNG, v2.1.4_20, it looks like if I open the plugin page (Firewall/pfBlockerNG) the MaxMind License Key field is blank. maxmind_key is populated in the saved config file, which I saved after entering it

                                          I checked several times yesterday and the field had the key in it each time I logged in. On a hunch waited until overnight again, and this morning the field is blank in the GUI. Seems so unlikely but is there some way it could disappear overnight? If I export the config file this morning it's missing, compared to my last export 3 days ago:

                                          <enable_log/>
                                          <skipfeed>0</skipfeed>
                                          <log_maxlines>20000</log_maxlines>
                                          <maxmind_key>****</maxmind_key>
                                          <maxmind_locale>en</maxmind_locale>
                                          <database_cc/>
                                          <inbound_interface>wan</inbound_interface>

                                          vs

                                          <enable_log/>
                                          <maxmind_locale>en</maxmind_locale>
                                          <database_cc/>
                                          <skipfeed>0</skipfeed>
                                          <log_maxlines>20000</log_maxlines>
                                          <inbound_interface>wan</inbound_interface>

                                          FWIW this is on an SG-4860 and it hasn't restarted in months.

                                          Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
                                          When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
                                          Upvote 👍 helpful posts!

                                          1 Reply Last reply Reply Quote 0
                                          • M
                                            MarcO42
                                            last edited by

                                            Hi,
                                            just a quiston: If Idon't want to use GeoIP and set "Disable MaxMind CSV database Updates" checkbox I'm already get an notification every hour that "MaxMind need a license". Is there a way to block this spam without disabling the notification or uninistalling pfBlockerNG?
                                            Cheers
                                            Marco

                                            BBcan177B 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.