Update lists fail

BBcan177 · May 12, 2018, 2:13 PM

a```
host -t A geolite.maxmind.com
returns```
geolite.maxmind.com has address 10.10.10.1
If I disable DNSBL I get
host -t A geolite.maxmind.com
geolite.maxmind.com has address 104.16.38.47
geolite.maxmind.com has address 104.16.37.47
I added .geolite.maxmind.com to the Custom Domain Whitelist in DNSBL, but nothing changes, still I get the ip of the VIP, instead op 104.16.etc.

When you manually add a domain or an IP to a whitelist, you need to run a Reload to get it to apply the change or wait until the next cron run to execute… Alternatively, when you whitelist from the Alerts Tab, the whitelist/suppression will take effect immediately.

Qinn · May 12, 2018, 2:32 PM

Thanks yeah I was pulling my hair ;) After I added it to the whitelist, I did a "Select 'Reload' option" All and hit run got a "exists" in return. Then I realized it and a reload solved it.

Now

host -t A geolite.maxmind.com
geolite.maxmind.com has address 104.16.37.47
geolite.maxmind.com has address 104.16.38.47

Now I works, btw I can do a manual update of MaxMind, but when will pfblockerNG do it automatically?

Thanks BBCan177 I hope everything it going well with the next major release, thumbs up!!

BBcan177 · May 12, 2018, 2:39 PM

@Qinn:

Thanks yeah I was pulling my hair ;) After I added it to the whitelist, I did a "Select 'Reload' option" All and hit run got a "exists" in return. Then I realized it and a reload solved it.

Now
host -t A geolite.maxmind.com
geolite.maxmind.com has address 104.16.37.47
geolite.maxmind.com has address 104.16.38.47
Now I works, btw I can do a manual update of MaxMind, but when will pfblockerNG do it automatically?

Thanks BBCan177 I hope everything it going well with the next major release, thumbs up!!

MaxMind is updated once per month. You will see the cron task in pfSense for that…

Thanks! Its been submitted and awaiting review by the devs...

Qinn · May 12, 2018, 2:55 PM

Thanks, did a manual update and worked like a charm.

 php -f /usr/local/www/pfblockerng/pfblockerng.php dc
Country code update Start
 Converting MaxMind Country databases for pfBlockerNG.
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 05/12/18 16:45:27 ]
 Creating pfBlockerNG Continent XML files
 IPv4 Africa                     [ 05/12/18 16:45:48 ]
 IPv6 Africa                     [ 05/12/18 16:45:49 ]
 IPv4 Antarctica                 [ 05/12/18 16:45:50 ]
 IPv6 Antarctica
 IPv4 Asia
 IPv6 Asia                       [ 05/12/18 16:45:59 ]
 IPv4 Europe                     [ 05/12/18 16:46:01 ]
 IPv6 Europe                     [ 05/12/18 16:46:30 ]
 IPv4 North America              [ 05/12/18 16:46:40 ]
 IPv6 North America              [ 05/12/18 16:47:01 ]
 IPv4 Oceania                    [ 05/12/18 16:47:04 ]
 IPv6 Oceania                    [ 05/12/18 16:47:06 ]
 IPv4 South America
 IPv6 South America              [ 05/12/18 16:47:08 ]
 IPv4 Proxy and Satellite        [ 05/12/18 16:47:10 ]
 IPv6 Proxy and Satellite
 IPv4 TOP 20
 IPv6 TOP 20
 pfBlockerNG Reputation Tab
Country Code Update Ended [ 05/12/18 16:47:11 ]

[2.4.3-RELEASE][root@pfSense.localdomain]/root:

Just to be sure I added the MaxMind IP's to my IPV4 whitelist also.

Qinn · May 20, 2018, 4:11 PM

@BBcan177:

MaxMind is updated once per month. You will see the cron task in pfSense for that…

I did a```
crontab -l


Cheers Qinn

RonpfS · May 20, 2018, 4:26 PM

Did you leave MaxMind Updates unticked ?

There is a Cron package you can install ;)

The job run from 4th to 10th of the month

/usr/local/bin/php /usr/local/www/pfblockerng/pfblockerng.php dcc >> /var/log/pfblockerng/extras.log 2>&1

Qinn · May 21, 2018, 1:31 PM

@RonpfS:

Did you leave MaxMind Updates unticked ?

There is a Cron package you can install ;)

The job run from 4th to 10th of the month
/usr/local/bin/php /usr/local/www/pfblockerng/pfblockerng.php dcc >> /var/log/pfblockerng/extras.log 2>&1

Thanks for you reply RonpfS. Nope I haven't disabled it, I just thought a```
crontab -l

RonpfS · May 21, 2018, 5:14 PM

On my system I get :

crontab -l

crontab: no crontab for root
```  :o

Qinn · May 22, 2018, 3:13 PM

So what does the MaxMind updates trigger?

Qinn · Jun 5, 2018, 4:09 PM

@qinn Is there a way to check when the next update of MaxMind will run?

RonpfS · Jun 5, 2018, 4:09 PM

@qinn You can check /var/log/pfblockerng/extras.log to see when the last update was done.

Qinn · Jun 5, 2018, 4:31 PM

Thanks, nice overview btw of the last 2 years, seems I have to wait for 11 juni (when updating comes once a month)

Qinn · Jun 22, 2018, 3:43 PM

Hmm it's been well over a month and as from what it looks in the dashboard MaxMind isn't updated, I looked in

cat /var/log/pfblockerng/extras.log

and it reads:

Download Process Starting [ 06/05/18 07:00:00 ]
 /usr/local/share/GeoIP/GeoIP.dat.gz            200 OK
 /usr/local/share/GeoIP/GeoIPv6.dat.gz          200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip                200 OK
 /var/db/pfblockerng/top-1m.csv.zip             200 OK
Download Process Ended [ 06/05/18 07:00:28 ]

Country code update Start
 Converting MaxMind Country databases for pfBlockerNG.
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 06/05/18 07:01:46 ]
 Creating pfBlockerNG Continent XML files
 IPv4 Africa                     [ 06/05/18 07:02:07 ]
 IPv6 Africa                     [ 06/05/18 07:02:08 ]
 IPv4 Antarctica
 IPv6 Antarctica
 IPv4 Asia
 IPv6 Asia                       [ 06/05/18 07:02:17 ]
 IPv4 Europe                     [ 06/05/18 07:02:19 ]
 IPv6 Europe                     [ 06/05/18 07:02:48 ]
 IPv4 North America              [ 06/05/18 07:02:58 ]
 IPv6 North America              [ 06/05/18 07:03:19 ]
 IPv4 Oceania                    [ 06/05/18 07:03:22 ]
 IPv6 Oceania                    [ 06/05/18 07:03:24 ]
 IPv4 South America
 IPv6 South America              [ 06/05/18 07:03:26 ]
 IPv4 Proxy and Satellite        [ 06/05/18 07:03:28 ]
 IPv6 Proxy and Satellite
 IPv4 TOP 20
 IPv6 TOP 20
 pfBlockerNG Reputation Tab
Country Code Update Ended [ 06/05/18 07:03:29 ]

So it confirms that the last one, was the one I did manually, what goes wrong, why doesn't it update automatically once a month?

Thnx for any advise

Cheers Qinn

RonpfS · Jun 22, 2018, 5:24 PM

@qinn said in Update lists fail:

was the one I did manually, what goes wrong

Nothing is wrong for now. You did a manual update on June 5th. The next automatic update will be done by Cron between the 4th and the 10th of July.

BTW my last update was on 06/07/18, but the version is from May 1st

/var/log/pfblockerng/maxmind_ver

MaxMind GeoLite2 Date/Time Stamp
Last-Modified: Tue, 01 May 2018 16:48:16 GMT
Duplicate Represented IP4 Networks: 36994

Qinn · Jun 23, 2018, 8:04 AM

Thanks for you reply, always helpful, but I have to say nope. I hoped that to, but 10/15/16 08:20:12 (as you can see below) isn't possible so it's dd-mm-yy, so there is something wrong...


Download Process Starting [ 10/15/16 08:18:03 ]
 /usr/local/share/GeoIP/GeoIP.dat.gz            200 OK
 /usr/local/share/GeoIP/GeoIPv6.dat.gz          200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip                200 OK
 /var/db/pfblockerng/top-1m.csv.zip             200 OK
Download Process Ended [ 10/15/16 08:18:40 ]

Country code update Start
 Converting MaxMind Country databases for pfBlockerNG.
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 10/15/16 08:19:49 ]
 Creating pfBlockerNG Continent XML files
 IPv4 Africa                     [ 10/15/16 08:20:03 ]
 IPv6 Africa                     [ 10/15/16 08:20:04 ]
 IPv4 Antarctica
 IPv6 Antarctica
 IPv4 Asia
 IPv6 Asia                       [ 10/15/16 08:20:12 ]
 IPv4 Europe                     [ 10/15/16 08:20:14 ]
 IPv6 Europe                     [ 10/15/16 08:20:40 ]
 IPv4 North America              [ 10/15/16 08:20:45 ]
 IPv6 North America              [ 10/15/16 08:21:02 ]
 IPv4 Oceania                    [ 10/15/16 08:21:05 ]
 IPv6 Oceania                    [ 10/15/16 08:21:07 ]
 IPv4 South America
 IPv6 South America              [ 10/15/16 08:21:09 ]
 IPv4 Proxy and Satellite        [ 10/15/16 08:21:10 ]
 IPv6 Proxy and Satellite
 IPv4 TOP 20
 IPv6 TOP 20                     [ 10/15/16 08:21:11 ]
 pfBlockerNG Reputation Tab
Country Code Update Ended


 Download Process Starting [ 05/12/18 16:43:36 ]
 /usr/local/share/GeoIP/GeoIP.dat.gz            200 OK
 /usr/local/share/GeoIP/GeoIPv6.dat.gz          200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip                200 OK
 /var/db/pfblockerng/top-1m.csv.zip             200 OK
Download Process Ended [ 05/12/18 16:44:09 ]

Country code update Start
 Converting MaxMind Country databases for pfBlockerNG.
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 05/12/18 16:45:27 ]
 Creating pfBlockerNG Continent XML files
 IPv4 Africa                     [ 05/12/18 16:45:48 ]
 IPv6 Africa                     [ 05/12/18 16:45:49 ]
 IPv4 Antarctica                 [ 05/12/18 16:45:50 ]
 IPv6 Antarctica
 IPv4 Asia
 IPv6 Asia                       [ 05/12/18 16:45:59 ]
 IPv4 Europe                     [ 05/12/18 16:46:01 ]
 IPv6 Europe                     [ 05/12/18 16:46:30 ]
 IPv4 North America              [ 05/12/18 16:46:40 ]
 IPv6 North America              [ 05/12/18 16:47:01 ]
 IPv4 Oceania                    [ 05/12/18 16:47:04 ]
 IPv6 Oceania                    [ 05/12/18 16:47:06 ]
 IPv4 South America
 IPv6 South America              [ 05/12/18 16:47:08 ]
 IPv4 Proxy and Satellite        [ 05/12/18 16:47:10 ]
 IPv6 Proxy and Satellite
 IPv4 TOP 20
 IPv6 TOP 20
 pfBlockerNG Reputation Tab
Country Code Update Ended [ 05/12/18 16:47:11 ]


Download Process Starting [ 06/05/18 07:00:00 ]
 /usr/local/share/GeoIP/GeoIP.dat.gz            200 OK
 /usr/local/share/GeoIP/GeoIPv6.dat.gz          200 OK
 /usr/local/share/GeoIP/GeoLite2-Country-CSV.zip                200 OK
 /var/db/pfblockerng/top-1m.csv.zip             200 OK
Download Process Ended [ 06/05/18 07:00:28 ]

Country code update Start
 Converting MaxMind Country databases for pfBlockerNG.
 Processing ISO IPv4 Continent/Country Data
 Processing ISO IPv6 Continent/Country Data [ 06/05/18 07:01:46 ]
 Creating pfBlockerNG Continent XML files
 IPv4 Africa                     [ 06/05/18 07:02:07 ]
 IPv6 Africa                     [ 06/05/18 07:02:08 ]
 IPv4 Antarctica
 IPv6 Antarctica
 IPv4 Asia
 IPv6 Asia                       [ 06/05/18 07:02:17 ]
 IPv4 Europe                     [ 06/05/18 07:02:19 ]
 IPv6 Europe                     [ 06/05/18 07:02:48 ]
 IPv4 North America              [ 06/05/18 07:02:58 ]
 IPv6 North America              [ 06/05/18 07:03:19 ]
 IPv4 Oceania                    [ 06/05/18 07:03:22 ]
 IPv6 Oceania                    [ 06/05/18 07:03:24 ]
 IPv4 South America
 IPv6 South America              [ 06/05/18 07:03:26 ]
 IPv4 Proxy and Satellite        [ 06/05/18 07:03:28 ]
 IPv6 Proxy and Satellite
 IPv4 TOP 20
 IPv6 TOP 20
 pfBlockerNG Reputation Tab
Country Code Update Ended [ 06/05/18 07:03:29 ]

RonpfS · Jun 23, 2018, 9:04 AM

@qinn said in Update lists fail:

so it’s dd-mm-yy,

The date is in mm-dd-yy format.

Qinn · Jun 24, 2018, 8:28 AM

@ronpfs please take a look at the logging in extras.log above and below, that can't be as there is no 15 month ...

Download Process Ended [ 10/15/16 08:18:40 ]

RonpfS · Jun 24, 2018, 3:52 PM

@qinn And you care about 2016 events ?

Qinn · Jun 25, 2018, 7:12 AM

@ronpfs ROFL ;)

Qinn · Jul 25, 2018, 8:28 AM

Somehow this won't go away, last Maxmind is 7 june and still pfBlockerNG did not update it. Is there anyway to restore the "automatic updates" or do I have to remove and reinstall the package?