DSNBL out of sync
-
Hi Folks,
i am having this issue since month and in the meantime there were 3 updates.
Still this message appears on the dashboard.
Is it just a notification bug or is there something i can change?Spec:
pfsense: 2.4.5-RELEASE-p1 (amd64)
built on Tue Jun 02 17:51:17 EDT 2020
FreeBSD 11.3-STABLEpfBlockerNG-devel 3.0.0_3
did start - stop, reload/update of everything....
Any Idea?Short Log:
TLD finalize... completed [ 12/07/20 14:34:36 ] Saving DNSBL statistics... completed [ 12/07/20 14:34:37 ] Resolver Live Sync analysis... completed [ 12/07/20 14:34:43 ] Resolver Live Sync finalizing: Remove local-zone(s): removed 1 zones Remove local-data(s): no changes Add local-zone(s): added 756 zones Add local-data(s): added 36 datas *** DNSBL update [ 1111110 ] [ 1111129 ] ... OUT OF SYNC ! *** [ 12/07/20 14:34:46 ]Long one:
UPDATE PROCESS START [ v3.0.0_3 ] [ 12/07/20 14:29:26 ] ===[ DNSBL Process ]================================================ Loading DNSBL Statistics... completed Loading DNSBL SafeSearch... enabled Loading DNSBL Whitelist... completed [ Shallalist_adv ] Reload . completed .. IPv4 count=4386 [ Shallalist_spyware ] Reload . completed .. IPv4 count=1335 [ UT1_ddos ] Reload . completed .. [ UT1_dialer ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ UT1_malware ] Reload . completed .. Whitelist: many entries, removed them IPv4 count=127646 [ UT1_phishing ] Reload [ 12/07/20 14:29:29 ] . completed .. - IPv4 count=127646 [ UT1_publicite ] Reload [ 12/07/20 14:29:31 ] . completed .. IPv4 count=74 [ adaway ] Reload [ 12/07/20 14:29:32 ] . completed .. [ BBcan177 ] Reload . completed .. IPv4 count=3 [ Cameleon ] Reload . completed .. [ D_Me_ADs ] Reload [ 12/07/20 14:29:33 ] . completed .. [ D_Me_Tracking ] Reload . completed .. [ Steven ] Reload [ 12/07/20 14:29:34 ] . completed .. [ ublock1 ] Reload [ 12/07/20 14:29:35 ] . completed . IDN converted: [ ||rołex.com^$document ] [ xn--||roex-6db.com^$document ] IDN converted: [ ||š427.biz^$all ] [ xn--||427-wdb.biz^$all ]. [ ublock2 ] Reload . completed .. [ ublock3 ] Reload . completed .. [ Yoyo ] Reload [ 12/07/20 14:29:36 ] . completed .. [ Zeustracker ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ EasyList ] Reload . completed .. IPv4 count=1 [ EasyList_Adware ] Reload [ 12/07/20 14:29:37 ] . completed .. [ EasyList_German ] Reload . completed .. [ EasyPrivacy ] Reload . completed .. [ Abuse_DOMBL ] Reload [ 12/07/20 14:29:38 ] . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ Abuse_URLBL ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ Abuse_Zeus_BD ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ BBC_DC2 ] Reload . completed .. [ ISC_SDL ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ MDL ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ MDS ] Reload . completed .. Whitelist: many entries, removed them| [ MDS_Immortal ] Reload [ 12/07/20 14:29:39 ] . completed .. [ MVPS ] Reload [ 12/07/20 14:29:40 ] . completed .. [ SFS_Toxic_BD ] Reload . completed .. [ Spam404 ] Reload [ 12/07/20 14:29:41 ] . completed .. [ SWC ] Reload . completed .. [ CoinBlocker_All ] Reload [ 12/07/20 14:29:42 ] . completed .. [ CoinBlocker_Opt ] Reload [ 12/07/20 14:29:43 ] . completed .. [ MoneroMiner ] Reload [ 12/07/20 14:29:44 ] . completed .. [ NoCoin ] Reload . completed .. [ Botvrij_Dom ] Reload [ 12/07/20 14:29:45 ] . completed .. [ CCT_BD ] Reload [ 12/07/20 14:29:46 ] . completed . IDN converted: [ дольщикиспб.рф ] [ xn--90afmajeumr0f6a.xn--p1ai ] IDN converted: [ шляхтен.рф ] [ xn--e1alhsoq4c.xn--p1ai ]. Whitelist: many entries, removed them IPv4 count=2849 [ EladKarako_BD ] Reload . completed .. [ HostsFile_BD ] Reload [ 12/07/20 14:30:13 ] . completed .. Whitelist: many entries, removed them [ JL_BD ] Reload [ 12/07/20 14:30:16 ] . completed .. [ Joewein_base ] Reload [ 12/07/20 14:30:20 ] . completed .. IPv4 count=78 [ Joewein_new ] Reload [ 12/07/20 14:30:23 ] . completed .. [ KAD_BD ] Reload [ 12/07/20 14:30:26 ] . completed .. [ Krog_BD ] Reload [ 12/07/20 14:30:29 ] . completed .. [ Magento ] Reload [ 12/07/20 14:30:32 ] . completed .. [ Malc0de ] Reload [ 12/07/20 14:30:35 ] . completed .. [ MOAB_BD ] Reload [ 12/07/20 14:30:37 ] . completed .. [ Piwik_Spam ] Reload [ 12/07/20 14:30:41 ] . completed .. [ Ponmocup ] Reload [ 12/07/20 14:30:44 ] . completed .. [ Quidsup_Mal ] Reload [ 12/07/20 14:30:47 ] . completed .. [ Quidsup_Trackers ] Reload [ 12/07/20 14:30:50 ] . completed .. [ StevenBlack_BD ] Reload [ 12/07/20 14:30:53 ] . completed .. [ VXVault ] Reload [ 12/07/20 14:30:55 ] . completed .. IPv4 count=17 [ Yhonay_BD ] Reload [ 12/07/20 14:30:58 ] . completed .. [ yHosts ] Reload [ 12/07/20 14:31:01 ] . completed .. [ CIArmy ] Reload [ 12/07/20 14:31:04 ] . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ DShield ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ Ransomware ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ Tor ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ HPHost ] Reload . completed . No Domains Found! Ensure only domain based Feeds are used for DNSBL! [ openphish ] Reload . completed .. Whitelist: wemmmoooppweewmemfdmdw.duckdns.org| IPv4 count=10 ------------------------------------------------------------------------ Assembling DNSBL database...... completed [ 12/07/20 14:31:10 ] TLD: Blocking full TLD/Sub-Domain(s)... many entries, removed them completed TLD analysis........................ completed [ 12/07/20 14:32:03 ] TLD finalize.................................................................. ---------------------------------------- Original Matches Removed Final ---------------------------------------- 2281516 909268 1170406 1111110 ----------------------------------------- TLD finalize... completed [ 12/07/20 14:34:36 ] Saving DNSBL statistics... completed [ 12/07/20 14:34:37 ] Resolver Live Sync analysis... completed [ 12/07/20 14:34:43 ] Resolver Live Sync finalizing: Remove local-zone(s): removed 1 zones Remove local-data(s): no changes Add local-zone(s): added 756 zones Add local-data(s): added 36 datas *** DNSBL update [ 1111110 ] [ 1111129 ] ... OUT OF SYNC ! *** [ 12/07/20 14:34:46 ] ------------------------------------------------------------------------ ===[ FINAL Processing ]===================================== [ Original IP count ] [ 1289032 ] [ Final IP Count ] [ 145535 ] ====================[ DNSBL Last Updated List Summary ]============== Jul 31 2015 D_Me_Tracking Mar 18 2018 Cameleon Apr 20 2018 HostsFile_BD Mar 13 2019 BBcan177 Apr 16 2019 Spam404 Apr 16 2019 MoneroMiner Aug 22 2019 Zeustracker Aug 22 2019 Abuse_Zeus_BD Oct 10 2019 Magento Oct 22 2019 MDS_Immortal Dec 9 2019 Abuse_DOMBL Dec 9 2019 Abuse_URLBL Dec 9 2019 Ransomware Dec 16 2019 Malc0de Feb 1 2020 D_Me_ADs Mar 19 2020 NoCoin Apr 21 2020 yHosts Apr 28 2020 Yhonay_BD Jul 28 23:32 BBC_DC2 Aug 14 00:35 MDS Oct 7 00:00 EasyList_Adware Oct 25 05:33 MVPS Nov 6 13:09 CoinBlocker_All Nov 6 13:09 CoinBlocker_Opt Nov 12 23:17 MDL Nov 12 23:17 HPHost Nov 14 00:03 JL_BD Nov 19 00:03 ublock3 Nov 23 00:04 StevenBlack_BD Nov 25 00:03 EladKarako_BD Dec 1 00:03 Piwik_Spam Dec 1 19:24 MOAB_BD Dec 3 00:04 Steven Dec 3 00:04 CCT_BD Dec 3 17:07 Botvrij_Dom Dec 3 18:20 adaway Dec 4 02:58 ISC_SDL Dec 4 11:14 Yoyo Dec 5 02:47 SWC Dec 6 00:04 Krog_BD Dec 6 13:00 openphish Dec 6 17:31 Joewein_base Dec 6 18:20 EasyList_German Dec 6 21:27 Ponmocup Dec 6 22:09 Joewein_new Dec 6 22:19 Shallalist_adv Dec 6 22:19 Shallalist_spyware Dec 6 22:19 UT1_ddos Dec 6 22:19 UT1_dialer Dec 6 22:19 UT1_malware Dec 6 22:19 UT1_phishing Dec 6 22:19 UT1_publicite Dec 6 23:04 CIArmy Dec 7 00:00 SFS_Toxic_BD Dec 7 00:00 DShield Dec 7 00:01 EasyList Dec 7 00:01 Tor Dec 7 00:01 EasyPrivacy Dec 7 00:03 ublock1 Dec 7 00:03 ublock2 Dec 7 00:03 KAD_BD Dec 7 00:03 Quidsup_Mal Dec 7 00:03 Quidsup_Trackers Dec 7 00:03 VXVault =============================================================== Database Sanity check [ PASSED ] ------------------------ Masterfile/Deny folder uniq check Deny folder/Masterfile uniq check 109.236.91.85 82.165.35.17 Sync check (Pass=No IPs reported) ---------- Alias table IP Counts ----------------------------- 277242 total 61231 /var/db/aliastables/pfB_Top_v4.txt 41493 /var/db/aliastables/pfB_Europe_v6.txt 39925 /var/db/aliastables/pfB_Top_v6.txt 19564 /var/db/aliastables/pfB_NAmerica_v6.txt 19430 /var/db/aliastables/pfB_Europe_v4.txt 15493 /var/db/aliastables/pfB_Asia_v6.txt 15016 /var/db/aliastables/pfB_NAmerica_v4.txt 14472 /var/db/aliastables/pfB_Asia_v4.txt 11025 /var/db/aliastables/pfB_SAmerica_v6.txt 10515 /var/db/aliastables/pfB_WindowsSpyBlockerIP_v4.txt 8841 /var/db/aliastables/pfB_Africa_v4.txt 7086 /var/db/aliastables/pfB_Oceania_v4.txt 4791 /var/db/aliastables/pfB_DNSBLIP_v4.txt 2498 /var/db/aliastables/pfB_Oceania_v6.txt 1710 /var/db/aliastables/pfB_TOR_v4.txt 1555 /var/db/aliastables/pfB_Africa_v6.txt 1002 /var/db/aliastables/pfB_PRI2_v4.txt 537 /var/db/aliastables/pfB_SAmerica_v4.txt 366 /var/db/aliastables/pfB_PRI3_v4.txt 223 /var/db/aliastables/pfB_PRI1_v4.txt 126 /var/db/aliastables/pfB_PRI4_v4.txt 122 /var/db/aliastables/pfB_Antarctica_v6.txt 76 /var/db/aliastables/pfB_PS_v4.txt 65 /var/db/aliastables/pfB_BinaryDefense_v4.txt 54 /var/db/aliastables/pfB_Antarctica_v4.txt 15 /var/db/aliastables/pfB_BlockListDE_v4.txt 8 /var/db/aliastables/pfB_Abuse_PS_v4.txt 2 /var/db/aliastables/pfB_tutorial_v4.txt 1 /var/db/aliastables/pfB_PS_v6.txt pfSense Table Stats ------------------- table-entries hard limit 40000000 Table Usage Count 280265 UPDATE PROCESS ENDED [ 12/07/20 14:35:20 ] -
Ensure that the Feed Header names are unique.
Did you add Domains to the TLD Blacklist? -
@bbcan177
thanks for this, all feed names should be unique.yes, i do have tld blackliistings:
cdn2.spiegel.de cp.abbp1.com ads.google.com ads.web.de adserver.web.de analytics.google.com telemetry.microsoft.com wns.notify.windows.com.akadns.net v10-win.vortex.data.microsoft.com.akadns.net us.vortex-win.data.microsoft.com us-v10.events.data.microsoft.com urs.microsoft.com.nsatc.net watson.telemetry.microsoft.com watson.ppe.telemetry.microsoft.com vsgallery.com watson.live.com watson.microsoft.com telemetry.remoteapp.windowsazure.com telemetry.urs.microsoft.com cm party click link technology gdn study men biz reise stream events-dc1.gfe.nvidia.com elb-telemetry-prod-external-1332413525.us-west-2.elb.amazonaws.com telemetry.malwarebytes.com gateway.skyprod.akadns.net evoke-windowsservices-tas.msedge.net candycrushsoda.king.com www.bing.com/proactive win.data.microsoft.com/collect/v1 windowsupdate update.microsoft download.microsoft ws.microsoft ntservicepack.microsoft wustat.windows juniper.com juniper.net juniper.org juniper.de setup.icloud.com gspe21-ssl.ls.apple.com static.ess.apple.com init.itunes.apple.com gsp64-ssl.ls.apple.com secure.gravatar.comtld whitelist is empty
-
The TLD Blacklist is used to block whole TLDs, like "ru" or "xyz" etc...
Move the Domains that are there to a DNSBL Group customlist. All of the DNSBL Groups have a customlist at the bottom of the page. So you can add these domains to the applicable Group.
Click on the blue infoblock icon for the "TLD Blacklist/TLD Whitelist" for more details about that feature.
Follow that with a Force Reload-DNSBL
-
@bbcan177
that worked. thanks a lot.
Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.