Some popular lists not loading



  • Hello,

    The following lists generate the error "No Domains Found! Ensure only domain based Feeds are used for DNSBL!"

    All disconnect lists (ADD_Me_ADs , ADD_Me_Tracking, D_Me_Malv). Flexget is activated and s3.amazonaws.com is added to the DNSBL Whitelist. The lists are accessible from a PC behind the firewall. It looks normal to me.

    The BBC_DC2 list has the same issues. Not blocked when accessed from a PC that 'uses' pfBlockerNG but the same error messages.

    https://osint.bambenekconsulting.com/feeds/c2-dommasterlist-high.txt

    What am I doing wrong please?

    Thanks.


  • Moderator

    @Koent
    Download the latest version of pfBlockerNG-devel and try again



  • Hello,

    I'm currently running 2.2.5_25. Should I do something special to get a more recent version please?

    Thanks.


  • Moderator

    That is the latest version.

    I check all D_ME feeds, and this is the only one that is empty at the moment:
    https://s3.amazonaws.com/lists.disconnect.me/simple_malware.txt

    Add this to the DNSBL Whitelist, and Force reload - DNSBL:

    .s3.amazonaws.com
    


  • Thanks for your help. I did as you instructed but it seems to make no difference.
    When the URL's of the lists are pasted in a browser, I can see the content of the list without a problem.

    The state of the lists are "flex", and not "on" to avoid SSL issues. No idea if that is significant.

    This is an extract of the update process:

    UPDATE PROCESS START [ 09/21/19 18:47:57 ]

    ===[ DNSBL Process ]================================================

    Loading DNSBL Statistics... completed
    Loading DNSBL Whitelist... completed

    [ ADD_Me_ADs ] Reload [ 09/21/19 18:48:18 ] . completed .
    No Domains Found! Ensure only domain based Feeds are used for DNSBL!

    [ ADD_Me_Tracking ] Reload . completed .
    No Domains Found! Ensure only domain based Feeds are used for DNSBL!

    ********[ ADEasylist ] Reload . completed ..
    Whitelist: affiliationjs.s3.amazonaws.com|airpushmarketing.s3.amazonaws.com|blamads-assets.s3.amazonaws.com|epowernetworktrackerimages.s3.amazonaws.com|gateways.s3.amazonaws.com|gfaf-banners.s3.amazonaws.com|kbnetworkz.s3.amazonaws.com|leaddyno-client-images.s3.amazonaws.com|secretmedia.s3.amazonaws.com|smblock.s3.amazonaws.com|stuff-nzwhistleout.s3.amazonaws.com|whistleout.s3.amazonaws.com|

    Orig. Unique # Dups # White # TOP1M Final

    1612 1612 159 12 0 1441

    [ D_Me_Malv ] Reload [ 09/21/19 18:48:34 ] . completed .
    No Domains Found! Ensure only domain based Feeds are used for DNSBL!

    [ ISC_SDH ] Reload . completed ..

    Orig. Unique # Dups # White # TOP1M Final

    19 19 19 0 0 0



  • OK. This is weird. I created a new category and copied the URL's manually. They loaded without problems.

    [ TSsimpletracking ] Downloading update .. 200 OK.

    Orig. Unique # Dups # White # TOP1M Final

    34 34 33 0 0 1

    I went back to the original categories, deleted the lists, saved and recreated them the same but changed the list abbreviation.
    Now they load without problems.

    I have no idea what happened but it seems solved. I have no idea how I could recreate the issue, unfortunately.


  • Moderator

    @Koent
    When you run a "Reload" it uses the previously downloaded feed if it was previously downloaded.
    Goto the Log Tab, view the file in the "dnsbl" folder, and delete it, then run a Force Reload/Update


Log in to reply