• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

23.05.01 easylist not in dashboard widget [edit: not loading at all]

Scheduled Pinned Locked Moved pfBlockerNG
7 Posts 2 Posters 860 Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • C
    Cabledude
    last edited by Cabledude Aug 31, 2023, 5:52 AM Aug 31, 2023, 1:38 AM

    Hi all,
    pfBlockerNG-devel 3.2.0_6 on Netgate SG-1100. IP works, DNSBL works. But:
    DNSBL EasyList feed doesn't get listed in the dashboard widget.
    Steps:

    1. enable Ads (or any other) feed and force reload
    2. shows in dashboard widget
      4e3c32d2-2632-4653-bbcf-7c7df8961587-image.png
    3. enable EasyList and disable Ads (or whatever lists you have) - force reload
      0f163f48-2126-45ab-a293-235d9ac49afb-image.png
    4. check dashboard widget: still showing Ads_Basic, not EasyList. And it's showing the Ads count too.

    I can repeat this using other DNSBL feeds, such as Ads_Basic or Malicious, remove them until only EasyList is left enabled and the widget will always show the previous list, e.g. the list that was loaded before EasyList, not EasyList itself.

    1. When I try to provoke blocks by browsing sites such as google or other sites that I am 100% sure have blockable content, the blocked counter doesn't go up, so the list doesn't work.
    2. As soon as I load one of the other lists, the counter goes up immediately.

    I reinstalled pfBlocker (keep settings enabled) just to see what would happen. I got the following errors at package install. Especially the python error seems troubling, but I'm not sure if these are bad.

    Custom commands completed ... done.
    Executing custom_php_resync_config_command()...cat: /var/db/pfblockerng/dnsbl/*.txt: No such file or directory
    done.
    Menu items... done.
    Services... done.
    Writing configuration... done.
    =====
    Message from py311-setuptools-63.1.0:
    
    --
    Only /usr/local/bin/easy_install-3.11 script has been installed
      since Python 3.11 is not the default Python version.
    =====
    Message from grepcidr-2.0:
    
    --
    ===>   NOTICE:
    
    The grepcidr port currently does not have a maintainer. As a result, it is
    more likely to have unresolved issues, not be up-to-date, or even be removed in
    the future. To volunteer to maintain this port, please create an issue at:
    
    https://bugs.freebsd.org/bugzilla
    
    More information about port maintainership is available at:
    
    https://docs.freebsd.org/en/articles/contributing/#ports-contributing
    =====
    Message from rsync-3.2.7:
    
    --
    Some scripts provided by rsync such as rrsync requires
    python which is not installed by default
    >>> Cleaning up cache... done.
    Success
    
    

    Pete
    Home: SG-2100 + UniFi + Synology. SG-1100 retired
    Parents: SG-1100 + UniFi + Synology
    Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

    G 1 Reply Last reply Aug 31, 2023, 7:52 AM Reply Quote 0
    • C Cabledude referenced this topic on Aug 31, 2023, 5:41 AM
    • G
      Gertjan @Cabledude
      last edited by Gertjan Aug 31, 2023, 7:58 AM Aug 31, 2023, 7:52 AM

      @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

      DNSBL EasyList feed doesn't get listed in the dashboard widget.

      I didn't took a screen shot of the situation before. After adding Easylist (the first one, at the top of the feeds list) I saw this :

      4718e048-b02d-4df4-abdd-ff168518822d-image.png

      The Force Reload All :

      UPDATE PROCESS START [ v3.2.0_6 ] [ 08/31/23 09:28:50 ]
      
      ===[  DNSBL Process  ]================================================
      
      Loading DNSBL Statistics... completed
      Loading DNSBL SafeSearch... disabled
      Loading DNSBL Whitelist... completed
      Loading TOP1M Whitelist... completed
      
      [ StevenBlack_ADs ]		 Reload . completed ..
       Whitelist: 15.taboola.com|aax-eu.amazon-adsystem........
       TOP1M Whitelist: 0.r.msn.com|0lovespells0.blogspot.com|0ve1.weebly.com......
       ----------------------------------------------------------------------
       Orig.    Unique     # Dups     # White    # TOP1M    Final                
       ----------------------------------------------------------------------
       207979   207979     0          96         10872      197011               
       ----------------------------------------------------------------------
      
      [ EasyList ]			 Downloading update [ 08/31/23 09:29:01 ] .. 200 OK.
       Whitelist: adsafeprotected.com|amazon-adsystem.com|
       TOP1M Whitelist: 0a0d-d3l1vr.b-cdn.net|1080872514.rsc.cdn77.org|.... 
       Orig.    Unique     # Dups     # White    # TOP1M    Final                
       ----------------------------------------------------------------------
       28978    28974      781        2          850        27341                
       ----------------------------------------------------------------------
      
      ------------------------------------------------------------------------
      Assembling DNSBL database...... completed [ 08/31/23 09:29:07 ]
      TLD:
      TLD analysis... completed [ 08/31/23 09:29:12 ]
      TLD finalize...
      ----------------------------------------
      Original    Matches    Removed    Final     
      ----------------------------------------
      224352      78403      56402      167950    
      -----------------------------------------
      TLD finalize... completed [ 08/31/23 09:29:15 ]
      
      Saving DNSBL statistics... completed [ 08/31/23 09:29:17 ]
      Reloading Unbound Resolver (DNSBL python).
      Stopping Unbound Resolver.
      Unbound stopped in 2 sec.
      Additional mounts (DNSBL python):
       No changes required.
      Starting Unbound Resolver... completed [ 08/31/23 09:29:22 ]
      Resolver cache restored [ 08/31/23 09:29:24 ]
      DNSBL update [ 167950 | PASSED  ]... completed [ 08/31/23 09:29:25 ]
      ------------------------------------------------------------------------
      
      ===[  GeoIP Process  ]============================================
      
      
      ===[  Aliastables / Rules  ]==========================================
      
      No changes to Firewall rules, skipping Filter Reload
      No Changes to Aliases, Skipping pfctl Update
      
      ===[  Kill States  ]==================================================
      
      No matching states found
      
      ======================================================================
      
      ===[ FINAL Processing ]=====================================
      
        [ Original IP count   ]  [ 0 ]
      
        [ Final IP Count  ]  [ 0 ]
      
      
      ===[ DNSBL Domain/IP Counts ] ===================================
      
       224352 total
       197011 /var/db/pfblockerng/dnsbl/StevenBlack_ADs.txt
        27341 /var/db/pfblockerng/dnsbl/EasyList.txt
      
      ====================[ DNSBL Last Updated List Summary ]==============
      
      Aug 14	00:15	StevenBlack_ADs
      Aug 31	09:04	EasyList
      ===============================================================
      
      Database Sanity check [  PASSED  ]
      ------------------------
      Masterfile/Deny folder uniq check
      Deny folder/Masterfile uniq check
      
      Sync check (Pass=No IPs reported)
      ----------
      
      Alias table IP Counts
      -----------------------------
      
      pfSense Table Stats
      -------------------
      table-entries hard limit   400000
      Table Usage Count         775
      
      UPDATE PROCESS ENDED [ 08/31/23 09:29:26 ]
      

      18db7f69-e124-409b-9ace-f03d046faf6e-image.png

      The "better safe then sorry test :

      Download the list manually to look at its format, size, download speed etc :

      https://easylist-downloads.adblockplus.org/easylist_noelemhide.txt

      Ok, its a small list. Strange format, though :

      ....
      -ad-sidebar-
      ....
      

      edit : re installing a package rarely (if ever) repairs a situation.

      The package, a file, is downloaded over a secure connection.
      Is encrypted/encoded with hash keys etc. So, bits can flip randomly during transport.
      If the installer (a FreeBSD core program) finds errors during writing the files in the correct place, it will bark.
      For me, this is a 99,9999 % save, with known result, situation.
      Where things go bad :

      @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

      (keep settings enabled)

      If the software (the "program") on our system, like mine and your, is the same .... our local setting are never the same.
      That is where, for 99,999 %, are the issues 😊

      No "help me" PM's please. Use the forum, the community will thank you.
      Edit : and where are the logs ??

      C 1 Reply Last reply Aug 31, 2023, 4:04 PM Reply Quote 0
      • C
        Cabledude @Gertjan
        last edited by Aug 31, 2023, 4:04 PM

        @Gertjan
        Thanks a lot for your efforts (and your time!) testing the easylist. I agree 99,999% the issue is settings (or pebcak). I simply switched from unbound to python mode, left all python specific settings at their defaults.
        Just got home from a long day at work, will look up the pfblocker DNSBL manpages and try to sort it out.

        Pete
        Home: SG-2100 + UniFi + Synology. SG-1100 retired
        Parents: SG-1100 + UniFi + Synology
        Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

        C 1 Reply Last reply Aug 31, 2023, 8:06 PM Reply Quote 0
        • C
          Cabledude @Cabledude
          last edited by Cabledude Sep 4, 2023, 10:54 PM Aug 31, 2023, 8:06 PM

          ![alt text](![image url](


          • ~~```
            [image url]([link url](![link url](![image url](![image url]([image url](![link url](![image url](![image url](![image url](![image url](![image url](![image url](![image url]([image url](![link url](![image url](![image url](%(%(%(%(#000000)[#000000])[#000000])[#000000])[image url]))))))))))))))))))

          Pete
          Home: SG-2100 + UniFi + Synology. SG-1100 retired
          Parents: SG-1100 + UniFi + Synology
          Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

          G 1 Reply Last reply Sep 1, 2023, 6:07 AM Reply Quote 0
          • G
            Gertjan @Cabledude
            last edited by Sep 1, 2023, 6:07 AM

            @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

            I need a new forum name now...

            Why ? You switched to "all wifi" ?

            No "help me" PM's please. Use the forum, the community will thank you.
            Edit : and where are the logs ??

            C 1 Reply Last reply Sep 1, 2023, 7:33 PM Reply Quote 0
            • C
              Cabledude @Gertjan
              last edited by Cabledude Sep 1, 2023, 7:37 PM Sep 1, 2023, 7:33 PM

              @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

              I need a new forum name now...

              @Gertjan said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

              Why ? You switched to "all wifi" ?

              😂

              Not quite. The reason for needing a forum name change is rather the utter stupidity, killing embarrassment and perpetual shame after this beginner's mistake.
              It's similar to this guy who forgot to plug in his IBM computer in a classic dutch IBM TV commercial.

              Pete
              Home: SG-2100 + UniFi + Synology. SG-1100 retired
              Parents: SG-1100 + UniFi + Synology
              Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

              G 1 Reply Last reply Sep 2, 2023, 12:11 PM Reply Quote 0
              • G
                Gertjan @Cabledude
                last edited by Gertjan Sep 2, 2023, 12:12 PM Sep 2, 2023, 12:11 PM

                @Cabledude

                I was using M0n0wall in the past, as it offered a 'captive portal' and I was looking for some answers.
                I've used my IRL first name to create an account here, just to ask some question.
                I had my answers quickly, from what I recall, my questions were just "wrong", and I've installed pfSense.
                Still using it today.

                edit : forgot about the most important one : I'm still learning.

                No "help me" PM's please. Use the forum, the community will thank you.
                Edit : and where are the logs ??

                1 Reply Last reply Reply Quote 0
                7 out of 7
                • First post
                  7/7
                  Last post
                Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                  This community forum collects and processes your personal information.
                  consent.not_received