Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    23.05.01 easylist not in dashboard widget [edit: not loading at all]

    pfBlockerNG
    2
    7
    833
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      Cabledude
      last edited by Cabledude

      Hi all,
      pfBlockerNG-devel 3.2.0_6 on Netgate SG-1100. IP works, DNSBL works. But:
      DNSBL EasyList feed doesn't get listed in the dashboard widget.
      Steps:

      1. enable Ads (or any other) feed and force reload
      2. shows in dashboard widget
        4e3c32d2-2632-4653-bbcf-7c7df8961587-image.png
      3. enable EasyList and disable Ads (or whatever lists you have) - force reload
        0f163f48-2126-45ab-a293-235d9ac49afb-image.png
      4. check dashboard widget: still showing Ads_Basic, not EasyList. And it's showing the Ads count too.

      I can repeat this using other DNSBL feeds, such as Ads_Basic or Malicious, remove them until only EasyList is left enabled and the widget will always show the previous list, e.g. the list that was loaded before EasyList, not EasyList itself.

      1. When I try to provoke blocks by browsing sites such as google or other sites that I am 100% sure have blockable content, the blocked counter doesn't go up, so the list doesn't work.
      2. As soon as I load one of the other lists, the counter goes up immediately.

      I reinstalled pfBlocker (keep settings enabled) just to see what would happen. I got the following errors at package install. Especially the python error seems troubling, but I'm not sure if these are bad.

      Custom commands completed ... done.
      Executing custom_php_resync_config_command()...cat: /var/db/pfblockerng/dnsbl/*.txt: No such file or directory
      done.
      Menu items... done.
      Services... done.
      Writing configuration... done.
      =====
      Message from py311-setuptools-63.1.0:
      
      --
      Only /usr/local/bin/easy_install-3.11 script has been installed
        since Python 3.11 is not the default Python version.
      =====
      Message from grepcidr-2.0:
      
      --
      ===>   NOTICE:
      
      The grepcidr port currently does not have a maintainer. As a result, it is
      more likely to have unresolved issues, not be up-to-date, or even be removed in
      the future. To volunteer to maintain this port, please create an issue at:
      
      https://bugs.freebsd.org/bugzilla
      
      More information about port maintainership is available at:
      
      https://docs.freebsd.org/en/articles/contributing/#ports-contributing
      =====
      Message from rsync-3.2.7:
      
      --
      Some scripts provided by rsync such as rrsync requires
      python which is not installed by default
      >>> Cleaning up cache... done.
      Success
      
      

      Pete
      Home: SG-2100 + UniFi + Synology. SG-1100 retired
      Parents: SG-1100 + UniFi + Synology
      Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

      GertjanG 1 Reply Last reply Reply Quote 0
      • C Cabledude referenced this topic on
      • GertjanG
        Gertjan @Cabledude
        last edited by Gertjan

        @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

        DNSBL EasyList feed doesn't get listed in the dashboard widget.

        I didn't took a screen shot of the situation before. After adding Easylist (the first one, at the top of the feeds list) I saw this :

        4718e048-b02d-4df4-abdd-ff168518822d-image.png

        The Force Reload All :

        UPDATE PROCESS START [ v3.2.0_6 ] [ 08/31/23 09:28:50 ]
        
        ===[  DNSBL Process  ]================================================
        
        Loading DNSBL Statistics... completed
        Loading DNSBL SafeSearch... disabled
        Loading DNSBL Whitelist... completed
        Loading TOP1M Whitelist... completed
        
        [ StevenBlack_ADs ]		 Reload . completed ..
         Whitelist: 15.taboola.com|aax-eu.amazon-adsystem........
         TOP1M Whitelist: 0.r.msn.com|0lovespells0.blogspot.com|0ve1.weebly.com......
         ----------------------------------------------------------------------
         Orig.    Unique     # Dups     # White    # TOP1M    Final                
         ----------------------------------------------------------------------
         207979   207979     0          96         10872      197011               
         ----------------------------------------------------------------------
        
        [ EasyList ]			 Downloading update [ 08/31/23 09:29:01 ] .. 200 OK.
         Whitelist: adsafeprotected.com|amazon-adsystem.com|
         TOP1M Whitelist: 0a0d-d3l1vr.b-cdn.net|1080872514.rsc.cdn77.org|.... 
         Orig.    Unique     # Dups     # White    # TOP1M    Final                
         ----------------------------------------------------------------------
         28978    28974      781        2          850        27341                
         ----------------------------------------------------------------------
        
        ------------------------------------------------------------------------
        Assembling DNSBL database...... completed [ 08/31/23 09:29:07 ]
        TLD:
        TLD analysis... completed [ 08/31/23 09:29:12 ]
        TLD finalize...
        ----------------------------------------
        Original    Matches    Removed    Final     
        ----------------------------------------
        224352      78403      56402      167950    
        -----------------------------------------
        TLD finalize... completed [ 08/31/23 09:29:15 ]
        
        Saving DNSBL statistics... completed [ 08/31/23 09:29:17 ]
        Reloading Unbound Resolver (DNSBL python).
        Stopping Unbound Resolver.
        Unbound stopped in 2 sec.
        Additional mounts (DNSBL python):
         No changes required.
        Starting Unbound Resolver... completed [ 08/31/23 09:29:22 ]
        Resolver cache restored [ 08/31/23 09:29:24 ]
        DNSBL update [ 167950 | PASSED  ]... completed [ 08/31/23 09:29:25 ]
        ------------------------------------------------------------------------
        
        ===[  GeoIP Process  ]============================================
        
        
        ===[  Aliastables / Rules  ]==========================================
        
        No changes to Firewall rules, skipping Filter Reload
        No Changes to Aliases, Skipping pfctl Update
        
        ===[  Kill States  ]==================================================
        
        No matching states found
        
        ======================================================================
        
        ===[ FINAL Processing ]=====================================
        
          [ Original IP count   ]  [ 0 ]
        
          [ Final IP Count  ]  [ 0 ]
        
        
        ===[ DNSBL Domain/IP Counts ] ===================================
        
         224352 total
         197011 /var/db/pfblockerng/dnsbl/StevenBlack_ADs.txt
          27341 /var/db/pfblockerng/dnsbl/EasyList.txt
        
        ====================[ DNSBL Last Updated List Summary ]==============
        
        Aug 14	00:15	StevenBlack_ADs
        Aug 31	09:04	EasyList
        ===============================================================
        
        Database Sanity check [  PASSED  ]
        ------------------------
        Masterfile/Deny folder uniq check
        Deny folder/Masterfile uniq check
        
        Sync check (Pass=No IPs reported)
        ----------
        
        Alias table IP Counts
        -----------------------------
        
        pfSense Table Stats
        -------------------
        table-entries hard limit   400000
        Table Usage Count         775
        
        UPDATE PROCESS ENDED [ 08/31/23 09:29:26 ]
        

        18db7f69-e124-409b-9ace-f03d046faf6e-image.png

        The "better safe then sorry test :

        Download the list manually to look at its format, size, download speed etc :

        https://easylist-downloads.adblockplus.org/easylist_noelemhide.txt

        Ok, its a small list. Strange format, though :

        ....
        -ad-sidebar-
        ....
        

        edit : re installing a package rarely (if ever) repairs a situation.

        The package, a file, is downloaded over a secure connection.
        Is encrypted/encoded with hash keys etc. So, bits can flip randomly during transport.
        If the installer (a FreeBSD core program) finds errors during writing the files in the correct place, it will bark.
        For me, this is a 99,9999 % save, with known result, situation.
        Where things go bad :

        @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

        (keep settings enabled)

        If the software (the "program") on our system, like mine and your, is the same .... our local setting are never the same.
        That is where, for 99,999 %, are the issues 😊

        No "help me" PM's please. Use the forum, the community will thank you.
        Edit : and where are the logs ??

        C 1 Reply Last reply Reply Quote 0
        • C
          Cabledude @Gertjan
          last edited by

          @Gertjan
          Thanks a lot for your efforts (and your time!) testing the easylist. I agree 99,999% the issue is settings (or pebcak). I simply switched from unbound to python mode, left all python specific settings at their defaults.
          Just got home from a long day at work, will look up the pfblocker DNSBL manpages and try to sort it out.

          Pete
          Home: SG-2100 + UniFi + Synology. SG-1100 retired
          Parents: SG-1100 + UniFi + Synology
          Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

          C 1 Reply Last reply Reply Quote 0
          • C
            Cabledude @Cabledude
            last edited by Cabledude

            ![alt text](![image url](


            • ~~```
              [image url]([link url](![link url](![image url](![image url]([image url](![link url](![image url](![image url](![image url](![image url](![image url](![image url](![image url]([image url](![link url](![image url](![image url](%(%(%(%(#000000)[#000000])[#000000])[#000000])[image url]))))))))))))))))))

            Pete
            Home: SG-2100 + UniFi + Synology. SG-1100 retired
            Parents: SG-1100 + UniFi + Synology
            Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

            GertjanG 1 Reply Last reply Reply Quote 0
            • GertjanG
              Gertjan @Cabledude
              last edited by

              @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

              I need a new forum name now...

              Why ? You switched to "all wifi" ?

              No "help me" PM's please. Use the forum, the community will thank you.
              Edit : and where are the logs ??

              C 1 Reply Last reply Reply Quote 0
              • C
                Cabledude @Gertjan
                last edited by Cabledude

                @Cabledude said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

                I need a new forum name now...

                @Gertjan said in 23.05.01 easylist not in dashboard widget [edit: not loading at all]:

                Why ? You switched to "all wifi" ?

                😂

                Not quite. The reason for needing a forum name change is rather the utter stupidity, killing embarrassment and perpetual shame after this beginner's mistake.
                It's similar to this guy who forgot to plug in his IBM computer in a classic dutch IBM TV commercial.

                Pete
                Home: SG-2100 + UniFi + Synology. SG-1100 retired
                Parents: SG-1100 + UniFi + Synology
                Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

                GertjanG 1 Reply Last reply Reply Quote 0
                • GertjanG
                  Gertjan @Cabledude
                  last edited by Gertjan

                  @Cabledude

                  I was using M0n0wall in the past, as it offered a 'captive portal' and I was looking for some answers.
                  I've used my IRL first name to create an account here, just to ask some question.
                  I had my answers quickly, from what I recall, my questions were just "wrong", and I've installed pfSense.
                  Still using it today.

                  edit : forgot about the most important one : I'm still learning.

                  No "help me" PM's please. Use the forum, the community will thank you.
                  Edit : and where are the logs ??

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post
                  Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.