• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

EasyList tutorial?

Scheduled Pinned Locked Moved pfBlockerNG
16 Posts 2 Posters 13.0k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • M
    MrGlasspoole
    last edited by Feb 21, 2017, 1:31 PM

    I don't get how to ad my lists.
    What does "EasyList w/o Elements" or "EasyPrivacy" mean?
    What does the Categories do?

    On the PC i normally use:
    Fanboy+Easylist-Merged Ultimate List:
    https://www.fanboy.co.nz/r/fanboy-ultimate.txt

    EasyList Germany:
    https://easylist-downloads.adblockplus.org/easylistgermany.txt

    Anti-ThirdpartySocial (Fanboy Anti-Facebook Filters):
    https://www.fanboy.co.nz/fanboy-antifacebook.txt

    Adblock Warning Removal List:
    https://easylist-downloads.adblockplus.org/antiadblockfilters.txt

    Anti-Adblock Killer | Reek:
    https://raw.githubusercontent.com/reek/anti-adblock-killer/master/anti-adblock-killer-filters.txt

    Spam404 - Enabled in uBlock:
    https://raw.githubusercontent.com/Dawsey21/Lists/master/adblock-list.txt

    1 Reply Last reply Reply Quote 0
    • B
      BBcan177 Moderator
      last edited by Feb 21, 2017, 3:11 PM

      The EasyList tab is hardcoded to use only the EasyList and EasyPrivacy feeds… You can't add any other EasyList feeds, as they are not useable for a DNS filter... The other feeds you linked, contain lines that remove elements on a page.... These are not useable for DNSBL... It blocks via domain name only...

      EasyList w/o elements, is a feed (Downloaded file) that is condensed to remove the "elements" lines in the file...

      Each of these feeds has a "Category" section where the Domains are located... typically "ADServers", "ADServer Popups",  "Adult ADServer" and "Adult AD Server Popups"...

      EasyPrivacy has "Tracking Servers" and "Tracking Servers International"

      Open the EasyList and EasyPrivacy URLs and you can review what is in the feeds...

      The next release will have some more EasyList Locale Specific Feeds (See Link)
          https://forum.pfsense.org/index.php?topic=122903.0

      "Experience is something you don't get until just after you need it."

      Website: http://pfBlockerNG.com
      Twitter: @BBcan177  #pfBlockerNG
      Reddit: https://www.reddit.com/r/pfBlockerNG/new/

      1 Reply Last reply Reply Quote 0
      • M
        MrGlasspoole
        last edited by Feb 21, 2017, 3:27 PM

        Ok than this is related to my other question about the uBlock filtering.
        Sorry I'm trying to find my way through pfBlockerNG - there are 1.21 gigawatts of settings.

        Just realized that on my German IT side i visit everyday i get allot of ad's because i don't have the EasyList Germany in pfBlockerNG.
        At the moment i still have uBlock enabled with all the EasyLists in Firefox and even with all the DNSBL Feeds uBlock is blocking 40 things.

        Because you wrote in the other thread:

        pfBlockerNG parses the EasyList feeds, and collects just the domains that can be blocked… The rest are discarded..

        i thought i can at any EasyList.

        The thing is that Fanboy+Easylist-Merged Ultimate List: https://www.fanboy.co.nz/r/fanboy-ultimate.txt
        Includes EasyList, EasyPrivacy, Fanboy Enhanced Trackers List, Fanboy Annoyances List, Fanboy Social List, Fanboy Anti-Cookie Filters

        1 Reply Last reply Reply Quote 0
        • B
          BBcan177 Moderator
          last edited by Feb 21, 2017, 4:10 PM

          Here is a little present  :)

          https://gist.githubusercontent.com/BBcan177/2a9fc2548c3c5a5e2dc86e580b5795d2/raw
          

          That is the parsed EasyList German feed w/ just the domains… Add that to the DNSBL Feeds Tab... Typically these locale specific feeds don't change that much, so it should help until the next release of pfBlockerNG...

          Keep in mind that the other DNSBL Feeds have most, if not all of the same domains listed in those EasyList/UBlock feeds already...

          "Experience is something you don't get until just after you need it."

          Website: http://pfBlockerNG.com
          Twitter: @BBcan177  #pfBlockerNG
          Reddit: https://www.reddit.com/r/pfBlockerNG/new/

          1 Reply Last reply Reply Quote 0
          • M
            MrGlasspoole
            last edited by Feb 21, 2017, 6:11 PM

            Presents in a forum :o  :D

            Ok that did at 370:

            370 /var/db/pfblockerng/dnsbl/EasyList_German_parsed.txt
            

            and I also enabled EasyList and EasyPrivacy but it makes no difference.

            uBlock still shows "42 or 34%" here: http://winfuture.de/news,96340.html
            It seems like on my PC i see no YouTube ads but on the Android devices.
            When looking at Pi-hole i did read you can't block YouTube ads with DNS.
            But with AdAway on the Android devices i never saw YouTube ads - and AdAway also just uses the host file?

            I must be missing something because it looks like allot of people love Pi-hole.
            But if you can't remove stuff like that?

            How to others here do it? Still using browser ad blockers with all the lists?

            1 Reply Last reply Reply Quote 0
            • B
              BBcan177 Moderator
              last edited by Feb 21, 2017, 6:35 PM

              That page  @  http://winfuture.de    is clean of ADs for me…  :)

              There are more feeds available here:
                  https://forum.pfsense.org/index.php?topic=102470.msg573159#msg573159

              You can hit "F12" in the Browser and goto Dev Mode... then hit "Console" to show the page errors...

              Here are the domains that are being blocked for me (See F12 - Dev mode)
              The "('image/gif') is not executable" is where the DNSBL 1x1 pixel was sent to the browser instead of the Advert…

              http://i.imgur.com/O2JS5SR.png

              You can also right-click on any ADvert, and select "Inspect" and it will show the html code... If the src is a Domain, then that can be added to a DNSBL Customlist...

              You can see if a Domain is listed in DNSBL w/ a grep command... These will also show in the Alerts Tab when blocked... You can see that feed    hpHosts    seems to be blocking most of these…

              grep "winfuture.de" /var/db/pfblockerng/dnsbl/*
              /var/db/pfblockerng/dnsbl/Cameleon.txt:local-data: "winfuture.de.intellitxt.com 60 IN A 10.10.10.1"
              /var/db/pfblockerng/dnsbl/MPatrol.txt:local-data: "dlgbit.winfuture.de 60 IN A 10.10.10.1"
              /var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "o0.winfuture.de 60 IN A 10.10.10.1"
              
              grep "a.visualrevenue.com" /var/db/pfblockerng/dnsbl/*
              /var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "a.visualrevenue.com 60 IN A 10.10.10.1"
              
              grep "cdn.stroeerdigitalmedia.de" /var/db/pfblockerng/dnsbl/*
              /var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "cdn.stroeerdigitalmedia.de 60 IN A 10.10.10.1"
              
              grep "widgets.outbrain.com" /var/db/pfblockerng/dnsbl/*
              /var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "widgets.outbrain.com 60 IN A 10.10.10.1"
              
              grep "platform.stumbleupon.com" /var/db/pfblockerng/dnsbl/*
              /var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "platform.stumbleupon.com 60 IN A 10.10.10.1"
              
              grep "static.digidip.net" /var/db/pfblockerng/dnsbl/*
              /var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "static.digidip.net 60 IN A 10.10.10.1"
              

              "Experience is something you don't get until just after you need it."

              Website: http://pfBlockerNG.com
              Twitter: @BBcan177  #pfBlockerNG
              Reddit: https://www.reddit.com/r/pfBlockerNG/new/

              1 Reply Last reply Reply Quote 0
              • M
                MrGlasspoole
                last edited by Feb 21, 2017, 7:09 PM

                Here is some ad in the attachment from: http://winfuture.de/news,96340.html
                And i did look at the uBlock logger and there i can see now it's all frames, scripts and stuff like that (other attachment).

                So do you use a browser adblocker together with pfBlocker?

                And i was wrong about AdAway on Android. There are ads on YouTube but so small i never realized them.

                ads.jpg_thumb
                ads.jpg
                uBlock-Logger.jpg
                uBlock-Logger.jpg_thumb

                1 Reply Last reply Reply Quote 0
                • B
                  BBcan177 Moderator
                  last edited by Feb 21, 2017, 8:53 PM

                  @MrGlasspoole:

                  Here is some ad in the attachment from: http://winfuture.de/news,96340.html
                  And i did look at the uBlock logger and there i can see now it's all frames, scripts and stuff like that (other attachment).

                  So do you use a browser adblocker together with pfBlocker?

                  And i was wrong about AdAway on Android. There are ads on YouTube but so small i never realized them.

                  I opened the same web page without any ADvert at the bottom of the video… I do not use any additional Browser extensions. Its best to test without the browser extensions, and see the results without them..

                  Follow the steps I indicated above to track down the domains that are displaying that AD… Right click on it, select "Inspect".... etc..

                  "Experience is something you don't get until just after you need it."

                  Website: http://pfBlockerNG.com
                  Twitter: @BBcan177  #pfBlockerNG
                  Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                  1 Reply Last reply Reply Quote 0
                  • M
                    MrGlasspoole
                    last edited by Feb 21, 2017, 9:42 PM Feb 21, 2017, 9:33 PM

                    Don't worry, i have more then one Firefox and profiles to test stuff ;)

                    https://cdn.recognified.com/banner/recognified/31/2017-02-03/0_170201_PY_Rubbellosaktion_2017_728x90_cse-1.gif

                    Where do you come from - i guess Penny (supermarket) advertising is not for you  :D

                    Then there is the stuff like in the attachment (just a div overlay that slides in from the side sometimes) i never saw before ;D

                    dont-miss.jpg
                    dont-miss.jpg_thumb

                    1 Reply Last reply Reply Quote 0
                    • B
                      BBcan177 Moderator
                      last edited by Feb 21, 2017, 9:52 PM

                      If that is in a div with an image (gif), then it cannot be blocked with a DNS Filter… Since the page is not calling a Domain name to display the AD...

                      "Experience is something you don't get until just after you need it."

                      Website: http://pfBlockerNG.com
                      Twitter: @BBcan177  #pfBlockerNG
                      Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                      1 Reply Last reply Reply Quote 0
                      • M
                        MrGlasspoole
                        last edited by Feb 21, 2017, 10:45 PM

                        The one in the video has a domain:

                        
                            ![](https://ads.recognified.com/adview.php?tz=1487716301692484&pid=92&kid=32&wmid=311&nvc=1&target1=-)
                        
                          [![](https://cdn.recognified.com/banner/recognified/31/2017-02-03/0_170201_PY_Rubbellosaktion_2017_728x90_cse-1.gif)](https://ads.recognified.com/adclick.php?tz=1487716301439825&pid=92&kid=32&wmid=311&wsid=17&uid=16&ord=1487716301&target=https://track.adform.net/C/?bn=15993163) 
                          ![](https://track.adform.net/adfserve/?bn=15993163;1x1inv=1;srctype=3;ord=[timestamp])
                        
                        

                        But adding "recognified.com" to DNSBL Feeds Custom Block List does not help.

                        From disabling and enabling filters it seems like Fanboy Annoyances List is blocking it even if the domain is not in that list.

                        So you use no browser adblocker - that means you live with ads like this and all the twitter, amazon, facebook, social content, social widgets, social scripts, social icons stuff?

                        1 Reply Last reply Reply Quote 0
                        • B
                          BBcan177 Moderator
                          last edited by Feb 21, 2017, 10:56 PM

                          Who said I live with ADs…  8)    And no I don't use any Browser add-ons...

                          You added "recognified.com", but the ADvert is from "ads.recognified.com"...

                          Did you enable the "TLD" option? With TLD, it blocks all sub-domains...
                          and don't forget to Force Reload - DNSBL to get it to add manually entered Domains....

                          See the following:
                            https://forum.pfsense.org/index.php?topic=125895.msg695615#msg695615

                          Did you add any other feeds to DNSBL?
                              https://forum.pfsense.org/index.php?topic=102470.msg572943#msg572943
                              https://forum.pfsense.org/index.php?topic=102470.msg573159#msg573159

                          "Experience is something you don't get until just after you need it."

                          Website: http://pfBlockerNG.com
                          Twitter: @BBcan177  #pfBlockerNG
                          Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                          1 Reply Last reply Reply Quote 0
                          • M
                            MrGlasspoole
                            last edited by Feb 22, 2017, 12:03 AM Feb 21, 2017, 11:30 PM

                            Ah i thought it includes subdomains.

                            I have everything in DNSBL Feeds that i normally have in uBlock:

                            Malware domains:
                            http://mirror1.malwaredomains.com/files/justdomains

                            Basic tracking list by Disconnect​​​​​:
                            https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt

                            Malvertising filter list by Disconnect:
                            https://s3.amazonaws.com/lists.disconnect.me/simple_malvertising.txt

                            Malware domains (long-lived):
                            http://malwaredomains.lehigh.edu/files/immortal_domains.txt

                            Malware filter list by Disconnect:
                            https://s3.amazonaws.com/lists.disconnect.me/simple_malware.txt

                            Malware Domain List:
                            https://www.malwaredomainlist.com/hostslist/hosts.txt

                            MVPS HOSTS:
                            http://winhelp2002.mvps.org/hosts.txt

                            AdAway:
                            https://adaway.org/hosts.txt

                            hpHosts:
                            https://hosts-file.net/ad_servers.txt

                            Peter Lowe’s Ad and tracking server list:
                            https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext

                            Then where is the magic if no ads and no Browser add-ons if you can't block div's with DNS?
                            How do you handle Adblock Warnings?

                            There is so many stuff on that side i never saw before (patchwork in the attachment).
                            It does not all come from other domains. Some are from the sides own cdn but the Fanboy stuff gets rid of it.

                            1 Reply Last reply Reply Quote 0
                            • M
                              MrGlasspoole
                              last edited by Aug 11, 2017, 2:32 PM

                              After a fresh installation i have to bring this up again.
                              You wrote:
                              @BBcan177:

                              If that is in a div with an image (gif), then it cannot be blocked with a DNS Filter… Since the page is not calling a Domain name to display the AD...

                              I know that pfBlocker can't manipulate the browser DOM/CSS.

                              But then you wrote:
                              @BBcan177:

                              Who said I live with ADs…  And no I don't use any Browser add-ons...

                              I see all the Google ADs if i do a Google search.
                              So how do you get rid of it without a Browser add-ons?

                              This guy has the same problem: https://forum.pfsense.org/index.php?topic=125895.0

                              1 Reply Last reply Reply Quote 0
                              • B
                                BBcan177 Moderator
                                last edited by Aug 11, 2017, 2:46 PM

                                You can't get rid of the Google Search "ADS" links with a DNS Blocker. That can only be achieved with a browser based extension…  My reply to the link you posted is the same...

                                "Experience is something you don't get until just after you need it."

                                Website: http://pfBlockerNG.com
                                Twitter: @BBcan177  #pfBlockerNG
                                Reddit: https://www.reddit.com/r/pfBlockerNG/new/

                                1 Reply Last reply Reply Quote 0
                                • M
                                  MrGlasspoole
                                  last edited by Aug 11, 2017, 3:06 PM

                                  Ok, so you do live with ADs ;D

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post
                                  Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                                    This community forum collects and processes your personal information.
                                    consent.not_received