EasyList tutorial?

MrGlasspoole

I don't get how to ad my lists.
What does "EasyList w/o Elements" or "EasyPrivacy" mean?
What does the Categories do?

On the PC i normally use:
Fanboy+Easylist-Merged Ultimate List:
https://www.fanboy.co.nz/r/fanboy-ultimate.txt

EasyList Germany:
https://easylist-downloads.adblockplus.org/easylistgermany.txt

Anti-ThirdpartySocial (Fanboy Anti-Facebook Filters):
https://www.fanboy.co.nz/fanboy-antifacebook.txt

Adblock Warning Removal List:
https://easylist-downloads.adblockplus.org/antiadblockfilters.txt

Anti-Adblock Killer | Reek:
https://raw.githubusercontent.com/reek/anti-adblock-killer/master/anti-adblock-killer-filters.txt

Spam404 - Enabled in uBlock:
https://raw.githubusercontent.com/Dawsey21/Lists/master/adblock-list.txt

BBcan177

The EasyList tab is hardcoded to use only the EasyList and EasyPrivacy feeds… You can't add any other EasyList feeds, as they are not useable for a DNS filter... The other feeds you linked, contain lines that remove elements on a page.... These are not useable for DNSBL... It blocks via domain name only...

EasyList w/o elements, is a feed (Downloaded file) that is condensed to remove the "elements" lines in the file...

Each of these feeds has a "Category" section where the Domains are located... typically "ADServers", "ADServer Popups", "Adult ADServer" and "Adult AD Server Popups"...

EasyPrivacy has "Tracking Servers" and "Tracking Servers International"

Open the EasyList and EasyPrivacy URLs and you can review what is in the feeds...

The next release will have some more EasyList Locale Specific Feeds (See Link)
https://forum.pfsense.org/index.php?topic=122903.0

MrGlasspoole

Ok than this is related to my other question about the uBlock filtering.
Sorry I'm trying to find my way through pfBlockerNG - there are 1.21 gigawatts of settings.

Just realized that on my German IT side i visit everyday i get allot of ad's because i don't have the EasyList Germany in pfBlockerNG.
At the moment i still have uBlock enabled with all the EasyLists in Firefox and even with all the DNSBL Feeds uBlock is blocking 40 things.

Because you wrote in the other thread:

pfBlockerNG parses the EasyList feeds, and collects just the domains that can be blocked… The rest are discarded..

i thought i can at any EasyList.

The thing is that Fanboy+Easylist-Merged Ultimate List: https://www.fanboy.co.nz/r/fanboy-ultimate.txt
Includes EasyList, EasyPrivacy, Fanboy Enhanced Trackers List, Fanboy Annoyances List, Fanboy Social List, Fanboy Anti-Cookie Filters

BBcan177

Here is a little present :)

https://gist.githubusercontent.com/BBcan177/2a9fc2548c3c5a5e2dc86e580b5795d2/raw

That is the parsed EasyList German feed w/ just the domains… Add that to the DNSBL Feeds Tab... Typically these locale specific feeds don't change that much, so it should help until the next release of pfBlockerNG...

Keep in mind that the other DNSBL Feeds have most, if not all of the same domains listed in those EasyList/UBlock feeds already...

MrGlasspoole

Presents in a forum :o :D

Ok that did at 370:

370 /var/db/pfblockerng/dnsbl/EasyList_German_parsed.txt

and I also enabled EasyList and EasyPrivacy but it makes no difference.

uBlock still shows "42 or 34%" here: http://winfuture.de/news,96340.html
It seems like on my PC i see no YouTube ads but on the Android devices.
When looking at Pi-hole i did read you can't block YouTube ads with DNS.
But with AdAway on the Android devices i never saw YouTube ads - and AdAway also just uses the host file?

I must be missing something because it looks like allot of people love Pi-hole.
But if you can't remove stuff like that?

How to others here do it? Still using browser ad blockers with all the lists?

BBcan177

That page @ http://winfuture.de is clean of ADs for me… :)

There are more feeds available here:
https://forum.pfsense.org/index.php?topic=102470.msg573159#msg573159

You can hit "F12" in the Browser and goto Dev Mode... then hit "Console" to show the page errors...

Here are the domains that are being blocked for me (See F12 - Dev mode)
The "('image/gif') is not executable" is where the DNSBL 1x1 pixel was sent to the browser instead of the Advert…

http://i.imgur.com/O2JS5SR.png

You can also right-click on any ADvert, and select "Inspect" and it will show the html code... If the src is a Domain, then that can be added to a DNSBL Customlist...

You can see if a Domain is listed in DNSBL w/ a grep command... These will also show in the Alerts Tab when blocked... You can see that feed hpHosts seems to be blocking most of these…

grep "winfuture.de" /var/db/pfblockerng/dnsbl/*
/var/db/pfblockerng/dnsbl/Cameleon.txt:local-data: "winfuture.de.intellitxt.com 60 IN A 10.10.10.1"
/var/db/pfblockerng/dnsbl/MPatrol.txt:local-data: "dlgbit.winfuture.de 60 IN A 10.10.10.1"
/var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "o0.winfuture.de 60 IN A 10.10.10.1"

grep "a.visualrevenue.com" /var/db/pfblockerng/dnsbl/*
/var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "a.visualrevenue.com 60 IN A 10.10.10.1"

grep "cdn.stroeerdigitalmedia.de" /var/db/pfblockerng/dnsbl/*
/var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "cdn.stroeerdigitalmedia.de 60 IN A 10.10.10.1"

grep "widgets.outbrain.com" /var/db/pfblockerng/dnsbl/*
/var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "widgets.outbrain.com 60 IN A 10.10.10.1"

grep "platform.stumbleupon.com" /var/db/pfblockerng/dnsbl/*
/var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "platform.stumbleupon.com 60 IN A 10.10.10.1"

grep "static.digidip.net" /var/db/pfblockerng/dnsbl/*
/var/db/pfblockerng/dnsbl/hpHosts_ads.txt:local-data: "static.digidip.net 60 IN A 10.10.10.1"

MrGlasspoole

Here is some ad in the attachment from: http://winfuture.de/news,96340.html
And i did look at the uBlock logger and there i can see now it's all frames, scripts and stuff like that (other attachment).

So do you use a browser adblocker together with pfBlocker?

And i was wrong about AdAway on Android. There are ads on YouTube but so small i never realized them.

ads.jpg_thumb

uBlock-Logger.jpg_thumb

BBcan177

@MrGlasspoole:

Here is some ad in the attachment from: http://winfuture.de/news,96340.html
And i did look at the uBlock logger and there i can see now it's all frames, scripts and stuff like that (other attachment).

So do you use a browser adblocker together with pfBlocker?

And i was wrong about AdAway on Android. There are ads on YouTube but so small i never realized them.

I opened the same web page without any ADvert at the bottom of the video… I do not use any additional Browser extensions. Its best to test without the browser extensions, and see the results without them..

Follow the steps I indicated above to track down the domains that are displaying that AD… Right click on it, select "Inspect".... etc..

MrGlasspoole

Don't worry, i have more then one Firefox and profiles to test stuff ;)

https://cdn.recognified.com/banner/recognified/31/2017-02-03/0_170201_PY_Rubbellosaktion_2017_728x90_cse-1.gif

Where do you come from - i guess Penny (supermarket) advertising is not for you :D

Then there is the stuff like in the attachment (just a div overlay that slides in from the side sometimes) i never saw before ;D

dont-miss.jpg_thumb

BBcan177

If that is in a div with an image (gif), then it cannot be blocked with a DNS Filter… Since the page is not calling a Domain name to display the AD...

MrGlasspoole

The one in the video has a domain:


    ![](https://ads.recognified.com/adview.php?tz=1487716301692484&pid=92&kid=32&wmid=311&nvc=1&target1=-)

  [![](https://cdn.recognified.com/banner/recognified/31/2017-02-03/0_170201_PY_Rubbellosaktion_2017_728x90_cse-1.gif)](https://ads.recognified.com/adclick.php?tz=1487716301439825&pid=92&kid=32&wmid=311&wsid=17&uid=16&ord=1487716301&target=https://track.adform.net/C/?bn=15993163) 
  ![](https://track.adform.net/adfserve/?bn=15993163;1x1inv=1;srctype=3;ord=[timestamp])

But adding "recognified.com" to DNSBL Feeds Custom Block List does not help.

From disabling and enabling filters it seems like Fanboy Annoyances List is blocking it even if the domain is not in that list.

So you use no browser adblocker - that means you live with ads like this and all the twitter, amazon, facebook, social content, social widgets, social scripts, social icons stuff?

BBcan177

Who said I live with ADs… 8) And no I don't use any Browser add-ons...

You added "recognified.com", but the ADvert is from "ads.recognified.com"...

Did you enable the "TLD" option? With TLD, it blocks all sub-domains...
and don't forget to Force Reload - DNSBL to get it to add manually entered Domains....

See the following:
https://forum.pfsense.org/index.php?topic=125895.msg695615#msg695615

Did you add any other feeds to DNSBL?
https://forum.pfsense.org/index.php?topic=102470.msg572943#msg572943
https://forum.pfsense.org/index.php?topic=102470.msg573159#msg573159

MrGlasspoole

Ah i thought it includes subdomains.

I have everything in DNSBL Feeds that i normally have in uBlock:

Malware domains:
http://mirror1.malwaredomains.com/files/justdomains

Basic tracking list by Disconnect:
https://s3.amazonaws.com/lists.disconnect.me/simple_tracking.txt

Malvertising filter list by Disconnect:
https://s3.amazonaws.com/lists.disconnect.me/simple_malvertising.txt

Malware domains (long-lived):
http://malwaredomains.lehigh.edu/files/immortal_domains.txt

Malware filter list by Disconnect:
https://s3.amazonaws.com/lists.disconnect.me/simple_malware.txt

Malware Domain List:
https://www.malwaredomainlist.com/hostslist/hosts.txt

MVPS HOSTS:
http://winhelp2002.mvps.org/hosts.txt

AdAway:
https://adaway.org/hosts.txt

hpHosts:
https://hosts-file.net/ad_servers.txt

Peter Lowe’s Ad and tracking server list:
https://pgl.yoyo.org/adservers/serverlist.php?hostformat=hosts&showintro=0&mimetype=plaintext

Then where is the magic if no ads and no Browser add-ons if you can't block div's with DNS?
How do you handle Adblock Warnings?

There is so many stuff on that side i never saw before (patchwork in the attachment).
It does not all come from other domains. Some are from the sides own cdn but the Fanboy stuff gets rid of it.

MrGlasspoole

After a fresh installation i have to bring this up again.
You wrote:
@BBcan177:

If that is in a div with an image (gif), then it cannot be blocked with a DNS Filter… Since the page is not calling a Domain name to display the AD...

I know that pfBlocker can't manipulate the browser DOM/CSS.

But then you wrote:
@BBcan177:

Who said I live with ADs… And no I don't use any Browser add-ons...

I see all the Google ADs if i do a Google search.
So how do you get rid of it without a Browser add-ons?

This guy has the same problem: https://forum.pfsense.org/index.php?topic=125895.0

BBcan177

You can't get rid of the Google Search "ADS" links with a DNS Blocker. That can only be achieved with a browser based extension… My reply to the link you posted is the same...

MrGlasspoole

Ok, so you do live with ADs ;D