Unofficial E2guardian package for pfSense

marcelloc

If you are on i386 architecture, uninstall/reinstall the package or run pkg install openssl on console. The was missing and without it, e2guardian does not start.

If you know how to install from freebsd repo, the result will be the same.

techbee

Hi Marcelloc,

I just would like to clarify coz I am confused.

1. Is E2Guardian a replacement for squidguard or squid ?
2. Do I need to install Squid package if I use E2Guardian ?
3. If I need to install Squid package, do I need to enable the Transparent proxy and SSL MITM Filtering in Squid Proxy configuration ?

marcelloc

@techbee:

1. Is E2Guardian a replacement for squidguard or squid ?

Full replacement for squidguard with more features.

@techbee:

2. Do I need to install Squid package if I use E2Guardian ?

If you do not need authentication or just ip authentication and no transparent proxy for ssl then you need only e2guardian package

@techbee:

l
3. If I need to install Squid package, do I need to enable the Transparent proxy and SSL MITM Filtering in Squid Proxy configuration ?

If you plan to transparent proxy ssl, then you need to enable splice all and configure cache peer to send traffic to e2guardian.

kenrutt

Hi Marcelloc
I appreciate all the work you are doing with e2guardian. I have be playing for awhile and I finally got it working.
I am a novice with pfsense so it took me awhile to figure some things out. One thing I seemed to have a problem with is file permissions. Even when I install e2guardian on a fresh installed pfsense, there where file permission problems. One was the log file and the other was the directory where temp ssl certs where stored, not sure if I am saying this correctly or not. After I figured out how to change file and directory permissions I got everythinf to work. I am using MITM filtering by the way.
So for what ever it is worth. GREAT WORK MARCELLOC! :)

pfsensation

Hey Marcello,

I'm sure you missed me. :P

Can you please look into caching content that E2Guardian has MITM'd? Using Squid directly doesn't seem to work due to them not using SAN on forged certificates. If you could add a workaround that would be amazing, for now and the future. Because for now even with MITM turned on, via E2Guardian, I have only been able to make Squid cache HTTP content, not HTTPS.

This makes caching slightly redundant as most websites have or are moving to HTTPS.

You you understand,

Thanks bro :)

PS: Be proud of urself, I am planning to deploy E2Guardian in a Charity Organisation! However… I am still waiting on that bug with blacklisted sites not showing category to be fixed. Thanks again for porting this over to pfSense, and keeping everything free, accessible and open source!

marcelloc

Did you configured it in sandwich mode?

Squid package +Splice all + transparent proxy + cache peer -> e2guardian with no nat redirect -> automatic parent.

jetberrocal

@marcelloc:

Did you configured it in sandwich mode?

Squid package +Splice all + transparent proxy + cache peer -> e2guardian with no nat redirect -> automatic parent.

Can you provide some screenshots with these configuration?

marcelloc

@jetberrocal:

Can you provide some screenshots with these configuration?

Configure e2guardian with automatic mode and watchdog

Then follow this post to configure squid in transparent mode with splice all and custom options to forward traffic to e2guardian.

https://forum.pfsense.org/index.php?topic=128116.msg730725#msg730725

EDIT

This is a tutorial in Portuguese with basic setup instructions and some screenshots

https://eliasmoraispereira.wordpress.com/2017/06/21/pfsense-proxy-transparente-mitm-no-modo-splice-all-com-squid-e2guardian/

jetberrocal

@marcelloc:

@jetberrocal:

Can you provide some screenshots with these configuration?

Configure e2guardian with automatic mode and watchdog

Then follow this post to configure squid in transparent mode with splice all and custom options to forward traffic to e2guardian.

https://forum.pfsense.org/index.php?topic=128116.msg730725#msg730725

EDIT

This is a tutorial in Portuguese with basic setup instructions and some screenshots

https://eliasmoraispereira.wordpress.com/2017/06/21/pfsense-proxy-transparente-mitm-no-modo-splice-all-com-squid-e2guardian/

But that link says is to filter without MITM. I want to filter with mitm and be able to activate squid cache for http and https.

marcelloc

Do not enable MITM for transparent proxy users with a group on e2guardian and keep it intercepting for WPAD/configured users.

jetberrocal

@marcelloc:

Do not enable MITM for transparent proxy users with a group on e2guardian and keep it intercepting for WPAD/configured users.

I am confused.

I know I cant use mitm in transparent mode but you keep recommending to use squid in transparent mode splice-all to protect e2g from bad form ssl sites because e2g still crashes very often without it.

And now your still recommending to use this mode to be able to use squid cache features for https sites.

So I am concluding that e2g content filtering for https is not available as this wont work with squid cache nor squid splice-all protection.

pfsensation

@jetberrocal:

@marcelloc:

Do not enable MITM for transparent proxy users with a group on e2guardian and keep it intercepting for WPAD/configured users.

I am confused.

I know I cant use mitm in transparent mode but you keep recommending to use squid in transparent mode splice-all to protect e2g from bad form ssl sites because e2g still crashes very often without it.

And now your still recommending to use this mode to be able to use squid cache features for https sites.

So I am concluding that e2g content filtering for https is not available as this wont work with squid cache nor squid splice-all protection.

I'm having the same experience Jetberrocal. Thought it was me not understanding.

However I wanted to add a couple things, won't Squid MITM interfere with E2Guardian? I tried this once and Squid couldn't even give usable forged certificates. It wasn't setting SUBJECT ALTERNATIVE Name and I was unable to browse https sites.

OH, and YES MITM can be used transparently. However the certificate will still need to be installed, I've seen it on smoothwall. I am able to just install the certificate and browse without messing with proxy settings or wpad.
My idea was actually to get all devices in the home using mitm, and all guests using non mitm filtering.

marcelloc

The squid daemon after e2guardian protects it from crashing. This is one point that I do not recommend disabling (automatic mode) until we identify and open an issue on e2guardian project.

This will cover almost all configuration together with wpad.

Any extra configuration can be done together with this initial setup.

For basic squid authentication methods that e2guardian is able to handle (according to it's documentation) can be configured replacing automatic parent with squid package behind e2guardian (keeping ssl on with splice all mode)

For transparent proxy setups, e2guardian MITM cannot be used because this feature is not implemented yet(will be on 5.0). If you need transparent mode for http and https, use squid with splice all from squid package. In this setup, you can use e2guardian acls configuring squid to send connections to it after transparent rules get client connection.

Caching is something IMHO useless with most web content dynamic but squid memory cache is something that I still Configure on both squids (automatic parent or squid package)

Hope I could make myself clear about proxy features and configuration using e2guardian package.

marcelloc

@pfsensation:

I am still waiting on that bug with blacklisted sites not showing category to be fixed. Thanks again for porting this over to pfSense, and keeping everything free, accessible and open source!

Found how to show it. Each blacklist file needs the listcategory definition inside it. Editing /usr/local/etc/e2guardian/lists/blacklists/porn/domains and including #listcategory: "Porn Banned Sites" shows the category on block page.

The default shallalist doesn't has it ou their files. I'll workaround it during apply config or blacklist fetch.

![site category.PNG](/public/imported_attachments/1/site category.PNG)
![site category.PNG_thumb](/public/imported_attachments/1/site category.PNG_thumb)

pfsensation

@marcelloc:

@pfsensation:

I am still waiting on that bug with blacklisted sites not showing category to be fixed. Thanks again for porting this over to pfSense, and keeping everything free, accessible and open source!

Found how to show it. Each blacklist file needs the listcategory definition inside it. Editing /usr/local/etc/e2guardian/lists/blacklists/porn/domains and including #listcategory: "Porn Banned Sites" shows the category on block page.

The default shallalist doesn't has it ou their files. I'll workaround it during apply config or blacklist fetch.

Awesome if you can properly add this. I can improve my block page further and push it out on Github.

I'm realising one big problem, every five days my pfSense just crashes. This has happened for the second time now. Squid is on splice all, I don't understand why. 4.1 E2G is giving me such a love and hate relationship with it. But even then it's way better than Squid Guard, which is shocking.

marcelloc

The system crash maybe related to memory or system resources exhausted. The crash I'm getting without splice all are just daemon Segmentation fault.

Try to "refresh" process every two days for example with a script on cron and see if these dumps stop happening.

pfsensation

@marcelloc:

The system crash maybe related to memory or system resources exhausted. The crash I'm getting without splice all are just daemon Segmentation fault.

Try to "refresh" process every two days for example with a script on cron and see if these dumps stop happening.

The max my entire memory usage goes to is 50% average 20% on top of that cpu utilisation is very low. Usually 0.20 load average on a multi core processor.

Also I decreased HTTP workers after last time to 200. I don't think it's a utilisation problem at all, because it happens only after 5 days always.

pfsensation

Hmm what happened to this thread? :o

Marcelloc, I'm considering reinstalling everything and starting from scratch. I really don't know what's going on, since I installed E2guardian 4. I'm getting sudden crashes, dhcp stops working. It's really doing my head in. Can I take a backup of my setup, and reinstall pfsense then restore it? I'm asking this again because obviously WPAD and E2guardian packages are both on your unofficial repo.

Also if I restore, I can use the existing certificates right? No need to generate new ones.

Edit : I've tried running a couple fsck's still no joy.

marcelloc

With the xml backup, you can restore everything.

Before you restore the backup, enable the Unofficial repo.

Do you have another hardware to test?

pfsensation

@marcelloc:

With the xml backup, you can restore everything.

Before you restore the backup, enable the Unofficial repo.

Do you have another hardware to test?

No I haven't got other hardware to test, but I may try in a VM.

I am getting this if I try updating via console :
pkg: Repository Unofficial load error: access repo file(/var/db/pkg/repo-Unofficial.sqlite) failed: No such file or directory

I tried reinstalling the repo. That seemed to fix it.

Is E2Guardian really working perfectly for you and fully stable?