Dansguardian package for 2.0

marcelloc

SSL filtering working now?

Not yet. Same invalid cert issue.

dig1234

SSL filtering working now?

I am able to get past the Invalid Server Certificate error message by dropping all the recognized public CA certs in the /etc/ssl folder (along with the appropriate symlinks named with the hash value of each cert) but I'm stuck on a missing cgi script called mitm.cgi.
Daniel Barron over on the dansguardian-dev list informed me that this script has not been open sourced by smoothwall and that we would have to reverse engineer/rewrite it based on the dansguardian mitm source code.

If you want more details on how to install those certs let me know.

marcelloc

@dig1234:

If you want more details on how to install those certs let me know.

dig1234,

I've already included the ca-root package as well links to ca folder, can you test on a virtual machine if this patch results on the same point you got?

dig1234

@marcelloc:

dig1234,

I've already included the ca-root package as well links to ca folder, can you test on a virtual machine if this patch results on the same point you got?

Hi I tried this, fresh pfsense install on vmware, installed dans and squid, turned on cert check & mitm. Now I just get connection refused when trying https sites. Also in the logs I see dansguardian[17654]: error opening new certificate. So, no I am not at the same place.

One thing I noticed is that you have added the 150 public certs to /etc/ssl but they are all in one file called cert.pem. Dans wants each one to be in a separate. Also they need to be named with the hash value of the cert (or symlinks by that name). They should look something like this:
ef2f636c.0
f060240e.0
f081611a.0
f15719eb.0
f3377b1b.0

UPDATE:
I turned off mitm and left cert checking turned on and didn't get any errors so maybe it is finding the certs. The problem now is with creation of the 'forged' certs.. Is there a way to get more verbose logging from dansguardian?

abnz

I had issues and uninstalled DG, Squid, HAVP, reinstalled Dansguardian –--> HAVP ----> WWW, so no more squid.

I now get in the system logs: Dans Guardian [xxxx} "Error connecting via IPC socket to log: No such file or directory"

After a reboot Dansguardian doesnt start, it starts from web configurator fine, workd fine, just using ram I think and get this in the log quite frequently. Any one seen this?

dig1234

@abnz:

After a reboot Dansguardian doesnt start, it starts from web configurator fine, workd fine, just using ram I think and get this in the log quite frequently. Any one seen this?

I experienced the same, dans not starting on reboot but starts fine from webgui later. I attributed it to squid taking a longer time to start, but I could be wrong…

marcelloc

@dig1234:

I experienced the same, dans not starting on reboot but starts fine from webgui later. I attributed it to squid taking a longer time to start, but I could be wrong…

I've just installed a clean 2.0.1 install with dansguardian and squid3 package and I still had no luck on reproducing this issue.

Can you check what happens during your boot process?

debug_dansguardian_01.png_thumb

rjcrowder

@dig1234:

@abnz:

After a reboot Dansguardian doesnt start, it starts from web configurator fine, workd fine, just using ram I think and get this in the log quite frequently. Any one seen this?

I experienced the same, dans not starting on reboot but starts fine from webgui later. I attributed it to squid taking a longer time to start, but I could be wrong…

Same issue here and I tend to thing dig1234 is correct… has to be a timing issue - which would be different depending on the machine. That said, doesn't it make sense that DG should start after Squid anyway? DG is dependent on Squid to proxy...

Also, haven't been able to find anywhere that DG gives an error message as to why it won't start. Let me know if you have any idea where I should look.

marcelloc

@rjcrowder:

Also, haven't been able to find anywhere that DG gives an error message as to why it won't start. Let me know if you have any idea where I should look.

Can you check boot process just like I've posted?

rjcrowder

@marcelloc:

@rjcrowder:

Also, haven't been able to find anywhere that DG gives an error message as to why it won't start. Let me know if you have any idea where I should look.

Can you check boot process just like I've posted?

I couldn't figure out how you got VirtualBox bigger - so I couldn't take a screenshot showing everything… However, the boot looks the exact same as the one you posted with the exception of dansguardian not running... in other words, the ps grepping for dans does not show anything.

BTW. I noted that if you install the old version of squid, it starts before dans.

marcelloc

@rjcrowder:

I couldn't figure out how you got VirtualBox bigger

printscreens and paint/gimp ;)

@rjcrowder:

In other words, the ps grepping for dans does not show anything.

BTW. I noted that if you install the old version of squid, it starts before dans.

I'm checking dansguardian boot process. I've fixed clamav startup error when enabled on dansguardian but I'll do more tests before publishing and I still have no idea why some systems are getting issues on boot and other don't.

rjcrowder

@marcelloc:

@rjcrowder:

I couldn't figure out how you got VirtualBox bigger

printscreens and paint/gimp ;)

@rjcrowder:

In other words, the ps grepping for dans does not show anything.

BTW. I noted that if you install the old version of squid, it starts before dans.

I'm checking dansguardian boot process. I've fixed clamav startup error when enabled on dansguardian but I'll do more tests before publishing and I still have no idea why some systems are getting issues on boot and other don't.

So… can't explain it, but DG seems to be starting up fine in the new virtual that I built. This is the first time I've seen it startup without needing to be restarted post-boot. All of that said, I do think that DG should start after squid and suspect that doing so would solve problems that people are having.

I was also wondering if you have given any thought to changing how the GUI handles the "denied" page? The thing that is stopping me from fully switching to PFsense is the fact that the GUI doesn't properly support using an access denied URL and both the GUI and the bootup process insist on overwriting my manual DG bypass changes (see this threadhttp://forum.pfsense.org/index.php/topic,47856.30.html. Obviously I can create a script to restore my changes, but that's a pretty inconvenient hack…

Just wondering... thanks!

rjcrowder

So I did a little more playing around so that I could be specific about what is necessary to make the bypass feature work correctly (without any overwrite issues)…

1. In the "Report and Log" page...
- Add the ability to specify the "accessdeniedaddress" value instead of just the HTML form content

2. In the "Groups" page...
- Add the ability to specify the "accessdeniedaddress"
- Add the ability to specify the "bypasskey"

That would basically do it...

marcelloc

I've just pushed some fixes do improve dansguardian boot process and checks.

On my tests, dansguardian startup time during boot process reduced to 20 seconds.

Wait 15 minutes, reinstall the package, apply config and reboot.

rjcrowder

@marcelloc:

I've just pushed some fixes do improve dansguardian boot process and checks.

On my tests, dansguardian startup time during boot process reduced to 20 seconds.

Wait 15 minutes, reinstall the package, apply config and reboot.

Thanks for the updates… BTW. I made the changes to include 'bypasskey' and 'accessdeniedaddress' on the groups page. Turns out this was all I had to do in order to make my changes work (since the settings in dansguardianf1.conf override those that are set in dansguardian.conf). It was a pretty simple change, but you can drop me an email at randyj.crowder@gmail.com if you want me to send you the three files I had to touch - they were dansguardian_groups.xml, dansguardian.conf.template, dansguardian.inc (in /usr/local/pkg).

marcelloc

@rjcrowder:

I made the changes to include 'bypasskey' and 'accessdeniedaddress' on the groups page.

Push these changes via github https://github.com/bsdperimeter/pfsense-packages/tree/master/config/dansguardian.

This way I can check changes and commit to the code.

rjcrowder

@marcelloc:

@rjcrowder:

I made the changes to include 'bypasskey' and 'accessdeniedaddress' on the groups page.

Push these changes via github https://github.com/bsdperimeter/pfsense-packages/tree/master/config/dansguardian.

This way I can check changes and commit to the code.

OK…done.

BTW. I was looking at the main "report and log" page (dansguardian_log.xml). The way it really should work is if you pick reporting level 3, then it enables the editing of the html template in the text box. Otherwise, it should enable a field for entering the accessdeniedaddress... I was digging through the package directory and saw how to enable fields from a checkbox, but couldn't figure out how to enable/disable multiple fields based on the value selected from a list... Sorry for my ignorance.

marcelloc

@rjcrowder:

OK…done.

I'm seeing only one push on github.

https://github.com/rjcrowder/pfsense-packages/commit/aa9fbaf910c0e1a3465826f9f5483646ab6b819e

What happen if user do not select any custom error page? Your code force this option on dansguardianfx.conf.template

accessdeniedaddress = '{$dansguardian_groups['accessdeniedaddress']}'

rjcrowder

@marcelloc:

@rjcrowder:

OK…done.

I'm seeing only one push on github.

https://github.com/rjcrowder/pfsense-packages/commit/aa9fbaf910c0e1a3465826f9f5483646ab6b819e

What happen if user do not select any custom error page? Your code force this option on dansguardianfx.conf.template

accessdeniedaddress = '{$dansguardian_groups['accessdeniedaddress']}'

K… I'll try to figure out what I did wrong on pushing to github - first time I've used it.

As far as the accessdeniedaddress, it should be fine to not specify a URL as long as the reportinglevel is 3. That's why I also "uncommented" the reportinglevel field in dansguardianfx.conf.template.

Like I said on the main page, the UI should only allow you to specify the template content if you choose level 3. Since the template file is global, there is no need to put it on the group page. However, the accessdeniedaddress field should be disabled on the group page if you pick reportinglevel 3 - since it would be ignored anyway.

rjcrowder

@marcelloc:

@rjcrowder:

OK…done.

I'm seeing only one push on github.

https://github.com/rjcrowder/pfsense-packages/commit/aa9fbaf910c0e1a3465826f9f5483646ab6b819e

What happen if user do not select any custom error page? Your code force this option on dansguardianfx.conf.template

accessdeniedaddress = '{$dansguardian_groups['accessdeniedaddress']}'

I'll figure out what I did wrong… but all the changes are out there under different patches...