Dansguardian 2.12.0.3 Signal 11

rjcrowder

@Fredb:

Marcelloc can you also make a package with and without "–with-dgdebug=on" ?

Sure, It's on my repo now.

http://e-sac.siteseguro.ws/packages/amd64/8/All/dansguardian-2.12.0.6.sig11.debug.tbz

Thanks Marcello… have been a little busy. I will try to get this in over the weekend...

rjcrowder

@Fredb:

Yes sorry,
Marcelloc can you also make a package with and without "–with-dgdebug=on" ?
I think the first step is trying without

@rjcrowder have you tried with 300, or less ?

OK… I wasn't 100% sure, so I made some assumptions about what you were asking for.

At the moment, I'm running dans as follows...

nohup ./dansguardian-2.12.0.6-dbg -N > & /tmp/debug &

This will send all stdout and stderr messages to /tmp/debug. I'll let you know if I get a Sig 11

Fredb

Perfect, Be careful the system can be unstable, If you have a problem with debug mode (100 % cpu or high memory usage, disk full, etc) try the other build from Marcelloc. It's less interesting for us but it's more faster.

Thanks for your help

rjcrowder

@Fredb:

Perfect, Be careful the system can be unstable, If you have a problem with debug mode (100 % cpu or high memory usage, disk full, etc) try the other build from Marcelloc. It's less interesting for us but it's more faster.

Thanks for your help

OK… got a signal 11 earlier this afternoon. Uploading now to my public dropbox - https://www.dropbox.com/sh/y3qoeiyxnvxl8c1/xmr7LJpScy It might take a while and I'll warn you that the file is huge. Let me know when you've got it. Thanks!

Fredb

I've got it, thanks
Doh big file ! It's not easy to find where the "signal 11" hides

rjcrowder

@Fredb:

I've got it, thanks
Doh big file ! It's not easy to find where the "signal 11" hides

I caught it fairly quickly… should be toward the end somewhere...

Fredb

Yes in system.log.sig11
Jun 1 17:04:21 pfsense kernel: pid 10303 (dansguardian-2.12.0), uid 106: exited on signal 11

But it's hard to correlate with the other file, for the moment I didn't see any point

rjcrowder

@Fredb:

But it's hard to correlate with the other file, for the moment I didn't see any point

yea… I was wondering how you could correlate them. There's nothing in the debug log that says "signal 11"... That's all I have though - those two logs.

Fredb

Very, very strange, there is no error in debug's file between Date: Sat, 01 Jun 2013 17:02:09 GMT and Date: Sat, 01 Jun 2013 17:04:31 GMT
DG run with very low load, without problem

busychildren:1
freechildren:32
waitingfor:0

Seems close to http://forum.pfsense.org/index.php?topic=58395.0 in both case the process seem doesn't really crashed (no need to restart)

I don't know what to think, there is no problem with oldest versions ?

EDIT: For those who suffer from "dansguardian -N" issues I will release a new version with a fix next week, here http://numsys.eu/search.php?search=Dansguardian

Fredb

Marcelloc as you know there was a problem with pcre recently, do you compile with pcre on or off ?
Can we make a test with off ?

rjcrowder

@Fredb:

Seems close to http://forum.pfsense.org/index.php?topic=58395.0 in both case the process seem doesn't really crashed (no need to restart)

I know I've seen it since 12.0.3 Not sure prior to that…

marcelloc

@Fredb:

Marcelloc as you know there was a problem with pcre recently, do you compile with pcre on or off ?
Can we make a test with off ?

I think it's marked as a dependence on freebsd ports, I'll try to compile it without pcre.

Does dansguardian works fine without pcre????

rjcrowder

@marcelloc:

Does dansguardian works fine without pcre????

see this http://contentfilter.futuragts.com/wiki/doku.php?id=pattern_matching. However - looks like compiling without PCRE may cause a problem with some of the regex expressions in the current config…

Fredb

Yes, pcre is for advanced regex

rjcrowder

@Fredb:

Very, very strange, there is no error in debug's file between Date: Sat, 01 Jun 2013 17:02:09 GMT and Date: Sat, 01 Jun 2013 17:04:31 GMT
DG run with very low load, without problem

busychildren:1
freechildren:32
waitingfor:0

Seems close to http://forum.pfsense.org/index.php?topic=58395.0 in both case the process seem doesn't really crashed (no need to restart)

I don't know what to think, there is no problem with oldest versions ?

EDIT: For those who suffer from "dansguardian -N" issues I will release a new version with a fix next week, here http://numsys.eu/search.php?search=Dansguardian

Hey guys… just wanted to bump this thread and see if there was any update. I'm still getting the occasional signal 11. Doesn't seem to cause any perceptible problem, but I"m thinking it's something that should get fixed... Any further ideas or things I can test to help with this issue?

Fredb

@rjcrowder

We had rewritten a part of engine for Linux ( http://numsys.eu/search.php?search=Dansguardian ), but the project need help for Freebsd, testing and new codes …
I'm searching how will the project be sustained after, an sponsor ? a fork ? I do not yet know

rjcrowder

@Fredb:

@rjcrowder

We had rewritten a part of engine for Linux ( http://numsys.eu/search.php?search=Dansguardian ), but the project need help for Freebsd, testing and new codes …
I'm searching how will the project be sustained after, an sponsor ? a fork ? I do not yet know

So is there already a BSD version that uses kqueue? Does the epoll rewrite fix the sig 11 issue?

No promises, but I might pull the code down for 2.12.0.7 and take a look at it…

Fredb

Sorry about my English, I guess I'm not clear

I mean DG used not optimized codes, in Fatcontrol.cpp, Philip Pearce has rewrites large parts of codes for Linux only (epoll), it's the first step, and the result is very very impressive.

My part was to preserve the old code in compilation, so:

Linux -> Many parts with epoll (still some old parts)
BSD -> Perhaps I made some minor fixes, and perhaps I put some new bugs, but no major changes (old codes)

So for beginning this version need tests with BSD (code broken ?), it's the second step, and after will do exactly the same work for BSD ( but with Kqueue http://en.wikipedia.org/wiki/Kqueue ).

I think we also works about some new features …

rjcrowder

@Fredb:

My part was to preserve the old code in compilation, so:

Linux -> Many parts with epoll (still some old parts)
BSD -> Perhaps I made some minor fixes, and perhaps I put some new bugs, but no major changes (old codes)

Is this the latest code with your changes? http://numsys.eu/dansguardian/dansguardian-2.12.0.7.tar.gz

Fredb

@rjcrowder:

@Fredb:

My part was to preserve the old code in compilation, so:

Linux -> Many parts with epoll (still some old parts)
BSD -> Perhaps I made some minor fixes, and perhaps I put some new bugs, but no major changes (old codes)

Is this the latest code with your changes? http://numsys.eu/dansguardian/dansguardian-2.12.0.7.tar.gz

Yes right, all the code is between #ifdef linux tag in Fatcontrol.cpp (code from Philip Pearce of http://www.e2bn.org/ )
I think there are also some work to do in basesocket.cpp, we will do it later, to improve again