Postfix - antispam and relay package

marcelloc

Included postfwd functions to limit messages per user and time based on package.

To use this funcion you must run the install cpan modules script from pkg-mailscanner

https://raw.githubusercontent.com/marcelloc/Unofficial-pfSense-packages/master/pkg-mailscanner/files/install_cpan_modules_23.sh

Fist time implementation, not used to run postfwd, so feedbacks are always welcome.

postfwd.PNG_thumb

marcelloc

@marcelloc:

@Bismarck:

Yes, but it looks like the widget just counts high scored spam and not all, same when searching for spam in postfix_search.php it just finds high scored spam and the numbers of high scored spam are are always the same in the widget and MailMatch.

The point is that database gets the last status from message. 'Normal spam' on your configuration are sent to user, this way, last state is sent, instead of spam.

I've pushed a commit that updates the status only when it's not a spam message
https://github.com/marcelloc/Unofficial-pfSense-packages/commit/d6dcd6d63ae83886aa9da00f545137fa2cd6b046

marcelloc

Also, I've include 7zip, rar and PDFID patch to mailscanner package, just re-run install to get latest updates.

Thanks for Bismarck and danny at tweegy.nl 8)

Bismarck

Thanks, I'm not at the office at the moment, will check it out when back. 8)

Bigdaddy168

Hey guys, would it be possible to include a pop3 connector like fetchmail or getmail?

marcelloc

@Bigdaddy168:

Hey guys, would it be possible to include a pop3 connector like fetchmail or getmail?

There was a package for it(p3scan) but it's too old and abandoned http://p3scan.sourceforge.net

danjeman

updated but now have two 'Mailscanner' Service menu items… Looks like the check_mailscanner_service.php is looking for menu item 'mailscanner' not 'Mailscanner'...

marcelloc

@danjeman:

updated but now have two 'Mailscanner' Service menu items… Looks like the check_mailscanner_service.php is looking for menu item 'mailscanner' not 'Mailscanner'...

Thanks for the feedback. I'll fix it.

danjeman

Was not getting any sqllite db's from the logs despite all settings being correct then found an old post referencing an issue if you have other characters in the hostname (- for instance which I do). So took a look at postfix.php and updated the regex match looking for date and hostname from:
preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+))….. to
preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+([.-]?\w+))….... and voilla now have widget and search logs available...

Will verify stats are valid but looks good so far :)

n3by

I think I am in the same situation as I have some hosts and email addresses that contain " - " and widget is not updating.

Can you please be more specific where in the file and what to change/patch as searching for

preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+)
```=```
preg_match("/(\\w+\\s+\\d+\\s+[0-9,:]+) (\\w+)
```find many instances of that code.

Please use "Insert Code" to preserve the format.

thank you.

marcelloc

@ecfx:

Can you please be more specific where in the file and what to change/patch.

At the beginning of every log pregmatch under /usr/local/www/postfix.php

I'll modify it to get hostname from system or xml

danjeman

This is just for matching the system hostname from the log…

There are 10 instances of that code at lines 253, 263, 275, 284, 295, 300, 305, 309, 319 and 357. Each one is parsing for a particular process log (postfix/smtpd, Mailscanner etc)

Replace

preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+)

with

preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+([\.-]?\w+))

There's probably a neater way to get the hostname but this does the job for my case at least.

n3by

Thank you now is clear, patched.

danjeman

Ok so widget crashed now due to memory allocation error… also not seeing any sent mails being logged but that could be configuration error (or will it not log those?)...


					Crash report begins.  Anonymous machine information:

amd64
10.3-RELEASE-p17
FreeBSD 10.3-RELEASE-p17 #10 6da131e75c7(RELENG_2_3_3): Wed Mar  8 14:24:33 CST 2017     root@ce23-amd64-builder:/builder/pfsense-233/tmp/obj/builder/pfsense-233/tmp/FreeBSD-src/sys/pfSense

Crash report details:

PHP Errors:
[19-Apr-2017 12:47:34 Europe/London] PHP Fatal error:  Allowed memory size of 262144000 bytes exhausted (tried to allocate 1262797654 bytes) in 

/usr/local/www/widgets/widgets/postfix.widget.php on line 146
[19-Apr-2017 12:47:34 Europe/London] PHP Stack trace:
[19-Apr-2017 12:47:34 Europe/London] PHP   1\. {main}() /usr/local/www/index.php:0
[19-Apr-2017 12:47:34 Europe/London] PHP   2\. include_once() /usr/local/www/index.php:438
[19-Apr-2017 12:48:41 Europe/London] PHP Fatal error:  Allowed memory size of 262144000 bytes exhausted (tried to allocate 1262797654 bytes) in /usr/local/www/widgets/widgets/postfix.widget.php on line 146
[19-Apr-2017 12:48:41 Europe/London] PHP Stack trace:
[19-Apr-2017 12:48:41 Europe/London] PHP   1\. {main}() /usr/local/www/index.php:0
[19-Apr-2017 12:48:41 Europe/London] PHP   2\. include_once() /usr/local/www/index.php:438

Filename: /var/crash/minfree
2048

marcelloc

What is the max file size you configured for widget?

danjeman

Left it blank so assuming default of 100mb? Will specify and test again.

Currently files are less than 1M each and only 4 of them…


-rw-r--r--  1 root     postfix   200K Apr 18 17:05 2017-04-15.db
-rw-r--r--  1 root     postfix   184K Apr 18 16:31 2017-04-17.db
-rw-r--r--  1 root     postfix   516K Apr 19 14:18 2017-04-18.db
-rw-r--r--  1 root     postfix   976K Apr 19 14:20 2017-04-19.db

EDIT: Also noticed widget only has one line with yesterday's date although the totals and reject and spam stats are increasing…

danjeman

Just noticed on the Access Lists page I couldn't edit sender, MIME or body filters and spotted the 'a' tag was still open… Line 109 of /usr/local/pkg/postfix_acl.xml is missing the closing tag

<description>PCRE filters [that are applied to initial message helo info. Hint:
[/code]

Should be
[code]<description>PCRE filters</description>](http://www.postfix.org/pcre_table.5.html) [that are applied to initial message helo info.](http://www.postfix.org/pcre_table.5.html) Hint:
[/code][/code]</description>

marcelloc

@danjeman:

Just noticed on the Access Lists page I couldn't edit sender, MIME or body filters and spotted the 'a' tag was still open… Line 109 of /usr/local/pkg/postfix_acl.xml is missing the closing tag

Fixed. Thanks for the feedback

marcelloc

@danjeman:

Ok so widget crashed now due to memory allocation error…

I've updated the widget file to allow more php memory use.

marcelloc

@danjeman:

Was not getting any sqllite db's from the logs despite all settings being correct then found an old post referencing an issue if you have other characters in the hostname (- for instance

I've changed the preg_match from (\w+) to (\S+)

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/0893d4a2e523688ccd56d419ff1d7c8be5c51cd2