Postfix - antispam and relay package

Bismarck · Apr 17, 2017, 8:15 AM

Thanks, I'm not at the office at the moment, will check it out when back. 8)

Bigdaddy168 · Apr 17, 2017, 8:29 AM

Hey guys, would it be possible to include a pop3 connector like fetchmail or getmail?

marcelloc · Apr 17, 2017, 9:54 AM

@Bigdaddy168:

Hey guys, would it be possible to include a pop3 connector like fetchmail or getmail?

There was a package for it(p3scan) but it's too old and abandoned http://p3scan.sourceforge.net

danjeman · Apr 17, 2017, 3:33 PM

updated but now have two 'Mailscanner' Service menu items… Looks like the check_mailscanner_service.php is looking for menu item 'mailscanner' not 'Mailscanner'...

marcelloc · Apr 17, 2017, 4:02 PM

@danjeman:

updated but now have two 'Mailscanner' Service menu items… Looks like the check_mailscanner_service.php is looking for menu item 'mailscanner' not 'Mailscanner'...

Thanks for the feedback. I'll fix it.

danjeman · Apr 18, 2017, 3:46 PM

Was not getting any sqllite db's from the logs despite all settings being correct then found an old post referencing an issue if you have other characters in the hostname (- for instance which I do). So took a look at postfix.php and updated the regex match looking for date and hostname from:
preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+))….. to
preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+([.-]?\w+))….... and voilla now have widget and search logs available...

Will verify stats are valid but looks good so far :)

n3by · Apr 18, 2017, 4:45 PM

I think I am in the same situation as I have some hosts and email addresses that contain " - " and widget is not updating.

Can you please be more specific where in the file and what to change/patch as searching for

preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+)
```=```
preg_match("/(\\w+\\s+\\d+\\s+[0-9,:]+) (\\w+)
```find many instances of that code.

Please use "Insert Code" to preserve the format.

thank you.

marcelloc · Apr 18, 2017, 5:36 PM

@ecfx:

Can you please be more specific where in the file and what to change/patch.

At the beginning of every log pregmatch under /usr/local/www/postfix.php

I'll modify it to get hostname from system or xml

danjeman · Apr 18, 2017, 5:45 PM

This is just for matching the system hostname from the log…

There are 10 instances of that code at lines 253, 263, 275, 284, 295, 300, 305, 309, 319 and 357. Each one is parsing for a particular process log (postfix/smtpd, Mailscanner etc)

Replace

preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+)

with

preg_match("/(\w+\s+\d+\s+[0-9,:]+) (\w+([\.-]?\w+))

There's probably a neater way to get the hostname but this does the job for my case at least.

n3by · Apr 18, 2017, 6:03 PM

Thank you now is clear, patched.

danjeman · Apr 19, 2017, 12:42 PM

Ok so widget crashed now due to memory allocation error… also not seeing any sent mails being logged but that could be configuration error (or will it not log those?)...


					Crash report begins.  Anonymous machine information:

amd64
10.3-RELEASE-p17
FreeBSD 10.3-RELEASE-p17 #10 6da131e75c7(RELENG_2_3_3): Wed Mar  8 14:24:33 CST 2017     root@ce23-amd64-builder:/builder/pfsense-233/tmp/obj/builder/pfsense-233/tmp/FreeBSD-src/sys/pfSense

Crash report details:

PHP Errors:
[19-Apr-2017 12:47:34 Europe/London] PHP Fatal error:  Allowed memory size of 262144000 bytes exhausted (tried to allocate 1262797654 bytes) in 

/usr/local/www/widgets/widgets/postfix.widget.php on line 146
[19-Apr-2017 12:47:34 Europe/London] PHP Stack trace:
[19-Apr-2017 12:47:34 Europe/London] PHP   1\. {main}() /usr/local/www/index.php:0
[19-Apr-2017 12:47:34 Europe/London] PHP   2\. include_once() /usr/local/www/index.php:438
[19-Apr-2017 12:48:41 Europe/London] PHP Fatal error:  Allowed memory size of 262144000 bytes exhausted (tried to allocate 1262797654 bytes) in /usr/local/www/widgets/widgets/postfix.widget.php on line 146
[19-Apr-2017 12:48:41 Europe/London] PHP Stack trace:
[19-Apr-2017 12:48:41 Europe/London] PHP   1\. {main}() /usr/local/www/index.php:0
[19-Apr-2017 12:48:41 Europe/London] PHP   2\. include_once() /usr/local/www/index.php:438

Filename: /var/crash/minfree
2048

marcelloc · Apr 19, 2017, 12:56 PM

What is the max file size you configured for widget?

danjeman · Apr 19, 2017, 1:58 PM

Left it blank so assuming default of 100mb? Will specify and test again.

Currently files are less than 1M each and only 4 of them…


-rw-r--r--  1 root     postfix   200K Apr 18 17:05 2017-04-15.db
-rw-r--r--  1 root     postfix   184K Apr 18 16:31 2017-04-17.db
-rw-r--r--  1 root     postfix   516K Apr 19 14:18 2017-04-18.db
-rw-r--r--  1 root     postfix   976K Apr 19 14:20 2017-04-19.db

EDIT: Also noticed widget only has one line with yesterday's date although the totals and reject and spam stats are increasing…

danjeman · Apr 19, 2017, 2:11 PM

Just noticed on the Access Lists page I couldn't edit sender, MIME or body filters and spotted the 'a' tag was still open… Line 109 of /usr/local/pkg/postfix_acl.xml is missing the closing tag

<description>PCRE filters [that are applied to initial message helo info. Hint:
[/code]

Should be
[code]<description>PCRE filters</description>](http://www.postfix.org/pcre_table.5.html) [that are applied to initial message helo info.](http://www.postfix.org/pcre_table.5.html) Hint:
[/code][/code]</description>

marcelloc · Apr 19, 2017, 6:54 PM

@danjeman:

Just noticed on the Access Lists page I couldn't edit sender, MIME or body filters and spotted the 'a' tag was still open… Line 109 of /usr/local/pkg/postfix_acl.xml is missing the closing tag

Fixed. Thanks for the feedback

marcelloc · Apr 19, 2017, 7:52 PM

@danjeman:

Ok so widget crashed now due to memory allocation error…

I've updated the widget file to allow more php memory use.

marcelloc · Apr 19, 2017, 7:37 PM

@danjeman:

Was not getting any sqllite db's from the logs despite all settings being correct then found an old post referencing an issue if you have other characters in the hostname (- for instance

I've changed the preg_match from (\w+) to (\S+)

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/0893d4a2e523688ccd56d419ff1d7c8be5c51cd2

danjeman · Apr 19, 2017, 8:24 PM

@marcelloc:

I've changed the preg_match from (\w+) to (\S+)

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/0893d4a2e523688ccd56d419ff1d7c8be5c51cd2

Re- ran the installer and all looks good so far, thanks! :)

danjeman · Apr 20, 2017, 9:49 AM

Noticed that the options for 'SPF lookup HELO' and 'SPF lookup Mail From' are missing 'Fail' option..

Looks like option Null for 'HELO' has value Fail set as well as option Fail so 'Fail' never displays (also would mean selecting Null didn't do what you expect).

For 'Mail From' option Null shouldn't be an option (according to the commented policyd-spf.conf) so removing this will correct the available options.

marcelloc · Apr 20, 2017, 6:01 PM

@danjeman:

Noticed that the options for 'SPF lookup HELO' and 'SPF lookup Mail From' are missing 'Fail' option..

Looks like option Null for 'HELO' has value Fail set as well as option Fail so 'Fail' never displays (also would mean selecting Null didn't do what you expect).

For 'Mail From' option Null shouldn't be an option (according to the commented policyd-spf.conf) so removing this will correct the available options.

thanks for the pull request on github :)