Postfix - antispam and relay package

marcelloc

Hi, I've pushed to pkg-postfix an auto cloudbased domains whitelist option.

This update prevents cloud based domains endless Service currently unavailable problems against Postscreen that we see on almost all postscreen base configuration worldwide.

This can be used together with RBL whitelist/negative rbl score and postwhite

When a network/CIDR is whitelisted by this function it does not bypass any other postfix, acl, mailscanner, clamav or spamassassin test. :)

auto_whitelist.PNG_thumb

view_config.PNG_thumb

Bismarck

@marcelloc - Excellent work! :)

Just in case you have problems to update to 2.3.4-RELEASE because of bugged pkg:

https://forum.pfsense.org/index.php?topic=130071.msg716776#msg716776

marcelloc

@Bismarck:

@marcelloc - Excellent work! :)

thanks Bismarck

@Bismarck:

Just in case you have problems to update to 2.3.4-RELEASE because of bugged pkg:

https://forum.pfsense.org/index.php?topic=130071.msg716776#msg716776

thanks for the info.

Bismarck

Marcello, how does Auto whitelist work, I just see a reference to auto_whitelisted_cidr but no function anywhere?

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/a5d8b57f932b9ffa0f1b275842777723475f1647

marcelloc

The script was uploaded few commits before but I messed up with older files.

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/a9770ddfaf827e025f79fc8d94f4c7e0cec086eb#diff-e50e08425a53cf0a262fae58e6f8de0c

It works together with every minute update database.
It checks for domains that received the 'back later' and if it reaches the count you defined on gui, it looks for all spf records for that domain and whitelist it on postscreen.

The view configuration tab shows whitelisted domains and it's cidrs.

Bismarck

Okay now I got it. ;)

postfix_cloud_domains.php is missing in the install_postfix_23.sh, you maybe want to fix this? :P

marcelloc

@Bismarck:

Okay now I got it. ;)

postfix_cloud_domains.php is missing in the install_postfix_23.sh, you maybe want to fix this? :P

I will. :)

EDIT

done

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/28e7676ee2b665de62cdccd28196975bc407288a

marcelloc

With Bismarck suggestion and help, I did a version of postfix package with DMARC.

I had to change the domain tab from rowhelper to domain list. It changes some internal logic on the package. So I ask you to test it and feedback to see if you get the same result as I did.

The install script is under postfix-DMARC branch, so to install this version, run


fetch https://raw.githubusercontent.com/marcelloc/Unofficial-pfSense-packages/postfix-DMARC/pkg-postfix/files/install_postfix_23.sh
sh install_postfix_23.sh

Warning, this will move and merge your domain config/dkim data on config.xml. So once upgraded to DMARC version, you will need to add all domain config again if you want to back to current stable version.

Once I do more tests and be sure nothing is broken, DMARC version will be the new stable version.

domain_list.PNG_thumb

domain_detail.PNG_thumb

dmarc.PNG_thumb

marcelloc

Did some minor fixes based on Bismarck feedback and also implemented the apply button to package gui

https://github.com/marcelloc/Unofficial-pfSense-packages/commit/1459643eb929263a6811fd75ed30e40f81522844

apply_changes.PNG_thumb

Bismarck

@marcelloc:

I had to change the domain tab from rowhelper to domain list. It changes some internal logic on the package.

I really like the new domain tab, you can even sort the domains via drag&drop. ;)

n3by

It looks like it is not working at pfsense 2.3.4 - new clean install.
here is the install log:

sh ./install_postfix_23.sh
fetching  /usr/local/bin/adexport.pl from github
fetching  /usr/local/pkg/postfix.inc from github
fetching  /usr/local/pkg/postfix.xml from github
fetching  /usr/local/pkg/postfix_acl.xml from github
fetching  /usr/local/pkg/postfix_antispam.xml from github
fetching  /usr/local/pkg/postfix_domains.xml from github
fetching  /usr/local/pkg/postfix_recipients.xml from github
fetching  /usr/local/pkg/postfix_sync.xml from github
fetching  /usr/local/share/pfSense-pkg-postfix/info.xml from github
fetching  /usr/local/www/postfix.php from github
fetching  /usr/local/www/postfix_about.php from github
fetching  /usr/local/www/postfix_queue.php from github
fetching  /usr/local/www/postfix_recipients.php from github
fetching  /usr/local/www/postfix_search.php from github
fetching  /usr/local/www/postfix_view_config.php from github
fetching  /usr/local/www/shortcuts/pkg_postfix.inc from github
fetching  /usr/local/www/widgets/widgets/postfix.widget.php from github
fetching  /usr/local/pkg/postfix_dkim.inc from github
fetching  /usr/local/www/vendor/datatable/se-1.2.0.zip from github
fetching  /usr/local/www/vendor/datatable/css/jquery.dataTables.min.css from github
fetching  /usr/local/bin/sa-learn-pipe.sh from github
fetching  /usr/local/www/vendor/datatable/js/jquery.dataTables.min.js from github
fetching  /usr/local/www/postfix.sql.php from github
fetching  /usr/local/bin/postwhite from github
fetching  /usr/local/pkg/postfix_postwhite.template from github
fetching  /usr/local/www/postfix_cloud_domains.php from github
fetching  /usr/local/www/postfix_migrate_config.php from github
fetching  /usr/local/pkg/postfix_dmarc.inc from github
fetching  /usr/local/pkg/postfix_postfwd.inc from github
cp: /usr/local/www/vendor/datatable/DataTables-1.10.13/images/sort_both.png: No such file or directory
cp: /usr/local/www/vendor/datatable/DataTables-1.10.13/images/sort_asc.png: No such file or directory
Locking pkg-1.10.1_1
Updating FreeBSD repository catalogue...
pkg: Repository FreeBSD load error: access repo file(/var/db/pkg/repo-FreeBSD.sqlite) failed: No such file or directory
Fetching meta.txz: 100%    944 B   0.9kB/s    00:01    
Fetching packagesite.txz: 100%    6 MiB   6.0MB/s    00:01    
Processing entries: 100%
FreeBSD repository update completed. 26276 packages processed.
Updating pfSense-core repository catalogue...
pfSense-core repository is up to date.
Updating pfSense repository catalogue...
pfSense repository is up to date.
All repositories are up to date.

pkg-1.10.1_1 is locked and may not be modified

pkg-1.10.1_1 is locked and may not be modified

pkg-1.10.1_1 is locked and may not be modified
The following 60 package(s) will be affected (of 0 checked):

New packages to be INSTALLED:
	postfix-sasl: 3.1.4,1 [FreeBSD]
	libspf2: 1.2.10_2 [FreeBSD]
	opendkim: 2.10.3_6 [FreeBSD]
	libmilter: 8.15.2 [FreeBSD]
	py27-postfix-policyd-spf-python: 1.3.2_1 [FreeBSD]
	p5-perl-ldap: 0.6500 [FreeBSD]
	postfix-postfwd: 1.35_1 [FreeBSD]
	opendmarc: 1.3.1_4 [FreeBSD]
	pflogsumm: 1.1.5,1 [FreeBSD]
	zip: 3.0_1 [pfSense]
	cyrus-sasl: 2.1.26_12 [FreeBSD]
	xproto: 7.0.31 [FreeBSD]
	jpeg-turbo: 1.5.1 [FreeBSD]
	jbigkit: 2.1_1 [FreeBSD]
	png: 1.6.29 [FreeBSD]
	libfontenc: 1.1.3_1 [FreeBSD]
	freetype2: 2.8 [FreeBSD]
	fontconfig: 2.12.1,1 [FreeBSD]
	pkg-devel: 1.10.99.4 [FreeBSD]
	pixman: 0.34.0 [FreeBSD]
	py27-pyspf: 2.0.12_4 [FreeBSD]
	py27-authres: 0.800 [FreeBSD]
	py27-setuptools: 32.1.0_1 [FreeBSD]
	py27-dns: 2.3.6_1 [FreeBSD]
	python2: 2_3 [FreeBSD]
	py27-ipaddr: 2.1.11 [FreeBSD]
	p5-XML-SAX-Writer: 0.56 [FreeBSD]
	p5-XML-SAX-Base: 1.08_1 [FreeBSD]
	p5-XML-NamespaceSupport: 1.11_1 [FreeBSD]
	p5-XML-Filter-BufferText: 1.01_1 [FreeBSD]
	p5-XML-SAX: 0.99_2 [FreeBSD]
	p5-IO-Socket-SSL: 2.044 [FreeBSD]
	p5-Mozilla-CA: 20160104 [FreeBSD]
	p5-Net-SSLeay: 1.81 [FreeBSD]
	p5-Socket: 2.024 [FreeBSD]
	p5-IO-Socket-IP: 0.39 [FreeBSD]
	p5-Authen-SASL: 2.16_1 [FreeBSD]
	p5-GSSAPI: 0.28_1 [FreeBSD]
	p5-Digest-HMAC: 1.03_1 [FreeBSD]
	p5-URI: 1.71 [FreeBSD]
	p5-Convert-ASN1: 0.27_2 [FreeBSD]
	p5-Net-Server: 2.008_3 [FreeBSD]
	p5-Socket6: 0.28 [FreeBSD]
	p5-IO-Socket-INET6: 2.72_1 [FreeBSD]
	p5-IO-Multiplex: 1.13_1 [FreeBSD]
	p5-Net-DNS: 1.09,1 [FreeBSD]
	p5-Time-HiRes: 1.9726_1,1 [FreeBSD]
	p5-Storable: 2.45_1 [FreeBSD]
	p5-HTTP-Message: 6.11 [FreeBSD]
	p5-LWP-MediaTypes: 6.02_1 [FreeBSD]
	p5-HTTP-Date: 6.02_1 [FreeBSD]
	p5-IO-HTML: 1.001_1 [FreeBSD]
	p5-Encode-Locale: 1.05 [FreeBSD]
	p5-Switch: 2.17_1 [FreeBSD]
	p5-Filter: 1.57 [FreeBSD]
	p5-DBI: 1.636_1 [FreeBSD]
	p5-DBD-mysql: 4.042 [FreeBSD]
	p5-Date-Calc: 6.4 [FreeBSD]
	p5-Bit-Vector: 7.4 [FreeBSD]
	p5-Carp-Clan: 6.06 [FreeBSD]

Number of packages to be installed: 60

The process will require 56 MiB more space.
13 MiB to be downloaded.
[1/60] Fetching postfix-sasl-3.1.4,1.txz: 100%    1 MiB   1.6MB/s    00:01    
[2/60] Fetching libspf2-1.2.10_2.txz: 100%  123 KiB 125.7kB/s    00:01    
[3/60] Fetching opendkim-2.10.3_6.txz: 100%  309 KiB 316.5kB/s    00:01    
[4/60] Fetching libmilter-8.15.2.txz: 100%  130 KiB 133.4kB/s    00:01    
[5/60] Fetching py27-postfix-policyd-spf-python-1.3.2_1.txz: 100%   37 KiB  38.0kB/s    00:01    
[6/60] Fetching p5-perl-ldap-0.6500.txz: 100%  294 KiB 301.3kB/s    00:01    
[7/60] Fetching postfix-postfwd-1.35_1.txz: 100%  149 KiB 152.3kB/s    00:01    
[8/60] Fetching opendmarc-1.3.1_4.txz: 100%  144 KiB 147.1kB/s    00:01    
[9/60] Fetching pflogsumm-1.1.5,1.txz: 100%   36 KiB  36.4kB/s    00:01    
[10/60] Fetching zip-3.0_1.txz: 100%  144 KiB 147.7kB/s    00:01    
[11/60] Fetching cyrus-sasl-2.1.26_12.txz: 100%  467 KiB 478.5kB/s    00:01    
[12/60] Fetching xproto-7.0.31.txz: 100%   59 KiB  60.2kB/s    00:01    
[13/60] Fetching jpeg-turbo-1.5.1.txz: 100%  292 KiB 299.0kB/s    00:01    
[14/60] Fetching jbigkit-2.1_1.txz: 100%   66 KiB  67.3kB/s    00:01    
[15/60] Fetching png-1.6.29.txz: 100%  272 KiB 278.5kB/s    00:01    
[16/60] Fetching libfontenc-1.1.3_1.txz: 100%   18 KiB  18.2kB/s    00:01    
[17/60] Fetching freetype2-2.8.txz: 100%  639 KiB 654.6kB/s    00:01    
[18/60] Fetching fontconfig-2.12.1,1.txz: 100%  345 KiB 353.5kB/s    00:01    
[19/60] Fetching pkg-devel-1.10.99.4.txz: 100%    4 MiB   4.4MB/s    00:01    
[20/60] Fetching pixman-0.34.0.txz: 100%  256 KiB 262.6kB/s    00:01    
[21/60] Fetching py27-pyspf-2.0.12_4.txz: 100%   34 KiB  35.0kB/s    00:01    
[22/60] Fetching py27-authres-0.800.txz: 100%   26 KiB  26.5kB/s    00:01    
[23/60] Fetching py27-setuptools-32.1.0_1.txz: 100%  436 KiB 446.5kB/s    00:01    
[24/60] Fetching py27-dns-2.3.6_1.txz: 100%   31 KiB  32.0kB/s    00:01    
[25/60] Fetching python2-2_3.txz: 100%    1 KiB   1.1kB/s    00:01    
[26/60] Fetching py27-ipaddr-2.1.11.txz: 100%   24 KiB  25.0kB/s    00:01    
[27/60] Fetching p5-XML-SAX-Writer-0.56.txz: 100%   22 KiB  22.4kB/s    00:01    
[28/60] Fetching p5-XML-SAX-Base-1.08_1.txz: 100%   28 KiB  29.0kB/s    00:01    
[29/60] Fetching p5-XML-NamespaceSupport-1.11_1.txz: 100%   10 KiB   9.9kB/s    00:01    
[30/60] Fetching p5-XML-Filter-BufferText-1.01_1.txz: 100%    4 KiB   4.0kB/s    00:01    
[31/60] Fetching p5-XML-SAX-0.99_2.txz: 100%   49 KiB  50.2kB/s    00:01    
[32/60] Fetching p5-IO-Socket-SSL-2.044.txz: 100%  153 KiB 157.0kB/s    00:01    
[33/60] Fetching p5-Mozilla-CA-20160104.txz: 100%  147 KiB 150.0kB/s    00:01    
[34/60] Fetching p5-Net-SSLeay-1.81.txz: 100%  238 KiB 243.8kB/s    00:01    
[35/60] Fetching p5-Socket-2.024.txz: 100%   37 KiB  37.8kB/s    00:01    
[36/60] Fetching p5-IO-Socket-IP-0.39.txz: 100%   27 KiB  27.3kB/s    00:01    
[37/60] Fetching p5-Authen-SASL-2.16_1.txz: 100%   38 KiB  38.8kB/s    00:01    
[38/60] Fetching p5-GSSAPI-0.28_1.txz: 100%   38 KiB  39.1kB/s    00:01    
[39/60] Fetching p5-Digest-HMAC-1.03_1.txz: 100%    7 KiB   7.4kB/s    00:01    
[40/60] Fetching p5-URI-1.71.txz: 100%   79 KiB  81.4kB/s    00:01    
[41/60] Fetching p5-Convert-ASN1-0.27_2.txz: 100%   34 KiB  34.4kB/s    00:01    
[42/60] Fetching p5-Net-Server-2.008_3.txz: 100%  158 KiB 161.7kB/s    00:01    
[43/60] Fetching p5-Socket6-0.28.txz: 100%   16 KiB  16.6kB/s    00:01    
[44/60] Fetching p5-IO-Socket-INET6-2.72_1.txz: 100%   17 KiB  17.1kB/s    00:01    
[45/60] Fetching p5-IO-Multiplex-1.13_1.txz: 100%   15 KiB  15.0kB/s    00:01    
[46/60] Fetching p5-Net-DNS-1.09,1.txz: 100%  299 KiB 306.0kB/s    00:01    
[47/60] Fetching p5-Time-HiRes-1.9726_1,1.txz: 100%   24 KiB  24.1kB/s    00:01    
[48/60] Fetching p5-Storable-2.45_1.txz: 100%   56 KiB  57.7kB/s    00:01    
[49/60] Fetching p5-HTTP-Message-6.11.txz: 100%   71 KiB  72.7kB/s    00:01    
[50/60] Fetching p5-LWP-MediaTypes-6.02_1.txz: 100%   17 KiB  17.2kB/s    00:01    
[51/60] Fetching p5-HTTP-Date-6.02_1.txz: 100%   14 KiB  14.5kB/s    00:01    
[52/60] Fetching p5-IO-HTML-1.001_1.txz: 100%   18 KiB  18.0kB/s    00:01    
[53/60] Fetching p5-Encode-Locale-1.05.txz: 100%    9 KiB   9.2kB/s    00:01    
[54/60] Fetching p5-Switch-2.17_1.txz: 100%   16 KiB  15.9kB/s    00:01    
[55/60] Fetching p5-Filter-1.57.txz: 100%   57 KiB  58.0kB/s    00:01    
[56/60] Fetching p5-DBI-1.636_1.txz: 100%  691 KiB 707.4kB/s    00:01    
[57/60] Fetching p5-DBD-mysql-4.042.txz: 100%  100 KiB 102.8kB/s    00:01    
[58/60] Fetching p5-Date-Calc-6.4.txz: 100%  170 KiB 174.0kB/s    00:01    
[59/60] Fetching p5-Bit-Vector-7.4.txz: 100%  131 KiB 133.8kB/s    00:01    
[60/60] Fetching p5-Carp-Clan-6.06.txz: 100%   14 KiB  14.6kB/s    00:01    
Checking integrity...
pkg-1.10.1_1 is locked and may not be modified
Assertion failed: (cun != NULL), function pkg_conflicts_check_chain_conflict, file pkg_jobs_conflicts.c, line 481.
Child process pid=3784 terminated abnormally: Abort trap
fetch: /usr/local/etc/postfix/yahoo_static_hosts.txt: open(): No such file or directory
fetch: https://github.com/jsarenik/spf-tools/archive/master.zip: size of remote file is not known
master.zip                                              49 kB  218 kBps 00m00s
Archive:  master.zip
d spf-tools-master
 extracting: spf-tools-master/.gitignore  
 extracting: spf-tools-master/.simplecov  
 extracting: spf-tools-master/.travis.yml  
 extracting: spf-tools-master/AUTHORS  
 extracting: spf-tools-master/LICENSE  
 extracting: spf-tools-master/README.md  
 extracting: spf-tools-master/circle.yml  
 extracting: spf-tools-master/cloudflare.sh  
 extracting: spf-tools-master/compare.sh  
 extracting: spf-tools-master/despf.sh  
 extracting: spf-tools-master/genspfzone.sh  
d spf-tools-master/include
 extracting: spf-tools-master/include/despf.inc.sh  
 extracting: spf-tools-master/include/global.inc.sh  
 extracting: spf-tools-master/include/isincidrange.sh  
 extracting: spf-tools-master/iprange.sh  
d spf-tools-master/misc
 extracting: spf-tools-master/misc/ci-runtest.sh  
 extracting: spf-tools-master/misc/ci-setup.sh  
 extracting: spf-tools-master/misc/tmpl  
 extracting: spf-tools-master/mkblocks.sh  
 extracting: spf-tools-master/mkzoneent.sh  
 extracting: spf-tools-master/normalize.sh  
 extracting: spf-tools-master/route53.sh  
 extracting: spf-tools-master/runspftools.sh  
 extracting: spf-tools-master/shippable.yml  
 extracting: spf-tools-master/simplify.sh  
d spf-tools-master/tests
d spf-tools-master/tests/a24
 extracting: spf-tools-master/tests/a24/cmd  
 extracting: spf-tools-master/tests/a24/in  
 extracting: spf-tools-master/tests/a24/out  
d spf-tools-master/tests/brokendns
 extracting: spf-tools-master/tests/brokendns/cmd  
 extracting: spf-tools-master/tests/brokendns/in  
 extracting: spf-tools-master/tests/brokendns/out  
d spf-tools-master/tests/cname
 extracting: spf-tools-master/tests/cname/cmd  
 extracting: spf-tools-master/tests/cname/in  
 extracting: spf-tools-master/tests/cname/out  
d spf-tools-master/tests/despf
 extracting: spf-tools-master/tests/despf/cmd  
 extracting: spf-tools-master/tests/despf/in  
 extracting: spf-tools-master/tests/despf/out  
d spf-tools-master/tests/despf_chain
 extracting: spf-tools-master/tests/despf_chain/cmd  
 extracting: spf-tools-master/tests/despf_chain/in  
 extracting: spf-tools-master/tests/despf_chain/out  
d spf-tools-master/tests/despf_help
 extracting: spf-tools-master/tests/despf_help/cmd  
 extracting: spf-tools-master/tests/despf_help/in  
 extracting: spf-tools-master/tests/despf_help/out  
d spf-tools-master/tests/despf_qualifier
 extracting: spf-tools-master/tests/despf_qualifier/cmd  
 extracting: spf-tools-master/tests/despf_qualifier/in  
 extracting: spf-tools-master/tests/despf_qualifier/out  
d spf-tools-master/tests/despf_qualifier2
 extracting: spf-tools-master/tests/despf_qualifier2/cmd  
 extracting: spf-tools-master/tests/despf_qualifier2/in  
 extracting: spf-tools-master/tests/despf_qualifier2/out  
d spf-tools-master/tests/despf_skip
 extracting: spf-tools-master/tests/despf_skip/cmd  
 extracting: spf-tools-master/tests/despf_skip/in  
 extracting: spf-tools-master/tests/despf_skip/out  
d spf-tools-master/tests/despf_skip_t
 extracting: spf-tools-master/tests/despf_skip_t/cmd  
 extracting: spf-tools-master/tests/despf_skip_t/in  
 extracting: spf-tools-master/tests/despf_skip_t/out  
d spf-tools-master/tests/despf_torn
 extracting: spf-tools-master/tests/despf_torn/cmd  
 extracting: spf-tools-master/tests/despf_torn/in  
 extracting: spf-tools-master/tests/despf_torn/out  
d spf-tools-master/tests/despf_upper_case
 extracting: spf-tools-master/tests/despf_upper_case/cmd  
 extracting: spf-tools-master/tests/despf_upper_case/in  
 extracting: spf-tools-master/tests/despf_upper_case/out  
d spf-tools-master/tests/fix_32
 extracting: spf-tools-master/tests/fix_32/cmd  
 extracting: spf-tools-master/tests/fix_32/in  
 extracting: spf-tools-master/tests/fix_32/out  
d spf-tools-master/tests/mkblocks-help
 extracting: spf-tools-master/tests/mkblocks-help/cmd  
 extracting: spf-tools-master/tests/mkblocks-help/in  
 extracting: spf-tools-master/tests/mkblocks-help/out  
d spf-tools-master/tests/mkblocks-start
 extracting: spf-tools-master/tests/mkblocks-start/cmd  
 extracting: spf-tools-master/tests/mkblocks-start/in  
 extracting: spf-tools-master/tests/mkblocks-start/out  
d spf-tools-master/tests/mkblocks
 extracting: spf-tools-master/tests/mkblocks/cmd  
 extracting: spf-tools-master/tests/mkblocks/in  
 extracting: spf-tools-master/tests/mkblocks/out  
d spf-tools-master/tests/mx20
 extracting: spf-tools-master/tests/mx20/cmd  
 extracting: spf-tools-master/tests/mx20/in  
 extracting: spf-tools-master/tests/mx20/out  
d spf-tools-master/tests/mx20_upper_case
 extracting: spf-tools-master/tests/mx20_upper_case/cmd  
 extracting: spf-tools-master/tests/mx20_upper_case/in  
 extracting: spf-tools-master/tests/mx20_upper_case/out  
d spf-tools-master/tests/norm_ignore
 extracting: spf-tools-master/tests/norm_ignore/cmd  
 extracting: spf-tools-master/tests/norm_ignore/in  
 extracting: spf-tools-master/tests/norm_ignore/out  
d spf-tools-master/tests/normalize
 extracting: spf-tools-master/tests/normalize/cmd  
 extracting: spf-tools-master/tests/normalize/in  
 extracting: spf-tools-master/tests/normalize/out  
d spf-tools-master/tests/normalize_empty
 extracting: spf-tools-master/tests/normalize_empty/cmd  
 extracting: spf-tools-master/tests/normalize_empty/in  
 extracting: spf-tools-master/tests/normalize_empty/out  
d spf-tools-master/tests/nospf
 extracting: spf-tools-master/tests/nospf/cmd  
 extracting: spf-tools-master/tests/nospf/in  
 extracting: spf-tools-master/tests/nospf/out  
d spf-tools-master/tests/redirect
 extracting: spf-tools-master/tests/redirect/cmd  
 extracting: spf-tools-master/tests/redirect/in  
unzip: skipping non-regular entry 'spf-tools-master/tests/redirect/out'
d spf-tools-master/tests/simplify
 extracting: spf-tools-master/tests/simplify/cmd  
 extracting: spf-tools-master/tests/simplify/in  
 extracting: spf-tools-master/tests/simplify/out  
 extracting: spf-tools-master/tests/test-shell.sh  
 extracting: spf-tools-master/tests/test-subdirs.sh  
 extracting: spf-tools-master/tests/test-unit.sh  
 extracting: spf-tools-master/xsel.sh  
./install_postfix_23.sh: /usr/local/bin/bash: not found
1creating menu and services...
updating soft bounce message status on databases..
/var/db/postfix/20*dbError: near line 1: no such table: mail_noqueue
 ok
Unlocking pkg-1.10.1_1
checking current domains configuration...ok
Merging current dkim keys with domain config...ok

and here is the pfsense log:

May 28 21:24:49 	php-fpm 	47872 	/pkg_edit.php: Postfix setup completed
May 28 21:24:49 	php-fpm 	47872 	/pkg_edit.php: Reloading/starting postfix
May 28 21:24:48 	php-fpm 	47872 	/pkg_edit.php: Writing rc_file
May 28 21:24:44 	php-fpm 	92605 	/pkg_edit.php: Writing out configuration
May 28 21:24:44 	check_reload_status 		Syncing firewall
May 28 21:24:43 	-host+domain-edited- 		nginx: 2017/05/28 21:24:43 [error] 88440#100105: send() failed (54: Connection reset by peer)
May 28 21:24:43 	syslogd 		kernel boot file is /boot/kernel/kernel
May 28 21:24:43 	syslogd 		exiting on signal 15
May 28 21:24:43 	check_reload_status 		Syncing firewall
May 28 21:24:42 	php-fpm 	92605 	/pkg_edit.php: sync_package_postfix called with via_rpc=no
May 28 21:24:42 	check_reload_status 		Syncing firewall
May 28 21:24:41 	php-fpm 	92605 	/pkg_edit.php: The command '/usr/local/etc/rc.d/postfix.sh stop' returned exit code '127', the output was '/usr/local/etc/rc.d/postfix.sh: /usr/local/sbin/postfix: not found'
May 28 21:24:41 	php-fpm 	92605 	/pkg_edit.php: Stopping postfix
May 28 21:24:40 	php-fpm 	92605 	/pkg_edit.php: Writing rc_file
May 28 21:23:56 	php-fpm 	70846 	/pkg_edit.php: The command '/usr/local/etc/rc.d/postfix.sh stop' returned exit code '127', the output was '/usr/local/etc/rc.d/postfix.sh: /usr/local/sbin/postfix: not found'
May 28 21:23:56 	php-fpm 	70846 	/pkg_edit.php: Stopping postfix
May 28 21:23:55 	php-fpm 	70846 	/pkg_edit.php: Writing rc_file
May 28 21:23:41 	-host+domain-edited- 		nginx: 2017/05/28 21:23:41 [error] 88270#100155: send() failed (54: Connection reset by peer)
May 28 21:23:41 	php-fpm 	14656 	/pkg_edit.php: Writing out configuration
May 28 21:23:41 	check_reload_status 		Syncing firewall
May 28 21:23:40 	php-fpm 	14656 	/pkg_edit.php: [postfix] Creating Domain key for -domain-edited- under /home/mailnull/keys/-domain-edited-
May 28 21:23:40 	syslogd 		kernel boot file is /boot/kernel/kernel
May 28 21:23:40 	syslogd 		exiting on signal 15
May 28 21:23:40 	check_reload_status 		Syncing firewall
May 28 21:23:39 	php-fpm 	14656 	/pkg_edit.php: sync_package_postfix called with via_rpc=no
May 28 21:23:39 	check_reload_status 		Syncing firewall
May 28 21:22:10 	php-fpm 	5562 	/pkg_edit.php: Postfix setup completed
May 28 21:22:10 	php-fpm 	5562 	/pkg_edit.php: Reloading/starting postfix
May 28 21:22:09 	php-fpm 	5562 	/pkg_edit.php: Writing rc_file
May 28 21:22:06 	php-fpm 	49681 	/pkg_edit.php: Writing out configuration
May 28 21:22:06 	check_reload_status 		Syncing firewall
May 28 21:22:05 	-host+domain-edited- 		nginx: 2017/05/28 21:22:05 [error] 88440#100105: send() failed (54: Connection reset by peer)
May 28 21:22:05 	php-fpm 	49681 	/pkg_edit.php: [postfix] Creating Domain key for -domain-edited- under /home/mailnull/keys/-domain-edited-
May 28 21:22:05 	php-fpm 	49681 	/pkg_edit.php: [postfix] Creating dkim folder /home/mailnull/keys/-domain-edited-
May 28 21:22:05 	php-fpm 	49681 	/pkg_edit.php: [postfix] Creating dkim folder /home/mailnull/keys
May 28 21:22:05 	php-fpm 	49681 	/pkg_edit.php: [postfix] Creating dkim folder /home/mailnull
May 28 21:22:05 	syslogd 		kernel boot file is /boot/kernel/kernel
May 28 21:22:05 	syslogd 		exiting on signal 15
May 28 21:22:04 	check_reload_status 		Syncing firewall
May 28 21:22:03 	check_reload_status 		Syncing firewall
May 28 21:22:02 	php-fpm 	49681 	/pkg_edit.php: sync_package_postfix called with via_rpc=no
May 28 21:22:02 	check_reload_status 		Syncing firewall

marcelloc

@ecfx:

It looks like it is not working at pfsense 2.3.4 - new clean install.

looks like something with pkg.

Can you try to install a package first, like cron for example or try the console menu 13 before trying to install the postfix and mailscanner?

n3by

I installed some packages and it was the same.

At the end I manually installed all packages downloaded by installer in /var/cache/pkg/
pkg install *.txz

p.s.
I remember I had an error message at installation with pkg-devel-1.10.99.4.txz so i had to delete it to be able to install all.

marcelloc

@ecfx:

I installed some packages and it was the same.

At the end I manually installed all packages downloaded by installer in /var/cache/pkg/
pkg install *.txz

p.s.
I remember I had an error message at installation with pkg-devel-1.10.99.4.txz so i had to delete it to be able to install all.

I've removed the pkg lock from a previous update. Test if it's fixed the install when you have a chance.

Rene.vandenBroek

@Marcelloc,

Could there be something missing in the UnOfficial Repo, the mailscanner and Postfix packages cannot be found.

Unofficial repository update completed. 5 packages processed.
Updating pfSense-core repository catalogue...
pfSense-core repository is up to date.
Updating pfSense repository catalogue...
pfSense repository is up to date.
All repositories are up to date.
pkg: No packages available to install matching 'mailscanner' have been found in the repositories

It looks like the mailscanner and Postfix txz files are missing in the repo folder.

edit - fix typo

marcelloc

@Rene.vandenBroek:

@Marcelloc,

Could there be something missing in the UnOfficial Repo, the mailscanner and Postfix packages cannot be found.

It's not there yet. the pkg add for postfix and mailscanner will have only gui files for now because it needs a lot of dependencies from FreeBSD.

Keep using the install script.

Rene.vandenBroek

Unfortunately the install script searches the repo for the package..

here's a the entire output from the install script. It can't install the patches, because the files to patch ain't there.

 sh ./install_mailscanner_23.sh
fetching  /usr/local/www/mailscanner_about.php from github
fetching  /usr/local/pkg/mailscanner.conf.template from github
fetching  /usr/local/pkg/mailscanner.xml from github
fetching  /usr/local/pkg/mailscanner_antispam.xml from github
fetching  /usr/local/pkg/mailscanner_attachments.xml from github
fetching  /usr/local/pkg/mailscanner_report.xml from github
fetching  /usr/local/pkg/mailscanner.inc from github
fetching  /usr/local/pkg/mailscanner_alerts.xml from github
fetching  /usr/local/pkg/mailscanner_antivirus.xml from github
fetching  /usr/local/pkg/mailscanner_content.xml from github
fetching  /usr/local/pkg/mailscanner_sync.xml from github
fetching  /usr/local/www/shortcuts/pkg_mailscanner.inc from github
fetching  /usr/local/bin/sa-updater-custom-channels.sh from github
fetching  /usr/local/bin/sa-wrapper.pl from github
Locking pkg-1.10.1_1
Updating Unofficial repository catalogue...
Fetching meta.txz: 100%    260 B   0.3kB/s    00:01
Fetching packagesite.txz: 100%    2 KiB   2.3kB/s    00:01
Processing entries: 100%
Unofficial repository update completed. 5 packages processed.
Updating pfSense-core repository catalogue...
pfSense-core repository is up to date.
Updating pfSense repository catalogue...
pfSense repository is up to date.
All repositories are up to date.

pkg-1.10.1_1 is locked and may not be modified
pkg: No packages available to install matching 'mailscanner' have been found in the repositories
0cd: root: No such file or directory
fetch: https://github.com/extremeshok/spamassassin-extremeshok_fromreplyto/archive/master.zip: size of remote file is not known
extremeshok_fromreplyto.zip                           7385  B   34 MBps 00m00s
fetch: https://github.com/smfreegard/DecodeShortURLs/archive/master.zip: size of remote file is not known
DecodeShortURLs.zip                                     11 kB   39 MBps 00m00s
pdfid.zip                                     100% of 9679  B   54 MBps 00m00s
fetch: https://github.com/extremeshok/clamav-unofficial-sigs/archive/master.zip: size of remote file is not known
clamav-unofficial-sigs.zip                              76 kB  353 kBps 00m00s
./install_mailscanner_23.sh: rehash: not found
./install_mailscanner_23.sh: /usr/local/bin/sa-update: not found
Hmm...  Looks like a unified diff to me...
The text leading up to this was:
--------------------------
|--- /usr/local/lib/MailScanner/MailScanner/ConfigDefs.orig.pl  2017-04-17 01:30:06.687969000 +0000
|+++ /usr/local/lib/MailScanner/MailScanner/ConfigDefs.pl       2017-04-17 01:37:31.896642000 +0000
--------------------------
File to patch:
No file found--skip this patch? [n]

marcelloc

I'll check the install process on a clean vm an fix it. Thanks for the feedback.

EDIT

I've found the issue, all repos (including Unofficial) must has Freebsd repo enabled inside it to be able to install Freebsd packages.

I'm fixing the install script and will push soon.

marcelloc

Re-run the install process, pkg install should be fixed now.

Rene.vandenBroek

Yes, it ran completely this time.

thank you.