PfSense 2.2: Squid 3.4.10_2 pkg 0.2.6 redirection not working in transparent mode

Steve Evans

Thank you.

Steve

eqx

Thank you.
Steve

Bump for i386 build:)

I'm also on a i386 box and i wonder if i should go with squid or squid3 ? i've had squid running under other circumstances, but not with pfSense on i386. Im already running pfBlockerNG with several alias lists, and i'd want squid/squid3 to not work for sites that are blocked there, obviously. Does squid3 transparent proxies 'bypass' the pfBlockerNG rules, or are the rules applied before the traffic even reaches it?

I think SquidGuard rule administering are a lot harder than in pfBlocker so i'd prefer to keep all the rules management there and have squid3 only do transparent proxying for the sites that pass the firewall.

Steve Evans

@marcelloc:

@Steve:

Now here's an oddity.

This is one of pbi behaviors. same binary, different folder, different results. (Imagine get all it working together :))

And here is the confirmation that pbi build on i386 is outdated
'--disable-ipf-transparent' '--disable-ipfw-transparent'
Go to amd64 and it will work :)

Thanks for your feedback

I've just installed 3.4.10_2 pkg 0.2.6 and I'm seeing the following config using "squid -v"

'--disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent'

This is the same as before… :(

Although I was offered an upgrade I now realise the version hasn't actually changed. Should I have expected this for the recompiled version?

Steve

sujyo1

Here is mine for more info…

2.2-RELEASE (i386)
built on Thu Jan 22 14:04:25 CST 2015
FreeBSD 10.1-RELEASE-p4

Intel(R) Atom(TM) CPU N280 @ 1.66GHz
2 CPUs: 1 package(s) x 1 core(s) x 2 HTT threads

$ squid -v
Squid Cache: Version 3.4.10
configure options: '–with-default-user=squid' '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/var' '--sysconfdir=/usr/local/etc/squid' '--with-logdir=/var/log/squid' '--with-pidfile=/var/run/squid/squid.pid' '--with-swapdir=/var/squid/cache' '--enable-auth' '--enable-build-info' '--enable-loadable-modules' '--enable-removal-policies=lru heap' '--disable-epoll' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-translation' '--disable-arch-native' '--enable-eui' '--enable-cache-digests' '--enable-delay-pools' '--enable-ecap' '--disable-esi' '--enable-follow-x-forwarded-for' '--enable-htcp' '--enable-icap-client' '--enable-icmp' '--enable-ident-lookups' '--enable-ipv6' '--enable-kqueue' '--with-large-files' '--enable-http-violations' '--without-nettle' '--enable-snmp' '--enable-ssl' '--enable-ssl-crtd' '--disable-stacktraces' '--disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent' '--with-nat-devpf' '--disable-forw-via-db' '--enable-wccp' '--enable-wccpv2' '--enable-auth-basic=DB MSNT MSNT-multi-domain NCSA PAM POP3 RADIUS fake getpwnam LDAP NIS' '--enable-auth-digest=file' '--enable-external-acl-helpers=file_userip time_quota unix_group LDAP_group' '--enable-auth-negotiate=kerberos wrapper' '--enable-auth-ntlm=fake smb_lm' '--enable-storeio=ufs aufs diskd' '--enable-disk-io=AIO Blocking IpcIo Mmapped DiskThreads DiskDaemon' '--enable-log-daemon-helpers=file' '--enable-url-rewrite-helpers=fake' '--enable-storeid-rewrite-helpers=file' '--with-openssl=/usr' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=i386-portbld-freebsd10.1' 'build_alias=i386-portbld-freebsd10.1' 'CC=cc' 'CFLAGS=-O2 -pipe -I/usr/local/include -I/usr/local/include -I/usr/include -fstack-protector -DLDAP_DEPRECATED -fno-strict-aliasing' 'LDFLAGS= -L/usr/local/lib -L/usr/local/lib -pthread -Wl,-rpath,/usr/lib:/usr/local/lib -L/usr/lib -fstack-protector' 'LIBS=' 'CPPFLAGS=' 'CXX=c++' 'CXXFLAGS=-O2 -pipe -I/usr/local/include -I/usr/local/include -I/usr/include -fstack-protector -DLDAP_DEPRECATED -fno-strict-aliasing -Wno-unused-private-field' 'CPP=cpp' 'PKG_CONFIG=pkgconf' --enable-ltdl-convenience

Log:

Feb 14 02:00:57 syslogd: kernel boot file is /boot/kernel/kernel
Feb 14 02:00:57 syslogd: exiting on signal 15
Feb 14 02:00:57 check_reload_status: Syncing firewall
Feb 14 02:00:00 php: sarg.php: Sarg: force refresh now with -d date +%d/%m/%Y-date +%d/%m/%Y args, compress(on) and none action after sarg finish.
Feb 14 01:41:33 sshlockout[57823]: sshlockout/webConfigurator v3.0 starting up
Feb 14 01:41:33 php-fpm[11780]: /index.php: Successful login for user 'admin' from: X.X.X.X
Feb 14 01:41:33 php-fpm[11780]: /index.php: Successful login for user 'admin' from: X.X.X.X
Feb 14 01:01:00 php: rc.dyndns.update: phpDynDNS (X.X.X.X.com): No change in my IP address and/or 25 days has not passed. Not updating dynamic DNS entry.
Feb 14 01:00:00 php: sarg.php: Sarg: force refresh now with -d date +%d/%m/%Y-date +%d/%m/%Y args, compress(on) and none action after sarg finish.
Feb 14 00:00:44 check_reload_status: Reloading filter
Feb 14 00:00:43 Squid_Alarm[8897]: Squid has resumed. Reconfiguring filter.
Feb 14 00:00:43 Squid_Alarm[7332]: Reconfiguring filter…
Feb 14 00:00:40 squid[6274]: Squid Parent: (squid-1) process 6758 started
Feb 14 00:00:40 squid[6274]: Squid Parent: will start 1 kids
Feb 14 00:00:39 Squid_Alarm[3586]: Attempting restart…
Feb 14 00:00:39 Squid_Alarm[3308]: Squid has exited. Reconfiguring filter.
Feb 14 00:00:34 php: swapstate_check.php: Squid cache and/or swap.state exceeded size limits. Removing and rotating. File was 293760 bytes, 0% of total disk space.
Feb 14 00:00:34 squid[94339]: Squid Parent: (squid-1) process 94855 exited with status 0
Feb 14 00:00:20 squid[85421]: Exiting due to repeated, frequent failures
Feb 14 00:00:20 squid[85421]: Squid Parent: (squid-1) process 99037 will not be restarted due to repeated, frequent failures
Feb 14 00:00:20 squid[85421]: Squid Parent: (squid-1) process 99037 exited with status 1
Feb 14 00:00:20 (squid-1): Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
Feb 14 00:00:19 squid[85421]: Squid Parent: (squid-1) process 99037 started
Feb 14 00:00:17 php: sarg.php: The command 'export LC_ALL=C && /usr/pbi/sarg-i386/bin/sarg -d date +%d/%m/%Y-date +%d/%m/%Y' returned exit code '1', the output was 'SARG: Records in file: 385516, reading: 0.00%^MSARG: Records in file: 5000, reading: 1.30%^MSARG: Records in file: 10000, reading: 2.59%^MSARG: Records in file: 15000, reading: 3.89%^MSARG: Records in file: 20000, reading: 5.19%^MSARG: Records in file: 25000, reading: 6.48%^MSARG: Records in file: 30000, reading: 7.78%^MSARG: Records in file: 35000, reading: 9.08%^MSARG: Records in file: 40000, reading: 10.38%^MSARG: Records in file: 45000, reading: 11.67%^MSARG: Records in file: 50000, reading: 12.97%^MSARG: Records in file: 55000, reading: 14.27%^MSARG: Records in file: 60000, reading: 15.56%^MSARG: Records in file: 65000, reading: 16.86%^MSARG: Records in file: 70000, reading: 18.16%^MSARG: Records in file: 75000, reading: 19.45%^MSARG: Records in file: 80000, reading: 20.75%^MSARG: Records in file: 85000, reading: 22.05%^MSARG: Records
Feb 14 00:00:16 squid[85421]: Squid Parent: (squid-1) process 97629 exited with status 1
Feb 14 00:00:16 (squid-1): Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
Feb 14 00:00:16 squid[85421]: Squid Parent: (squid-1) process 97629 started
Feb 14 00:00:13 squid[85421]: Squid Parent: (squid-1) process 95605 exited with status 1
Feb 14 00:00:13 (squid-1): Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
Feb 14 00:00:12 squid[85421]: Squid Parent: (squid-1) process 95605 started
Feb 14 00:00:09 squid[85421]: Squid Parent: (squid-1) process 95125 exited with status 1
Feb 14 00:00:09 (squid-1): Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
Feb 14 00:00:09 squid[85421]: Squid Parent: (squid-1) process 95125 started
Feb 14 00:00:08 squid[94339]: Squid Parent: (squid-1) process 94855 started
Feb 14 00:00:08 squid[94339]: Squid Parent: will start 1 kids
Feb 14 00:00:07 php: swapstate_check.php: The command '/usr/pbi/squid-i386/sbin/squid -k kill -f /usr/pbi/squid-i386/local/etc/squid/squid.conf' returned exit code '1', the output was 'squid: ERROR: Could not send signal 9 to process 86112: (3) No such process'
Feb 14 00:00:06 squid[85421]: Squid Parent: (squid-1) process 89244 exited with status 1
Feb 14 00:00:06 (squid-1): Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
Feb 14 00:00:05 squid[85421]: Squid Parent: (squid-1) process 89244 started
Feb 14 00:00:02 kernel: pid 86112 (squid), uid 62: exited on signal 6
Feb 14 00:00:01 php: swapstate_check.php: Creating squid cache subdirs in /var/squid/cache
Feb 14 00:00:01 php: swapstate_check.php: Creating Squid cache dir /var/squid/cache
Feb 14 00:00:01 php: sarg.php: Sarg: force refresh now with -d date +%d/%m/%Y-date +%d/%m/%Y args, compress(on) and none action after sarg finish.

Steve Evans

Hi Sujyo1,

You report the squid version/config and startup logs, but you don't indicate what issues you are seeing. Is it that transparent mode isn't working for you? If so do it prior to your upgrade to 2.2 with your current configuration?

Thanks,

Steve

sujyo1

Thanks for reply…
https://forum.pfsense.org/index.php?topic=88329.msg487689#msg487689

Hobby-Student

Hey guys,

have an amd64 where squid (reverse) is working as expected. But i386 is driving me nuts… Solved all "startup" problems (net.inet.ip.portrange.reservedhigh=0) and always get

commBind: Cannot bind socket FD NN ti <ip>:443: (48) Address already in use</ip>

Now I moved the pfSense webGUI from 443 to another port and squid reverse is listening on 443 as it should.

To be clear: On amd64 webGUI and squid reverse sits on 443, whereas on i386 this won't work…

On amd64 I also don't need any changes to tunables or others. Install and it just runs on 443.

moroznah

pfSense 2.2 AMD64 normal install, squid 3.4.10_2 pkg 0.2.6. Webconfigurator listening on non standard port and redirect rule disabled.

After updating pfSense to 2.2, squid 2 stopped working in transparent mode.. I thought i'd upgrade to squid 3, same story.

squid -v
'–disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent'

Looks like compile flags are wrong...

netstat -an | grep LISTEN | grep 3128
tcp4 0 0 127.0.0.1.3128 . LISTEN
tcp4 0 0 192.168.2.1.3128 . LISTEN
tcp4 0 0 192.168.45.1.3128 . LISTEN
tcp4 0 0 192.168.43.1.3128 . LISTEN
tcp4 0 0 192.168.44.1.3128 . LISTEN

Squid is listening for sure, if i point a browser directly to port 3128 from any LAN interface i can see activity in squid logs, http://www.lagado.com/proxy-test test page also confirms it's working.

pfctl -s rules | grep 3128
pass in quick on em1 proto tcp from any to ! (em1) port = 3128 flags S/SA keep state
pass in quick on em0 proto tcp from any to ! (em0) port = 3128 flags S/SA keep state
pass in quick on em5 proto tcp from any to ! (em5) port = 3128 flags S/SA keep state
pass in quick on ath0_wlan0 proto tcp from any to ! (ath0_wlan0) port = 3128 flags S/SA keep state

192.168.2.1 = ath0_wlan0; 192.168.43.1 = em0; 192.168.44.1 = em1; 192.168.45.1 = em5
However, it should also show smth like:
rdr on em0 proto tcp from any to !(em0) port 80 -> 127.0.0.1 port 3128

First lines of squid.conf look like this:

/usr/pbi/squid-amd64/etc/squid: cat squid.conf

This file is automatically generated by pfSense

Do not edit manually !

http_port 192.168.44.1:3128
http_port 192.168.43.1:3128
http_port 192.168.45.1:3128
http_port 192.168.2.1:3128
http_port 127.0.0.1:3128
http_port 127.0.0.1:3128 intercept

In squid2 i think it was "transparent" instead "intercept".

Squid logs are clean, no complaints, not even about net.inet.ip.portrange.first being too high since only root can use <1024 ports. Disabling/enabling transparent proxy in General tab of webconfigurator does not seem to have any effect on listening ports, but it does change squid.conf which means it's not webconfig's fault for sure.
I've been tampering with configs for some time without success, still i didn't figure out why squid transparent mode is not working, but my guess is because of wrong compile flags.
This is so frustrating, any help is appreciated.

Thanks!

Steve Evans

I've just updated to 2.3.2 and squid 0.4.22.

It looks as if the "'–disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent'" issue persists.

: squid -v
Squid Cache: Version 3.5.19
Service Name: squid
configure options:  '--with-default-user=squid' '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/var' '--sysconfdir=/usr/local/etc/squid' '--with-logdir=/var/log/squid' '--with-pidfile=/var/run/squid/squid.pid' '--with-swapdir=/var/squid/cache' '--without-gnutls' '--enable-auth' '--enable-build-info' '--enable-loadable-modules' '--enable-removal-policies=lru heap' '--disable-epoll' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-translation' '--disable-arch-native' '--enable-eui' '--enable-cache-digests' '--enable-delay-pools' '--disable-ecap' '--disable-esi' '--enable-follow-x-forwarded-for' '--enable-htcp' '--enable-icap-client' '--enable-icmp' '--enable-ident-lookups' '--enable-ipv6' '--enable-kqueue' '--with-large-files' '--enable-http-violations' '--without-nettle' '--enable-snmp' '--enable-ssl' '--with-openssl=/usr' 'LIBOPENSSL_CFLAGS=-I/usr/include' 'LIBOPENSSL_LIBS=-lcrypto -lssl' '--enable-ssl-crtd' '--disable-stacktraces' '--disable-forw-via-db' '--enable-wccp' '--enable-wccpv2' '--with-mit-krb5=/usr/local' 'CFLAGS=-I/usr/local/include -O2 -pipe  -I/usr/local/include -I/usr/local/include -fstack-protector -DLDAP_DEPRECATED -fno-strict-aliasing' 'LDFLAGS=-L/usr/local/lib  -pthread -L/usr/local/lib -L/usr/local/lib -Wl,-rpath,/usr/local/lib:/usr/lib  -fstack-protector' 'LIBS=-lkrb5 -lgssapi_krb5 ' 'KRB5CONFIG=/usr/local/bin/krb5-config' '--disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent' '--with-nat-devpf' '--enable-auth-basic=LDAP SASL DB SMB_LM MSNT-multi-domain NCSA PAM POP3 RADIUS fake getpwnam NIS' '--enable-auth-digest=file' '--enable-external-acl-helpers=LDAP_group file_userip time_quota unix_group kerberos_ldap_group' '--enable-auth-negotiate=kerberos wrapper' '--enable-auth-ntlm=fake smb_lm' '--enable-storeio=aufs diskd ufs' '--enable-disk-io=DiskThreads DiskDaemon AIO Blocking IpcIo Mmapped' '--enable-log-daemon-helpers=file' '--enable-url-rewrite-helpers=fake' '--enable-storeid-rewrite-helpers=file' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=i386-portbld-freebsd10.3' 'build_alias=i386-portbld-freebsd10.3' 'CC=cc' 'CPPFLAGS=-I/usr/local/include' 'CXX=c++' 'CXXFLAGS=-O2 -pipe -I/usr/local/include -I/usr/local/include -fstack-protector -DLDAP_DEPRECATED -fno-strict-aliasing ' 'CPP=cpp' --enable-ltdl-convenience

Has it been confirmed that using –enable-ipf-transparent' and '--enable-ipfw-transparent' on i386 will get transparent mode working again?

Could somebody please provide a 'squid -v' output on an amd64 system to compare.

Thanks,

Steve

tuhucon

pfSense 2.3.2-RELEASE-p1 (amd64)

squid 0.4.26

transparent mode is not working :(

squid -v
Squid Cache: Version 3.5.19
Service Name: squid
configure options: '–with-default-user=squid' '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/var' '--sysconfdir=/usr/local/etc/squid' '--with-logdir=/var/log/squid' '--with-pidfile=/var/run/squid/squid.pid' '--with-swapdir=/var/squid/cache' '--without-gnutls' '--enable-auth' '--enable-build-info' '--enable-loadable-modules' '--enable-removal-policies=lru heap' '--disable-epoll' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-translation' '--disable-arch-native' '--enable-eui' '--enable-cache-digests' '--enable-delay-pools' '--disable-ecap' '--disable-esi' '--enable-follow-x-forwarded-for' '--enable-htcp' '--enable-icap-client' '--enable-icmp' '--enable-ident-lookups' '--enable-ipv6' '--enable-kqueue' '--with-large-files' '--enable-http-violations' '--without-nettle' '--enable-snmp' '--enable-ssl' '--with-openssl=/usr' 'LIBOPENSSL_CFLAGS=-I/usr/include' 'LIBOPENSSL_LIBS=-lcrypto -lssl' '--enable-ssl-crtd' '--disable-stacktraces' '--disable-forw-via-db' '--enable-wccp' '--enable-wccpv2' '--with-mit-krb5=/usr/local' 'CFLAGS=-I/usr/local/include -O2 -pipe -I/usr/local/include -I/usr/local/include -fstack-protector -DLDAP_DEPRECATED -fno-strict-aliasing' 'LDFLAGS=-L/usr/local/lib -pthread -L/usr/local/lib -L/usr/local/lib -Wl,-rpath,/usr/local/lib:/usr/lib -fstack-protector' 'LIBS=-lkrb5 -lgssapi_krb5 ' 'KRB5CONFIG=/usr/local/bin/krb5-config' '--disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent' '--with-nat-devpf' '--enable-auth-basic=LDAP SASL DB SMB_LM MSNT-multi-domain NCSA PAM POP3 RADIUS fake getpwnam NIS' '--enable-auth-digest=file' '--enable-external-acl-helpers=LDAP_group file_userip time_quota unix_group kerberos_ldap_group' '--enable-auth-negotiate=kerberos wrapper' '--enable-auth-ntlm=fake smb_lm' '--enable-storeio=aufs diskd ufs' '--enable-disk-io=DiskThreads DiskDaemon AIO Blocking IpcIo Mmapped' '--enable-log-daemon-helpers=file' '--enable-url-rewrite-helpers=fake' '--enable-storeid-rewrite-helpers=file' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=amd64-portbld-freebsd10.3' 'build_alias=amd64-portbld-freebsd10.3' 'CC=cc' 'CPPFLAGS=-I/usr/local/include' 'CXX=c++' 'CXXFLAGS=-O2 -pipe -I/usr/local/include -I/usr/local/include -fstack-protector -DLDAP_DEPRECATED -fno-strict-aliasing ' 'CPP=cpp' --enable-ltdl-convenience

jimp

It works fine, this is an ancient issue that has nothing to do with the modern package system. Start a new thread if you have a problem, but it's not related to this.

Locking thread.