Fix the squid package {completed}

[mhab12]

Sullrich, thanks for being so amazingly prompt in getting the package updated, especially in light of 1.2 approaching release.

The 'broken' sites appear to be working under the latest version.  The speeds look improved, but not fixed.  Under 2.6.18/1.2RC5 I can get 600kbps where I used to see about 250-300 kbps before the package bump.  This is on a bonded T-1 WAN 3mbps where I can see 2700kbps on squid 2.6.5/1.2RC2.

Getting the package updated is a huge step, thanks…now where is all the bandwidth going?

[jahonix]

Can you monitor your processor utilization? Does it max out when D/L-ing?

Attached I have a screenshot when pulling this service pack (~370MB): http://www.microsoft.com/downloads/details.aspx?FamilyID=95ac1610-c232-4644-b828-c55eec605d55&DisplayLang=en

I have squid (2.6.18) running in transparent mode. But notice the increase of CPU utilization (is that normal?). Anyway, I still get close to my theoretical max. of 16MB down


[mhab12]

I'm not seeing CPU spikes like that, but my bandwidth is all over the place.

[jahonix]

Can you easily switch off squid and test without it?
Just to make sure the hardware, cables and stuff work as expected.

[mhab12]

Same file download, without using the proxy.

[jahonix]

This is a full install and you're using single or MP kernel?

[mhab12]

MP kernel AFAIK, it's a dual processor machine.  I have had the same results on a single processor box as well.  Is there a shell command I can run to tell me which kernel I am running?

[jahonix]

For sure it's somewhere here:  https://<your-pfsense-ip>/status.php</your-pfsense-ip>

[mhab12]

Just a sampling…
FreeBSD 6.2-RELEASE-p11 #0: Mon Feb 18 01:25:40 EST 2008
    sullrich@builder6.pfsense.com:/usr/obj.pfSense/usr/src/sys/pfSense_SMP.6

FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs

[eri--]

Are you by any case heeting swap?!

[mhab12]

Heeting swap?  I don't understand what that means.

[Sn3ak]

I am guessing 'needing swap'?

Have you checked your throttling settings? More specifically is 'Throttle only specific extensions' [Proxy / traffic management] Checked? From my understanding, if that is not checked all file transfers get throttled by default, which may be contributing to your speed loss?

[mhab12]

Just tried it again both ways, checked and unchecked on 'Throttle only specific extensions'…no change.

[eri--]

Are you by any case heeting swap?!

I mean, is swap getting used?!

[mhab12]

The top output on my 1.2RC3 box that is working properly shows 100k of swap in use.  The 1.2RC5 with the new squid package just shows 1024M available, 1024M free.  Perhaps you're on to something.

[eri--]

Can you please post the generated squid.conf.

[mhab12]

Here are two squid.conf, one from our working box and one from the new slower box.  I have tested with only two interfaces on different boxes and see the same result.  I have the newer box in non-transparent mode so the few people who use it won't have to put up with the slowness.

squid.conf.2.6.5.pf.1.2.rc3.txt
squid.conf.2.6.18.pf.1.2.rc5.txt

[sullrich]

So basically the differences are:

diff squid.conf.2.6.5.pf.1.2.rc3.txt squid.conf.2.6.18.pf.1.2.rc5.txt

1c1
http_access deny allto be sureterface(s)nsacl/blacklist.acl"s.acl"025-65535
\ No newline at end of file
–-
http_access deny allto be sureterface(s)nsquid/acl/throttle_exts.acl"-65535
\ No newline at end of file

[mhab12]

The diff related to throttle went away after I changed the box for 'Throttle only specific extensions'.  The do not cache entries are diff because there are no donotcache entries on the 2.6.18 box.  Other than that, they look the same to me, aside from a couple of cache size cfg and IP changes.

[databeestje]

He means to ask if you are running into swap space. I asume you are not since you are on a Dual core machine and likely have atleast 1GB of ram.

Can you try using the single processor kernel and see if the problem persists?