Fix the squid package {completed}
-
This discussion has been ongoing in the packages forum. The squid package is now very slow for some reason. It is also based on an outdated release. To be awarded the bounty, update the squid package to the latest stable release (2.6.18), provide transparent proxy throughput at or very near non-proxy throughput, and make sure that sites like auctionsniper.com and evga.com (maybe others too?) display properly when opened through the proxy. All of this must work on 1.2rc5 or 1.2_STABLE when it happens. I am willing to contribute $250 to the bounty, and heiko $200 per one of the related posts below as long as he gets an invoice. To get up to speed I've listed most (I think) of the other related posts below.
http://forum.pfsense.org/index.php/topic,7887.0.html
http://forum.pfsense.org/index.php/topic,7281.0.html
http://forum.pfsense.org/index.php/topic,7538.0.html
http://forum.pfsense.org/index.php/topic,6835.0.htmlhttp://forum.pfsense.org/index.php/topic,7652.0.html
http://forum.pfsense.org/index.php/topic,6808.0.html
http://cvstrac.pfsense.com/tktview?tn=1557 -
To be awarded the bounty, update the squid package to the latest stable release (2.6.18), provide transparent proxy throughput at or very near non-proxy throughput,
Can you tell me what this is?!
-
I will contribute $50 if this can fix my issue here:
http://forum.pfsense.org/index.php/topic,7919.0.html
-
As i saw, sullrich have updated the squid package to the latest 2.6.18 version!
-
Sullrich, thanks for being so amazingly prompt in getting the package updated, especially in light of 1.2 approaching release.
The 'broken' sites appear to be working under the latest version. The speeds look improved, but not fixed. Under 2.6.18/1.2RC5 I can get 600kbps where I used to see about 250-300 kbps before the package bump. This is on a bonded T-1 WAN 3mbps where I can see 2700kbps on squid 2.6.5/1.2RC2.
Getting the package updated is a huge step, thanks…now where is all the bandwidth going?
-
Can you monitor your processor utilization? Does it max out when D/L-ing?
Attached I have a screenshot when pulling this service pack (~370MB): http://www.microsoft.com/downloads/details.aspx?FamilyID=95ac1610-c232-4644-b828-c55eec605d55&DisplayLang=en
I have squid (2.6.18) running in transparent mode. But notice the increase of CPU utilization (is that normal?). Anyway, I still get close to my theoretical max. of 16MB down
 -
I'm not seeing CPU spikes like that, but my bandwidth is all over the place.
-
Can you easily switch off squid and test without it?
Just to make sure the hardware, cables and stuff work as expected. -
Same file download, without using the proxy.
-
This is a full install and you're using single or MP kernel?
-
MP kernel AFAIK, it's a dual processor machine. I have had the same results on a single processor box as well. Is there a shell command I can run to tell me which kernel I am running?
-
For sure it's somewhere here: https://<your-pfsense-ip>/status.php</your-pfsense-ip>
-
Just a sampling…
FreeBSD 6.2-RELEASE-p11 #0: Mon Feb 18 01:25:40 EST 2008
sullrich@builder6.pfsense.com:/usr/obj.pfSense/usr/src/sys/pfSense_SMP.6FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
-
Are you by any case heeting swap?!
-
Heeting swap? I don't understand what that means.
-
I am guessing 'needing swap'?
Have you checked your throttling settings? More specifically is 'Throttle only specific extensions' [Proxy / traffic management] Checked? From my understanding, if that is not checked all file transfers get throttled by default, which may be contributing to your speed loss?
-
Just tried it again both ways, checked and unchecked on 'Throttle only specific extensions'…no change.
-
Are you by any case heeting swap?!
I mean, is swap getting used?!
-
The top output on my 1.2RC3 box that is working properly shows 100k of swap in use. The 1.2RC5 with the new squid package just shows 1024M available, 1024M free. Perhaps you're on to something.
-
Can you please post the generated squid.conf.
