Squid slow Transfers



  • Hi Guys,

    Great work with PFSENSE :)

    Just an anoying issue im having basically with the Squid Proxy off can get transfers of 1.6 MB Sec (Link Max) but with the transparent proxy on, it hovvers around the 1.1 MB Mark?

    Was running 1.3 RC but just upgraded to 1.4 and having the same issue.

    Its on a Duel  Athlon with 2Gig Ram?

    Any help appreciated.
    Cheers



  • I'm curious, if I wanted to test the throughput of my system, how would I go about to do that?  I have the transparent proxy on as well and I'd like to compare with you.  How did you do your measurement?

    Thanks!



  • I've been seeing similar issues, but with my system the difference is more like 340 kB/s without the proxy, and about 20 kB/s through the proxy.  Hopefully this post will help the issue get the attention it deserves.



  • I can happily push 20 Mb/s (2.5 MB/s) through Squid on my pfSense host, so it's not a generic problem.



  • Cry Havok - you are admittedly running 1.2beta2.

    I am running the latest published Squid package (2.6.5_1-p15), though I'm still on 1.2-beta2.

    I am curious if you would see symptoms if you upgraded to latest release.  Guess we'll find find out when 1.2 goes final, by 1/31 according to the pfsense blog!  Thanks for the continued input though - everyone appreciates it.



  • Yes, I am running beta.  Of course, given that the OP claims to be running 1.3 then 1.4 - yet 1.2 hasn't gone final yet, I think we've got a good range of releases for (non-)information gathering ;)

    We should find out in a week or so whether the problem is related to a post 1.2 Beta2 change or whether it's hardware related.



  • Can I borrow your time machine??



  • Unfortunately somebody calling himself The Master stole it, muttering something about visiting a doctor ;)

    (Even if 1.2 isn't out at the end of the month I may upgrade to the latest RC anyway so I can get NUT support back)



  • hello!

    I also experience slow transfers with squid-2.6.5,pf 1.2RC3 and squidguard- 1.2.0_1 ,with squid in transparent mode.
    If i disable squid all web pages goes very fast.If i enable it the speed decreases at about 20-30%.It's not a big deal for me now but i would like to have it work better… :)

    thank you



  • @acidrop:

    hello!

    I also experience slow transfers with squid-2.6.5,pf 1.2RC3 and squidguard- 1.2.0_1 ,with squid in transparent mode.
    If i disable squid all web pages goes very fast.If i enable it the speed decreases at about 20-30%.It's not a big deal for me now but i would like to have it work better… :)

    thank you

    If disabled SquidGuard - speed slowly too?



  • yes it is slow even if i disable squidguard and even if i put the web site in exeption list to not be cached by squid.



  • @acidrop:

    yes it is slow even if i disable squidguard and even if i put the web site in exeption list to not be cached by squid.

    Traffic shaper used?



  • no i'm not using ts cause i have a dual wan config.



  • no traffic shaper, but I'm seeing this too…



  • I can confirm that I experience the same slowdown when using the proxy.

    No bandwidth throttling set.  No Traffic Shaper used at the moment, either.

    I tried setting squid's "Overall Bandwidth Throttling" to the maximum my connection allows, in case "Disabled" wasn't working as it should, but this had no effect.

    My maximum downstream speed is ~350kBps but I get between 175 and 200kBps when I use the proxy.



  • To Fix Squid

    add this to the /boot/loader.conf

    kern.ipc.nmbclusters=32768
    kern.maxfiles=65536
    kern.maxfilesperproc=32768
    net.inet.ip.portrange.last=65535

    or just delete it and replace with

    autoboot_delay="1"
    #kern.ipc.nmbclusters="0"
    hint.apic.0.disabled=1
    kern.hz=100
    #for squid
    kern.ipc.nmbclusters="32768"
    kern.maxfiles="65536"
    kern.maxfilesperproc="32768"
    net.inet.ip.portrange.last="65535"

    you might ask why squid is so slow? its because default configuration of pfsense is router not as a server
    thats why kern.ipc.nmbclusters="0" <- is set to zero. if you just simply remove this squid will be just fine.

    but to tune the squid i add this
    kern.ipc.nmbclusters: 32768
    kern.maxfiles=65536
    kern.maxfilesperproc=32768
    net.inet.ip.portrange.last: 65535

    i just figure out why squid is slow. but i don't like the binary package of squid. i'll be using the squid HEAD bec of the store_rewrite feature for caching youtubes videos and other video files and mp3.



  • hello all,

    i seem to experience the same problem/situation, and configured /boot/loader.conf as suggested and re-start the squid service. but after half an hour, squid and squidguard suddenly stopped functioning… tracing the cause of the problem, i found out that /var/squid/cache occupied the available disk space, therefore stopping the services. could the modification in /boot/loader.conf caused this? can you please explain what's the effect of each line of the modification to /boot/loader.conf?

    thank you very much for clearing this up.

    allison



  • WOW this makes a big change to squid !!!

    Thank You

    Now it is helpfull and not a pain anymore

    Is there anywhere a squid 3.0 based package for pfsense ?



  • The change must be made to loader.conf in 1.2.2_RELEASE as well.  I was suffering from the exceptionally slow transfers until I commented out the #kern.ipc.nmbclusters="0"

    @Devs
    What are the advantages of this argument?  Why was this changed temporarily in the 1.2/FreeBSD 6.3 Release?  Any insight would be greatly appreciated.  Perhaps someone could also commit a change to the Squid packages so that the loader.conf gets updated upon package installation.


Locked