Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Squid slow Transfers

    Scheduled Pinned Locked Moved pfSense Packages
    19 Posts 11 Posters 26.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • V Offline
      voona
      last edited by

      Hi Guys,

      Great work with PFSENSE :)

      Just an anoying issue im having basically with the Squid Proxy off can get transfers of 1.6 MB Sec (Link Max) but with the transparent proxy on, it hovvers around the 1.1 MB Mark?

      Was running 1.3 RC but just upgraded to 1.4 and having the same issue.

      Its on a Duel  Athlon with 2Gig Ram?

      Any help appreciated.
      Cheers

      1 Reply Last reply Reply Quote 0
      • F Offline
        flachance
        last edited by

        I'm curious, if I wanted to test the throughput of my system, how would I go about to do that?  I have the transparent proxy on as well and I'd like to compare with you.  How did you do your measurement?

        Thanks!

        1 Reply Last reply Reply Quote 0
        • M Offline
          mhab12
          last edited by

          I've been seeing similar issues, but with my system the difference is more like 340 kB/s without the proxy, and about 20 kB/s through the proxy.  Hopefully this post will help the issue get the attention it deserves.

          1 Reply Last reply Reply Quote 0
          • Cry HavokC Offline
            Cry Havok
            last edited by

            I can happily push 20 Mb/s (2.5 MB/s) through Squid on my pfSense host, so it's not a generic problem.

            1 Reply Last reply Reply Quote 0
            • M Offline
              mhab12
              last edited by

              Cry Havok - you are admittedly running 1.2beta2.

              I am running the latest published Squid package (2.6.5_1-p15), though I'm still on 1.2-beta2.

              I am curious if you would see symptoms if you upgraded to latest release.  Guess we'll find find out when 1.2 goes final, by 1/31 according to the pfsense blog!  Thanks for the continued input though - everyone appreciates it.

              1 Reply Last reply Reply Quote 0
              • Cry HavokC Offline
                Cry Havok
                last edited by

                Yes, I am running beta.  Of course, given that the OP claims to be running 1.3 then 1.4 - yet 1.2 hasn't gone final yet, I think we've got a good range of releases for (non-)information gathering ;)

                We should find out in a week or so whether the problem is related to a post 1.2 Beta2 change or whether it's hardware related.

                1 Reply Last reply Reply Quote 0
                • S Offline
                  sullrich
                  last edited by

                  Can I borrow your time machine??

                  1 Reply Last reply Reply Quote 0
                  • Cry HavokC Offline
                    Cry Havok
                    last edited by

                    Unfortunately somebody calling himself The Master stole it, muttering something about visiting a doctor ;)

                    (Even if 1.2 isn't out at the end of the month I may upgrade to the latest RC anyway so I can get NUT support back)

                    1 Reply Last reply Reply Quote 0
                    • A Offline
                      acidrop
                      last edited by

                      hello!

                      I also experience slow transfers with squid-2.6.5,pf 1.2RC3 and squidguard- 1.2.0_1 ,with squid in transparent mode.
                      If i disable squid all web pages goes very fast.If i enable it the speed decreases at about 20-30%.It's not a big deal for me now but i would like to have it work better… :)

                      thank you

                      1 Reply Last reply Reply Quote 0
                      • D Offline
                        dvserg
                        last edited by

                        @acidrop:

                        hello!

                        I also experience slow transfers with squid-2.6.5,pf 1.2RC3 and squidguard- 1.2.0_1 ,with squid in transparent mode.
                        If i disable squid all web pages goes very fast.If i enable it the speed decreases at about 20-30%.It's not a big deal for me now but i would like to have it work better… :)

                        thank you

                        If disabled SquidGuard - speed slowly too?

                        SquidGuardDoc EN  RU Tutorial
                        Localization ru_PFSense

                        1 Reply Last reply Reply Quote 0
                        • A Offline
                          acidrop
                          last edited by

                          yes it is slow even if i disable squidguard and even if i put the web site in exeption list to not be cached by squid.

                          1 Reply Last reply Reply Quote 0
                          • D Offline
                            dvserg
                            last edited by

                            @acidrop:

                            yes it is slow even if i disable squidguard and even if i put the web site in exeption list to not be cached by squid.

                            Traffic shaper used?

                            SquidGuardDoc EN  RU Tutorial
                            Localization ru_PFSense

                            1 Reply Last reply Reply Quote 0
                            • A Offline
                              acidrop
                              last edited by

                              no i'm not using ts cause i have a dual wan config.

                              1 Reply Last reply Reply Quote 0
                              • M Offline
                                mhab12
                                last edited by

                                no traffic shaper, but I'm seeing this too…

                                1 Reply Last reply Reply Quote 0
                                • F Offline
                                  fallen
                                  last edited by

                                  I can confirm that I experience the same slowdown when using the proxy.

                                  No bandwidth throttling set.  No Traffic Shaper used at the moment, either.

                                  I tried setting squid's "Overall Bandwidth Throttling" to the maximum my connection allows, in case "Disabled" wasn't working as it should, but this had no effect.

                                  My maximum downstream speed is ~350kBps but I get between 175 and 200kBps when I use the proxy.

                                  1 Reply Last reply Reply Quote 0
                                  • C Offline
                                    chudy
                                    last edited by

                                    To Fix Squid

                                    add this to the /boot/loader.conf

                                    kern.ipc.nmbclusters=32768
                                    kern.maxfiles=65536
                                    kern.maxfilesperproc=32768
                                    net.inet.ip.portrange.last=65535

                                    or just delete it and replace with

                                    autoboot_delay="1"
                                    #kern.ipc.nmbclusters="0"
                                    hint.apic.0.disabled=1
                                    kern.hz=100
                                    #for squid
                                    kern.ipc.nmbclusters="32768"
                                    kern.maxfiles="65536"
                                    kern.maxfilesperproc="32768"
                                    net.inet.ip.portrange.last="65535"

                                    you might ask why squid is so slow? its because default configuration of pfsense is router not as a server
                                    thats why kern.ipc.nmbclusters="0" <- is set to zero. if you just simply remove this squid will be just fine.

                                    but to tune the squid i add this
                                    kern.ipc.nmbclusters: 32768
                                    kern.maxfiles=65536
                                    kern.maxfilesperproc=32768
                                    net.inet.ip.portrange.last: 65535

                                    i just figure out why squid is slow. but i don't like the binary package of squid. i'll be using the squid HEAD bec of the store_rewrite feature for caching youtubes videos and other video files and mp3.

                                    1 Reply Last reply Reply Quote 0
                                    • I Offline
                                      isonski
                                      last edited by

                                      hello all,

                                      i seem to experience the same problem/situation, and configured /boot/loader.conf as suggested and re-start the squid service. but after half an hour, squid and squidguard suddenly stopped functioning… tracing the cause of the problem, i found out that /var/squid/cache occupied the available disk space, therefore stopping the services. could the modification in /boot/loader.conf caused this? can you please explain what's the effect of each line of the modification to /boot/loader.conf?

                                      thank you very much for clearing this up.

                                      allison

                                      1 Reply Last reply Reply Quote 0
                                      • M Offline
                                        mlabenda
                                        last edited by

                                        WOW this makes a big change to squid !!!

                                        Thank You

                                        Now it is helpfull and not a pain anymore

                                        Is there anywhere a squid 3.0 based package for pfsense ?

                                        Microsoft gives you "Windows"
                                        Opensource gives you the whole house

                                        1 Reply Last reply Reply Quote 0
                                        • M Offline
                                          mhab12
                                          last edited by

                                          The change must be made to loader.conf in 1.2.2_RELEASE as well.  I was suffering from the exceptionally slow transfers until I commented out the #kern.ipc.nmbclusters="0"

                                          @Devs
                                          What are the advantages of this argument?  Why was this changed temporarily in the 1.2/FreeBSD 6.3 Release?  Any insight would be greatly appreciated.  Perhaps someone could also commit a change to the Squid packages so that the loader.conf gets updated upon package installation.

                                          1 Reply Last reply Reply Quote 0
                                          • First post
                                            Last post
                                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.