Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Squid…Log Filled with nothing but TCP_200MISS

    Scheduled Pinned Locked Moved pfSense Packages
    19 Posts 3 Posters 24.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • chrismacmahonC
      chrismacmahon
      last edited by

      I am at a loss to know where to go. 
      My logs are full of nothing but TCP_200MISS:

      tail /var/squid/logs

      2.1-RELEASE][admin@pfsense.local]/var/squid/logs(66): tail access.log
      1382670302.185    145 192.168.91.210 TCP_MISS/200 2619 GET http://f.thumbs.redditmedia.com/asWiuhvOZjpIWvpG.jpg - DIRECT/184.29.105.136 image/jpeg
      1382670302.206    198 192.168.91.210 TCP_MISS/200 1410 GET http://e.thumbs.redditmedia.com/-Yo3mWEMwVpHUrc4.jpg - DIRECT/184.29.105.163 image/jpeg
      1382670302.262    254 192.168.91.210 TCP_MISS/200 2023 POST http://www.reddit.com/api/request_promo - DIRECT/184.29.105.187 text/html
      1382670302.396    121 192.168.91.210 TCP_MISS/200 706 GET http://www.reddit.com/user/the_wookie_of_maine/about.json? - DIRECT/184.29.105.187 application/json
      1382670302.507    57 192.168.91.210 TCP_MISS/200 415 GET http://pixel.redditmedia.com/pixel/of_defenestration.png? - DIRECT/54.225.255.55 image/png
      1382670302.507    234 192.168.91.210 TCP_MISS/200 1099 GET http://www.flickr.com/services/oembed/? - DIRECT/206.190.57.61 application/json
      1382670302.613    355 192.168.91.210 TCP_MISS/200 1381 GET http://gdata.youtube.com/feeds/api/videos? - DIRECT/74.125.226.200 application/json
      1382670302.654    98 192.168.91.210 TCP_MISS/200 531 GET http://www.google-analytics.com/__utm.gif? - DIRECT/74.125.226.193 image/gif
      1382670302.688    116 192.168.91.210 TCP_MISS/200 389 GET http://tracker.redditmedia.com/fetch-trackers? - DIRECT/23.21.201.128 text/javascript
      1382670302.813    44 192.168.91.210 TCP_MISS/200 415 GET http://pixel.redditmedia.com/pixel/of_doom.png? - DIRECT/54.225.255.55 image/png

      Looking at lightsquid:  we have gotten 20gb of data, but 0% hits..again we visit some graphic heavy sites.

      Need help fast? Our support is available 24/7 https://www.netgate.com/support/

      Do Not PM For Help!

      1 Reply Last reply Reply Quote 0
      • perikoP
        periko
        last edited by

        does squid created the cache directories?

        ls /var/squid/cache/?

        cat /var/squid/logs/access.log | grep HIT

        Return something?

        Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
        www.bajaopensolutions.com
        https://www.facebook.com/BajaOpenSolutions
        Quieres aprender PfSense, visita mi canal de youtube:
        https://www.youtube.com/c/PedroMorenoBOS

        1 Reply Last reply Reply Quote 0
        • chrismacmahonC
          chrismacmahon
          last edited by

          [2.1-RELEASE][admin@pfsense.local]/root(1): cat /var/log/squid/access.log | grep hit
          [2.1-RELEASE][admin@pfsense.local]/root(2):

          Returned nothing

          Need help fast? Our support is available 24/7 https://www.netgate.com/support/

          Do Not PM For Help!

          1 Reply Last reply Reply Quote 0
          • marcellocM
            marcelloc
            last edited by

            /var/squid/logs

            Treinamentos de Elite: http://sys-squad.com

            Help a community developer! ;D

            1 Reply Last reply Reply Quote 0
            • chrismacmahonC
              chrismacmahon
              last edited by

              2.1-RELEASE][admin@pfsense.local]/root(1):cat /var/squid/logs/access.log | grep HIT
              [2.1-RELEASE][admin@pfsense.local]/root(2):

              same thing

              Need help fast? Our support is available 24/7 https://www.netgate.com/support/

              Do Not PM For Help!

              1 Reply Last reply Reply Quote 0
              • marcellocM
                marcelloc
                last edited by

                Did you enabled cache?

                Treinamentos de Elite: http://sys-squad.com

                Help a community developer! ;D

                1 Reply Last reply Reply Quote 0
                • chrismacmahonC
                  chrismacmahon
                  last edited by

                  As near as I can tell.  Yes.

                  I have transparent proxy enabled.
                  I have my interface selected
                  I have /var/squid/logs
                  log rotated every 5 days.

                  Heap LRU is selcted for policy
                  /var/squid/cache is cache area

                  Need help fast? Our support is available 24/7 https://www.netgate.com/support/

                  Do Not PM For Help!

                  1 Reply Last reply Reply Quote 0
                  • marcellocM
                    marcelloc
                    last edited by

                    What you have on Hard disk cache size and Hard disk cache system?

                    Treinamentos de Elite: http://sys-squad.com

                    Help a community developer! ;D

                    1 Reply Last reply Reply Quote 0
                    • chrismacmahonC
                      chrismacmahon
                      last edited by

                      2048 and ufs

                      Need help fast? Our support is available 24/7 https://www.netgate.com/support/

                      Do Not PM For Help!

                      1 Reply Last reply Reply Quote 0
                      • perikoP
                        periko
                        last edited by

                        No problem, u can force the creation of the cache dir structure, if doesn't exist.

                        U must have access to your shell.

                        1; Stop the service from the GUI.
                        2; run this command:

                        squid -z

                        u will see a lot of info, once it finish, check the dir for the whole directories:

                        ls /var/squid/cache/

                        U must seen if u setup squid with default settings, u must have 16 directories and each one with more directories.

                        Once u check this start the service from the GUI, I will suggest to restart your machine, this way squid will check the cache directory.

                        If everything is goes well, test with your browser and hope this fix the issue.

                        Other thing, change UFS to AUFS.

                        Good luck !!!

                        Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                        www.bajaopensolutions.com
                        https://www.facebook.com/BajaOpenSolutions
                        Quieres aprender PfSense, visita mi canal de youtube:
                        https://www.youtube.com/c/PedroMorenoBOS

                        1 Reply Last reply Reply Quote 0
                        • perikoP
                          periko
                          last edited by

                          U are right men, I have a full installation on a P4 machine, squid is not caching nothing, I got just 1 HIT, I'm working to see this issue and see if we could fix this  :o

                          Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                          www.bajaopensolutions.com
                          https://www.facebook.com/BajaOpenSolutions
                          Quieres aprender PfSense, visita mi canal de youtube:
                          https://www.youtube.com/c/PedroMorenoBOS

                          1 Reply Last reply Reply Quote 0
                          • perikoP
                            periko
                            last edited by

                            Looks like is working.

                            My installation created the cache dir, no issue, but I check the

                            access.log

                            and I didn't founf any HIT, not even MEM_HIT.

                            Before increase debug settings, I did what I told u:

                            stop squid from GUI
                            delete cache dir
                            create cache structure again
                            restart squid from GUI
                            restart the machine

                            I start seen MEM_HIT/TCP_HIT again, hope this help u, see u latter.

                            Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                            www.bajaopensolutions.com
                            https://www.facebook.com/BajaOpenSolutions
                            Quieres aprender PfSense, visita mi canal de youtube:
                            https://www.youtube.com/c/PedroMorenoBOS

                            1 Reply Last reply Reply Quote 0
                            • marcellocM
                              marcelloc
                              last edited by

                              Do you think it's a cache create issue?

                              Treinamentos de Elite: http://sys-squad.com

                              Help a community developer! ;D

                              1 Reply Last reply Reply Quote 0
                              • perikoP
                                periko
                                last edited by

                                I will reinstall pfsense+squid and let u know, can be, because my cache dir was created but it was not caching nothing until I recreate them, but need to make more test and see if is a install issue.

                                Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                                www.bajaopensolutions.com
                                https://www.facebook.com/BajaOpenSolutions
                                Quieres aprender PfSense, visita mi canal de youtube:
                                https://www.youtube.com/c/PedroMorenoBOS

                                1 Reply Last reply Reply Quote 0
                                • perikoP
                                  periko
                                  last edited by

                                  marcelloc, this is not a cache issue, well in my case I setup on other machine and no problem, it create the cache dir once u setup size and everything in the tab "local cache".
                                  For me is more related to the specific machine.
                                  But will be good to have a info list about this little issues that could happen to the new users and let them know how to check them and  fix them.
                                  See u latter!!!

                                  Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                                  www.bajaopensolutions.com
                                  https://www.facebook.com/BajaOpenSolutions
                                  Quieres aprender PfSense, visita mi canal de youtube:
                                  https://www.youtube.com/c/PedroMorenoBOS

                                  1 Reply Last reply Reply Quote 0
                                  • chrismacmahonC
                                    chrismacmahon
                                    last edited by

                                    I completely removed all of squid (I was on squid 3 sorry, should have put that at the top), from the package manager.
                                    Then I  searched the drive for squid references…removed all of them no backups, no xml's etc...
                                    Removed all 'cache' verified there was a dive in disk usage after the removal..all cache seemed to be gone.

                                    re-installed, and waited 3 hours, went to reddit a few times...tumblr/facebook/news text sights that I can cache (not video etc). still no "HIT" in access.log.

                                    Removed squid 3 via package manager.

                                    "downgraded" to squid.

                                    10% hit in 3 hours.

                                    I'm willing to test out ideas..this is now on my home box duplicating results...

                                    Thanks

                                    Need help fast? Our support is available 24/7 https://www.netgate.com/support/

                                    Do Not PM For Help!

                                    1 Reply Last reply Reply Quote 0
                                    • perikoP
                                      periko
                                      last edited by

                                      Just to add, once u remove and reinstall.

                                      clean your browsers cache, they have a internal cache to, this force them to request the web page.

                                      How u are getting those numbers?

                                      Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                                      www.bajaopensolutions.com
                                      https://www.facebook.com/BajaOpenSolutions
                                      Quieres aprender PfSense, visita mi canal de youtube:
                                      https://www.youtube.com/c/PedroMorenoBOS

                                      1 Reply Last reply Reply Quote 0
                                      • chrismacmahonC
                                        chrismacmahon
                                        last edited by

                                        I clean all the browser cache (chrome/firefox)..

                                        and lightsquid: 
                                        average              Hit %
                                        3.0 G           9.66%

                                        Need help fast? Our support is available 24/7 https://www.netgate.com/support/

                                        Do Not PM For Help!

                                        1 Reply Last reply Reply Quote 0
                                        • perikoP
                                          periko
                                          last edited by

                                          Remember that dynamic pages(fb, twitter, yt) won't punch the cache, if u can setup calamaris, squid-cache manager and compare with lightsquid reports.

                                          3GB won't say nothing, squid won't warranty that will use those 3GB at the moment.

                                          If u want to see the cache at full speed, give little memory to squid 128MB, restart, full day running and watch your reports, I cannot nothing about how lightsquid works, I don't used.

                                          Necesitan Soporte de Pfsense en México?/Need Pfsense Support in Mexico?
                                          www.bajaopensolutions.com
                                          https://www.facebook.com/BajaOpenSolutions
                                          Quieres aprender PfSense, visita mi canal de youtube:
                                          https://www.youtube.com/c/PedroMorenoBOS

                                          1 Reply Last reply Reply Quote 0
                                          • First post
                                            Last post
                                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.