• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

Want to setup squid-proxy and squidguard but have lots of questions.

Scheduled Pinned Locked Moved Cache/Proxy
squid-proxysquidguardcontentfilter
16 Posts 4 Posters 2.9k Views
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J
    jc1976 @dutsnekcirf
    last edited by jc1976 Dec 21, 2023, 5:09 PM Dec 21, 2023, 5:02 PM

    @dutsnekcirf

    i'm interested in a somewhat similar concept as well regarding the tsl/cert thing, particularly your 3rd point.. hopefully folks will chime in.

    the problem is as of yet, getting squid updated and supported with pfsense has been iffy.. one of the guru's on here created an update package that, after installing the latest version of pfsense, you could get squid updated, however it requires running scripts that he wrote, and while they work well, if most people are shying away from squid/clamav because 99% of all web traffic today is encrypted, so clamav won't really serve a purpose.. even suricata and snort can't do their jobs to their full capability because of the encryption, but i digress..

    i was wondering if the following setup were possible:

    1. use haproxy for tls termination on the wan,
    2. from there, send all unencrypted traffic to another device that's piggy-backing off the pfsense box. a small box that's running linux with a full-fledged modern antivirus solution (like crowdstrike or sentinalOne for example) for scanning,
    3. the stream gets sent BACK to the pfsense box to be further scanned by suricata (or snort),
    4. data stream moves on to the clients, maybe re-encrypting it to satisfy the browsers and other apps that would otherwise complain..

    it seems like it should be possible.. the modularity of it all is a nice idea because if i'm not satisfied with the antivirus solution, i can just install another one instead of being locked into clamav..

    i figured linux for the AV part because there are far more enterprise grade AV solutions for linux than freeBSD.

    overly complicated? meh.. maybe.. but that doesn't mean it wouldn't work, especially for a small network.. plus it's less expensive and more flexible than something from palo alto..

    sure, put crowdstrike on the clients and call it a day, but i'd like to be able to stop the bugs from getting in at the firewall rather than wait until their in..

    opinions?

    1 Reply Last reply Reply Quote 0
    • J
      JonathanLee
      last edited by JonathanLee Dec 21, 2023, 7:59 PM Dec 21, 2023, 7:46 PM

      I use it and love it. It requires a lot of work to configure it, and certs installed.

      https://forum.it-monkey.net/index.php?topic=23.0

      My favorite guide for Squid and Squidguard.

      I use custom settings here.

      Some devices are splice only

      Screenshot 2023-12-21 at 11.51.59 AM.png

      I have a regex based splice only file for sites you always want spliced.

      Screenshot 2023-12-21 at 11.53.00 AM.png

      Works great it has amazing code, Marcos worked wonders on it. I will let my 2100 die with the version that supports it.

      Here is it running in real time
      Screenshot 2023-12-21 at 11.55.13 AM.png

      My accelerator running.
      Screenshot 2023-12-21 at 11.54.54 AM.png

      A blocked URL

      Screenshot 2023-12-21 at 11.58.31 AM.png

      Make sure to upvote

      J 1 Reply Last reply Dec 21, 2023, 7:59 PM Reply Quote 0
      • J
        jc1976 @JonathanLee
        last edited by Dec 21, 2023, 7:59 PM

        @JonathanLee

        could you use a wpad configuration to auto input your proxy into web browsers instead of installing a cert on each pc?
        that has always interested me

        J 2 Replies Last reply Dec 21, 2023, 8:03 PM Reply Quote 0
        • J
          JonathanLee @jc1976
          last edited by JonathanLee Dec 21, 2023, 8:07 PM Dec 21, 2023, 8:03 PM

          @jc1976 Yes use DHCP option 252 with it point to your wpad

          "https://192.168.1.1:8080/wpad.dat"

          Screenshot 2023-12-21 at 12.00.10 PM.png

          It is the most amazing package. It is complex to configure..

          Screenshot 2023-12-21 at 12.01.19 PM.png

          Real time view with litesquid

          Screenshot 2023-12-21 at 12.03.27 PM.png

          It doesn't care about DoH or DNL over TLS.

          It is simple it looks at the get requests and blocks.

          Of course you need the splice list for office stuff outlook teams email. The URL blocker is amazing. Thank you Marcos!!!! very secure consumer side cybersecurity tool. Big Tech hates it. It's the giant spotlight of cybersecurity.

          Make sure to upvote

          1 Reply Last reply Reply Quote 0
          • J
            JonathanLee
            last edited by Dec 21, 2023, 8:11 PM

            it's even got on the fly https/http antivirus if your system has the RAM for clamAV. It will stop a virus and show an error page.

            1698865258654-1691622380809-1686121145228-screenshot-2023-06-06-at-11.58.44-pm.png

            Make sure to upvote

            1 Reply Last reply Reply Quote 0
            • J
              JonathanLee @jc1976
              last edited by Dec 21, 2023, 8:13 PM

              @jc1976 I use SSL certs, it can't run without them, you got to own the hardware to install the certs.

              Make sure to upvote

              1 Reply Last reply Reply Quote 0
              • J
                JonathanLee
                last edited by JonathanLee Dec 21, 2023, 8:17 PM Dec 21, 2023, 8:16 PM

                If we did this feature request add on anyone could use it

                https://redmine.pfsense.org/issues/14998

                It would make the splice lists as easy as pushing a button on the proxy.

                Its not a recommended package Netgate depreciated it for a DNS based blocker.

                I dislike DNS versions..

                Make sure to upvote

                J 1 Reply Last reply Dec 21, 2023, 8:46 PM Reply Quote 0
                • J
                  jc1976
                  last edited by Dec 21, 2023, 8:38 PM

                  the only problem with all this is netgate seems to be trying to phase out squid.. hence my thought of being able to splice in a linux box that could handle inline antivirus scanning as it came through the firewall, after tls termination at the wan.

                  1 Reply Last reply Reply Quote 0
                  • J
                    jc1976 @JonathanLee
                    last edited by Dec 21, 2023, 8:46 PM

                    @JonathanLee

                    regarding your request to have the ability to "not cache" anything, unless i'm reading it wrong, it does have that ability..

                    under "services -> squid proxy server -> localc cache" at the top you can 'disable caching' by checking the box, and at the bottom of the page you can specify how much ram you'd like to commit to squid caching, if you were to enable caching.. as for hard drive cache system, i have that set to 'null' and for memory cache size i have that at 2 gigs.. but again, if don't enable caching, it seems to me the packet stream would be scanned inline without being cached.

                    J 1 Reply Last reply Dec 21, 2023, 8:54 PM Reply Quote 0
                    • J
                      JonathanLee @jc1976
                      last edited by JonathanLee Dec 21, 2023, 9:02 PM Dec 21, 2023, 8:54 PM

                      @jc1976 I want to cache with it. I like it. I use affordable DSL, so it helps keep everything smooth and my bill down. Yes you can disable caching completely, you can even disable ClamAV if you want and only use splice mode for a URL blocker. So you don't even need certificates like that. Again, with this version you could run it in transparent mode and never need to even set proxies, it would transparently block URLS like that and show an error page. I am doing a more complex version where some devices are https ssl intercepted to look for container virtualized bugs data marshaling network cards, "I found them however I needed Snort AppID to track them down in the end" and some devices are set to transparent mode where it looks at only the get request and nothing else.

                      It is a very amazing set of software. I am so in love with this package and the way it works. I report stuff all the time with it, track items its great. It is also protected behind a firewall set of rules so it's great for pfSense.

                      My SG-2100 will continue to use it until the appliance dies. The final version of pfSense after 4 years of config changes, code, bugs, works perfectly, I am not going to give up on it. To everyone that worked on it at Netgate and all the community members to make it finally work, Thank you. The device works how it should for what I need, sure it's super secure maybe to secure but that was what was needed for cybersecurity, to stop the ransomware all the issues stopped with something like this. This was the firewall that helped END it.

                      Make sure to upvote

                      1 Reply Last reply Reply Quote 0
                      • J
                        jdb67
                        last edited by May 22, 2024, 10:09 AM

                        Hey. Question for you guys:

                        When squid is attempting to redirect, I get:

                        <p>The following error was encountered while trying to retrieve the URL: <a href="https://http/">https://http/</a></p>

                        on an HTML response.

                        acl {
                                default  {
                        		pass !badstuff destinations all
                        		redirect http://wpad.jvj.com/denied?url=Access+Denied&a=%a&n=%n&i=%i&s=%s&t=%t&u=%u
                        		log block.log
                        	}
                        }
                        

                        the redirect is behaving as a host, not a URL. what is the proper syntax? As ChatGPT says this is correct. But, cannot be.

                        1 Reply Last reply Reply Quote 0
                        • J
                          jdb67
                          last edited by May 22, 2024, 10:15 AM

                          Hey! Another one!

                          When I try to go to the squid 'status' on the pfsense GUI, I get a 403 error:

                          HTTP/1.1 403 Forbidden
                          Server: squid/6.6
                          Mime-Version: 1.0
                          Date: Wed, 22 May 2024 10:12:57 GMT
                          Content-Type: text/html;charset=utf-8
                          Content-Length: 3800
                          X-Squid-Error: ERR_ACCESS_DENIED 0
                          Vary: Accept-Language
                          Content-Language: en
                          Cache-Status: squid.jvj28.com
                          Via: 1.1 squid.jvj.com (squid/6.6), 1.1 squid.jvj.com (squid/6.6)
                          Cache-Status: squid.jvj28.com;detail=no-cache
                          Connection: close
                          

                          I really have looked for every ACL that I could think of. Not finding the issue.

                          J 1 Reply Last reply May 22, 2024, 1:22 PM Reply Quote 0
                          • J
                            JonathanLee @jdb67
                            last edited by May 22, 2024, 1:22 PM

                            @jdb67 there is an open Redmine ticket to fix the status page, Squid has a new url schema to access the status page the GUI code still needs to be updated.

                            Make sure to upvote

                            J 1 Reply Last reply Jun 3, 2024, 10:48 AM Reply Quote 0
                            • J
                              jdb67 @JonathanLee
                              last edited by Jun 3, 2024, 10:48 AM

                              @JonathanLee Sweet. Thanks

                              J 1 Reply Last reply Jun 4, 2024, 5:07 AM Reply Quote 1
                              • J
                                JonathanLee @jdb67
                                last edited by Jun 4, 2024, 5:07 AM

                                @jdb67 You might also try to email the Squid users support email to get Squid help they are very helpful sometimes the original code writers chime in and help users.

                                squid-users@lists.squid-cache.org

                                FYI: You will have to register your email and wait for approval before you can send out a email to everyone on this however.

                                Make sure to upvote

                                1 Reply Last reply Reply Quote 0
                                • First post
                                  Last post
                                Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.
                                  [[user:consent.lead]]
                                  [[user:consent.not_received]]