Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Guide to configure squid, squidguard, https?

    Scheduled Pinned Locked Moved pfSense Packages
    38 Posts 10 Posters 8.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • T
      thecableguy
      last edited by

      @KOM:

      I gave you the link for one in my previous post  ;D

      Thanks, I did see that however I am not an expert like yourself  ;), I was looking for a comprehensive guide from A to Z to configure WPAD..

      Is this guide correct? :

      http://irj972.co.uk/articles/pfSense-WPAD-PAC-configuration

      Thanks

      1 Reply Last reply Reply Quote 0
      • KOMK
        KOM
        last edited by

        The guide I linked to was much easier for me to understand (I just did this whole exercise two weeks ago!) than the one you provided.  Really, it's a lot easier than you think:

        1.  Login to pfSense via SSH and go to /usr/local/www
        2.  Create wpad.dat and stuff it with:

        function FindProxyForURL(url,host)
        {
        return "PROXY Your.Proxy.IP.Address:3128";
        }

        3.  Copy wpad.dat to wpad.da and proxy.pac to support other auto-discovery methods
        4.  Create a DNS entry for wpad and point it to your pfSense LAN IP
        5.  Create a DHCP Option 252 entry and point it to your pfSense WPAD URL: http://Your_pfSense_LAN_IP:Port/wpad.dat
        6.  Add LAN rules that block port 80 and port 43

        Done.

        1 Reply Last reply Reply Quote 0
        • C
          Cino
          last edited by

          Only problem with that setup, pfSense should be using port 443 for the WebGUI which means port 80 isn't listening anymore.  I've had look results adding v-host and dropping the wpad files into that folder for hosting.

          1 Reply Last reply Reply Quote 0
          • KOMK
            KOM
            last edited by

            pfSense should be using port 443 for the WebGUI which means port 80 isn't listening anymore

            And yet it works.  It probably listens on both but only serves on the specified port.

            1 Reply Last reply Reply Quote 0
            • C
              Cino
              last edited by

              @KOM:

              pfSense should be using port 443 for the WebGUI which means port 80 isn't listening anymore

              And yet it works.  It probably listens on both but only serves on the specified port.

              Port 80 is closed when I enabled https and is free for another process to use.

              1 Reply Last reply Reply Quote 0
              • KOMK
                KOM
                last edited by

                Actually, I'm a moron.  While my test 2.2 box is HTTPS, my 2.1.5 box is HTTP.  Yes, if you have WebGUI set for HTTPS then you will need another web server to host the WPAD files.

                1 Reply Last reply Reply Quote 0
                • cwagzC
                  cwagz
                  last edited by

                  Couple of questions:

                  So if I put the wpad.dat files on a virtual webserver on my network I could leave pfsense GUI on 443?

                  and

                  If Squid is used in normal mode does it filter HTTPS without having to do the man in the middle thing?  I am trying to decide how to protect my kids as well…

                  Thanks
                  Chad

                  Netgate 6100 MAX

                  1 Reply Last reply Reply Quote 0
                  • marcellocM
                    marcelloc
                    last edited by

                    Chad,  if wpad stays out of pfsense box(or at least out of default web server)  you can leave it 443.

                    While using active proxy,  you can filter https sites but not https urls without ssl interception.

                    Treinamentos de Elite: http://sys-squad.com

                    Help a community developer! ;D

                    1 Reply Last reply Reply Quote 0
                    • cwagzC
                      cwagz
                      last edited by

                      Thanks marcelloc,

                      I have gotten my setup working with wpad and was pretty happy but then found that minecraft would not use the proxy and failed to launch. I then setup a transparent proxy and everything works good but of course the kids can bypass the filter by going https. I then got https filtering working in transparent mode only to find that Minecraft won't buy my CA and therefore won't download it's package from Amazon.

                      Is there a way to have traffic out to a specic website not go through the ssl interception?
                      Anyone have a good solution?

                      Chad

                      Netgate 6100 MAX

                      1 Reply Last reply Reply Quote 0
                      • KOMK
                        KOM
                        last edited by

                        When you have your proxy in standard mode (non-transparent), you typically use firewall rules to block access from LAN to ports 80 and 443.  In your case, you want to add a rule above the block rule that specifically allows your Minecraft box to talk on 80/443 or whatever Minecraft uses for its updates.

                        1 Reply Last reply Reply Quote 0
                        • marcellocM
                          marcelloc
                          last edited by

                          While using transparent proxy,  create a host alias with  hosts/ips (not domains)  you want to bypass the transparent proxy  and then put this alias on squid general tab(bypass proxy to these Destination ips).

                          Treinamentos de Elite: http://sys-squad.com

                          Help a community developer! ;D

                          1 Reply Last reply Reply Quote 0
                          • cwagzC
                            cwagz
                            last edited by

                            I thought i tried putting s3.amazonaws.com in the bypass proxy to these destinations without affect.  Is this the right format for the host alias?

                            The problem with the firewall rule for standard mode is I would end up bypassing all of my kids computers from being forced through the proxy.  I did find something about launching minecraft via a shortcut to define the proxy so I may go back to trying standard mode if i cannot get the launcher to work with ssl interception.  So far I have installed my cert on all of our phones and machines and the transparent proxy is working really well.  It just seems to be minecraft that is causing problems.

                            Thanks for the help.

                            Netgate 6100 MAX

                            1 Reply Last reply Reply Quote 0
                            • J
                              Jambro1964
                              last edited by

                              I used GPO to push the cert to all domain computers, the pain was all the BYODs and had to manually import the cert. I just stuck it on the internal webserver and gave all instructions to get to it and import it. Wasn't that bad.

                              My problem now is that Squid has problems with https sites that are using TLS 1.2.  Any one know how to fix that in the Squid-dev so I can continue to use MitM?

                              Thanks,

                              Jim

                              1 Reply Last reply Reply Quote 0
                              • T
                                thecableguy
                                last edited by

                                @KOM:

                                The guide I linked to was much easier for me to understand (I just did this whole exercise two weeks ago!) than the one you provided.  Really, it's a lot easier than you think:

                                1.  Login to pfSense via SSH and go to /usr/local/www
                                2.  Create wpad.dat and stuff it with:

                                function FindProxyForURL(url,host)
                                {
                                return "PROXY Your.Proxy.IP.Address:3128";
                                }

                                3.  Copy wpad.dat to wpad.da and proxy.pac to support other auto-discovery methods
                                4.  Create a DNS entry for wpad and point it to your pfSense LAN IP
                                5.  Create a DHCP Option 252 entry and point it to your pfSense WPAD URL: http://Your_pfSense_LAN_IP:Port/wpad.dat
                                6.  Add LAN rules that block port 80 and port 43

                                Done.

                                I understand this however, is there a step by step guide? I am still learning BSD and Linux and don't want to make any mistakes..

                                Thanks

                                1 Reply Last reply Reply Quote 0
                                • marcellocM
                                  marcelloc
                                  last edited by

                                  KOM steps are a step by step guide.  The dhcp stuff you can configure on your active directory (Windows)  but you will also find good guides looking for wpad + dhcp configuration on forum, Google and/or youtube.

                                  Treinamentos de Elite: http://sys-squad.com

                                  Help a community developer! ;D

                                  1 Reply Last reply Reply Quote 0
                                  • cwagzC
                                    cwagz
                                    last edited by

                                    @marcelloc:

                                    While using transparent proxy,  create a host alias with  hosts/ips (not domains)  you want to bypass the transparent proxy  and then put this alias on squid general tab(bypass proxy to these Destination ips).

                                    I tried this again and realized I was missing a required host.  It works!  Minecraft needs the following bypassed:
                                    s3.amazonaws.com
                                    authserver.mojang.com

                                    Thanks again

                                    Netgate 6100 MAX

                                    1 Reply Last reply Reply Quote 0
                                    • marcellocM
                                      marcelloc
                                      last edited by

                                      The real time tab is really useful for these diagnostics  :)

                                      Treinamentos de Elite: http://sys-squad.com

                                      Help a community developer! ;D

                                      1 Reply Last reply Reply Quote 0
                                      • cwagzC
                                        cwagz
                                        last edited by

                                        Maybe this will help some for thecableguy.  From KOM guide which I followed:

                                        I put my wpad.dat on a virtual machine running ubuntu but the same stuff works in pfsense i believe.  There are a lot of blogs and posts that show how to use this stuff as well.

                                        1.  Login to pfSense via SSH and go to /usr/local/www
                                        I use Putty on windows to do this.  You have to turn SSH access on in pfsense

                                        2.  Create wpad.dat and stuff it with:
                                        you can also do this from inside pfsense using the "edit file" page
                                        or cd to the directory above and then use nano to create the file (hopefully nano is included in pfsense otherwise google how to use vi)

                                        #nano wpad.dat

                                        function FindProxyForURL(url,host)
                                        {
                                        return "PROXY Your.Proxy.IP.Address:3128";
                                        }

                                        3.  Copy wpad.dat to wpad.da and proxy.pac to support other auto-discovery methods
                                        #cp wpad.dat wpad.da
                                        #cp wpad.dat proxy.pac

                                        4.  Create a DNS entry for wpad and point it to your pfSense LAN IP

                                        5.  Create a DHCP Option 252 entry and point it to your pfSense WPAD URL: http://Your_pfSense_LAN_IP:Port/wpad.dat

                                        6.  Add LAN rules that block port 80 and port 43

                                        Done.

                                        Netgate 6100 MAX

                                        1 Reply Last reply Reply Quote 0
                                        • M
                                          MrGlasspoole
                                          last edited by

                                          I can't get WPAD to work.

                                          What i did is installing vHosts and there i made this setting:

                                          Host: wpad.mydomain.net
                                          IP Address: 192.168.0.1
                                          Port: 80
                                          

                                          I uploaded .dat, .da and .pac to /usr/local/vhosts/wpad.mydomain.net
                                          I checked lighty-webConfigurator.conf and the mimetypes are there.

                                          webConfigurator is set to HTTPS and "Disable webConfigurator redirect rule"

                                          DNS Resolver Host Overrides has:

                                          Host: wpad
                                          Domain: mydomain.net
                                          IP: 192.168.0.1
                                          

                                          DHCP Server LAN Additional BOOTP/DHCP Options has:

                                          255 TEXT http://192.168.0.1:80/wpad.dat
                                          255 TEXT http://192.168.0.1:80/wpad.da
                                          255 TEXT http://192.168.0.1:80/proxy.pac
                                          

                                          I can download the files in the browser with wpad.mydomain.net/wpad.dat
                                          It also works if i add the path to the wpad.dat into the browser proxy settings
                                          but Auto-Proxy does not work.

                                          I also wonder about blocking port 80. If i do that no side is reachable anymore.

                                          And just as i wrote that i had the idea to check if 192.168.0.1:80/wpad.dat downloads
                                          the file in the browser - it doesn't. Maybe thats the problem?

                                          1 Reply Last reply Reply Quote 0
                                          • W
                                            wiz561
                                            last edited by

                                            A question about the wpad configuration and squid in standard mode with HTTPS.  Can you cache HTTPS pages?  Do you have to do the MitM and install the self signed certificate on the client workstations in order for you to cache HTTPS?

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.