Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    "aws s3 cp" crashes the firewall when using squid web proxy

    Scheduled Pinned Locked Moved General pfSense Questions
    23 Posts 6 Posters 3.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • JonathanLeeJ
      JonathanLee @adamw
      last edited by

      @adamw What port is used? You need to add that to safe ports in Squid.. I had issues with the college ports needed to be marked safe in Squid that was in use without them it failed any connections

      Make sure to upvote

      adamwA 1 Reply Last reply Reply Quote 0
      • adamwA
        adamw @JonathanLee
        last edited by

        @JonathanLee
        TCP 443 in both cases (aws s3 cp and Google Drive upload).

        JonathanLeeJ 1 Reply Last reply Reply Quote 0
        • JonathanLeeJ
          JonathanLee @adamw
          last edited by JonathanLee

          @adamw

          Is Squid set as Custom SSL MITM or Transparent or both??

          ee7ade31-5516-437f-8526-129d174800cb-image.png

          Some sites need to be splice only add this as a splice only

          I do this with advanced

          a70cf919-9ffe-4c71-adae-365c990e1e2f-image.png

          I have a regex splice file that has sites always set to splice

          daa37ff5-da56-47a3-8f63-9666b1ddc253-image.png

          Make sure to upvote

          adamwA 1 Reply Last reply Reply Quote 0
          • adamwA
            adamw @JonathanLee
            last edited by

            @JonathanLee

            My settings:

            squid_proxy_settings.png

            Making it bypass proxy has basically solved my problem but thanks for the suggestions.

            JonathanLeeJ 2 Replies Last reply Reply Quote 0
            • JonathanLeeJ
              JonathanLee @adamw
              last edited by

              @adamw @mcury I also bypass destination of my firewall IP that helped me with weird firewall logs showing up. I have my 192.168.1.1 as go to firewall rules

              Make sure to upvote

              M 1 Reply Last reply Reply Quote 0
              • JonathanLeeJ
                JonathanLee @adamw
                last edited by

                @adamw IP addresses that are set to already use the proxy don’t need to be transparent also because they know the proxy addresses already. That is what my bypass is so it doesn’t double them.

                Make sure to upvote

                1 Reply Last reply Reply Quote 0
                • M
                  mcury Rebel Alliance @JonathanLee
                  last edited by

                  @JonathanLee said in "aws s3 cp" crashes the firewall when using squid web proxy:

                  @adamw @mcury I also bypass destination of my firewall IP that helped me with weird firewall logs showing up. I have my 192.168.1.1 as go to firewall rules

                  If you are going to use transparent proxy for some users and explicit proxy for others, as I used to do back in my Squid days, the best way I found was :

                  Bypass Proxy for These Source IPs: Include all IPs that are going to use explicit proxy.
                  Bypass Proxy for These Destination IPs: Inlucde here all the local networks, advice would be to add 10.0.0.0/8;172.16.0.0/12;192.168.0.0/16

                  For users using explicit mode, do the same bypass but in the client settings (Browser and/or OS, or through the .pac file directly).

                  dead on arrival, nowhere to be found.

                  adamwA 1 Reply Last reply Reply Quote 1
                  • adamwA
                    adamw @mcury
                    last edited by

                    @mcury

                    Just a quick reminder that the thread is not about bypassing squid but about a sensible https request crashing the firewall requiring a power cycle :)

                    M 1 Reply Last reply Reply Quote 0
                    • M
                      mcury Rebel Alliance @adamw
                      last edited by

                      @adamw said in "aws s3 cp" crashes the firewall when using squid web proxy:

                      Just a quick reminder that the thread is not about bypassing squid but about a sensible https request crashing the firewall requiring a power cycle :)

                      Hm, unfortunately I can't help you with that.. I was a SG-3100 owner for almost 6 years, used Squid for a long long time and no crashes for me.
                      I would suggest you to try to a clean squid install, then go configuring little by little to find what is the trigger for the crash.

                      good luck!

                      dead on arrival, nowhere to be found.

                      1 Reply Last reply Reply Quote 0
                      • adamwA
                        adamw @marcosm
                        last edited by adamw

                        @marcosm

                        Is config exported from Netgate 3100 expected to work with Netgate 4100 out of the box?
                        I might be ok with exchanging one of our 3100 devices for 4100 and use the latter for further testing.

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          You'd have to reassign the interfaces but otherwise yes. If you have any complex VLAN/switch port setup in the 3100 that wouldn't apply in a 4100 of course.

                          1 Reply Last reply Reply Quote 0
                          • adamwA adamw referenced this topic on
                          • First post
                            Last post
                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.