Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Limiter source mask now after NAT when using gateway groups - 2.8 change?

    Scheduled Pinned Locked Moved Traffic Shaping
    14 Posts 3 Posters 2.9k Views 5 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • G Offline
      gemg83 @gemg83
      last edited by gemg83

      I was testing versions 2.6.0, 2.7.0, 2.7.1, 2.7.2, and 2.8.0 on new virtual machine with the same network configuration of the image.

      In version 2.6.0, the limiters worked fine when applied to any WAN. In versions 2.7.0, 2.7.1, 2.7.2, and 2.8.0, the limiters use the post-NAT IP address. This divides the bandwidth and doesn't limit each connection from the LAN to upload.

      The rules were never modified between versions.

      limiter on 2.6.0 not default gateway
      d3fa6587-8bb9-426b-89e3-e54dba96bfdd-image.png

      limiter on 2.7.x to 2.8.0 not default gateway
      5eab5b89-402f-4af9-a67c-4bc620d2544b-image.png

      It is not clear to me if the problem is the version of pfsense or freeBSD and the PF package

      b2c0c7ce-fb55-4d8d-ba17-0531d0be9358-image.png

      K 2 Replies Last reply Reply Quote 0
      • G gemg83 referenced this topic on
      • K Offline
        Konan 0 @gemg83
        last edited by

        @gemg83 Hi,

        I'm afraid I'm no further with it. Honestly, I'm starting to wonder about the state of PFSense. That or I've massively misunderstood how they deal with feedback and bugs (or the right place to go).

        I added a description to this bug as it sounds to be the same thing:

        https://redmine.pfsense.org/issues/15770

        I've had a bug that's similar open (although much more niche, it's how the limiters apply when going through an OpenVPN based interface) for a year with no response.

        If you look in the limiters section of their issue tracker, there's confirmed bugs 11 years old there and 'new' issues that are now 7 years old.

        1 Reply Last reply Reply Quote 0
        • K Offline
          Konan 0 @gemg83
          last edited by

          @gemg83 I see what you're saying - it could be the jump from 12.3 to 14 on the BSD side.

          It really hampers the use of limiters in multi-WAN setups so it feels like an important bug (I call it a bug as it doesn't behave at all how the UI or documentation suggests, it's more like using them on a floating rule).

          1 Reply Last reply Reply Quote 0
          • K Konan 0 referenced this topic on
          • stephenw10S stephenw10 referenced this topic on
          • stephenw10S Online
            stephenw10 Netgate Administrator
            last edited by

            On the bug report the reporter claims it works correctly in 2.7.1 but doesn't show which version they thought was affected.

            However the 2.7.2 release was specifically to address a regression in the route-to behaviour that would be used by this. So I could believe it was that.

            But you are now also seeing the issue in 2.7.0 and 2.7.1?

            G K 2 Replies Last reply Reply Quote 0
            • G Offline
              gemg83 @stephenw10
              last edited by gemg83

              @stephenw10 , In versions 2.7.x and 2.8, the problem with limiters on a WAN that isn't the default route occurs. The last version that worked correctly was 2.6.0.

              The evidence and tests performed in each version are documented. Thank you very much and I hope you can validate from version 2.7.x onwards that the limiters no longer work in a WAN that is not the default .

              thanks.

              In 2.6.0 the limiter uses the private IP as source and destination, to control the BW for each IP

              In 2.8 and 2.7.x the limiter uses the public IP as the source and the private IP as the destination, that is, for the upload it uses the public IP after applying NAT, this does not limit each connection from the LAN, it limits the entire bandwidth

              3031a675-6d14-4702-98be-a788da8e8744-image.png

              1 Reply Last reply Reply Quote 0
              • K Offline
                Konan 0 @stephenw10
                last edited by

                @stephenw10 I'm happy to configure this is a virtual and step through versions to find out where the behavior change happens, if it helps. Sounds like @gemg83 has got it dialed down though.

                1 Reply Last reply Reply Quote 0
                • stephenw10S Online
                  stephenw10 Netgate Administrator
                  last edited by

                  Yup I just to replicate it here.

                  G 1 Reply Last reply Reply Quote 0
                  • G Offline
                    gemg83 @stephenw10
                    last edited by gemg83

                    @stephenw10 Please tell us what other information you need. I still have the test firewall with snapshots in versions 2.6.0, 2.7.x, and 2.8.0. If I can help with more information, please count on me.

                    I think the test cases are well documented with all the evidence in this chain, but I'll be on the lookout if I can help with anything else. Thanks.

                    1 Reply Last reply Reply Quote 1
                    • stephenw10S Online
                      stephenw10 Netgate Administrator
                      last edited by

                      OK we replicated this and are digging...

                      1 Reply Last reply Reply Quote 0
                      • K Offline
                        Konan 0
                        last edited by

                        I'm not sure if it's helpful or not to link these two - but I've also noticed that if sticky connections are enabled, the source tracking table remains empty. Which I think is described here:

                        https://forum.netgate.com/topic/197911/pfsense-2-8-0-sticky-connections-in-dual-wan-setup-not-maintaining-source-tracking

                        I felt it worth a mention as it relates to gateway groups and source IPs, but I don't know if they use the same mechanism underneath (the above post also appears to be linked to 2.8, where it appears this one was also present in 2.7.x).

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S Online
                          stephenw10 Netgate Administrator
                          last edited by

                          I don't believe it is the same root cause. That is fixed in 2.8.1-beta. https://redmine.pfsense.org/issues/16282

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.