Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    WAN interfaces flapping with multiWAN

    Scheduled Pinned Locked Moved 1.2.1-RC Snapshot Feedback and Problems-RETIRED
    43 Posts 9 Posters 36.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      cmb
      last edited by

      I'm sure they're all at default hz. Changing that isn't a solution regardless.

      We'll get a resolution to this eventually, if it's an immediate problem for you, you'll have to downgrade to 1.2. This isn't going to be easy or quick to resolve.

      1 Reply Last reply Reply Quote 0
      • F
        familyguy
        last edited by

        @cmb:

        I'm sure they're all at default hz. Changing that isn't a solution regardless.

        We'll get a resolution to this eventually, if it's an immediate problem for you, you'll have to downgrade to 1.2. This isn't going to be easy or quick to resolve.

        OK.  I think downgrading looks like the path of least resistance.  The complaining from folks with frequently dropped connections at the office is getting rather shrill.  Looking forward to an eventual fix.

        Best,

        1 Reply Last reply Reply Quote 0
        • C
          cheesyboofs
          last edited by

          For what its worth I was seeing this too and have also downgraded to 1.2-Release. Its a shame, as I hate going backwards. You need a firewall to be reliable and stable and its hard to test a new beta without putting it in 'service'.

          Author of pfSense themes:

          DARK-ORANGE

          CODE-RED

          1 Reply Last reply Reply Quote 0
          • E
            eri--
            last edited by

            The latest snapshots have a fix for this can you, if possible, test and report if it behaves correctly now.

            1 Reply Last reply Reply Quote 0
            • F
              familyguy
              last edited by

              @ermal:

              The latest snapshots have a fix for this can you, if possible, test and report if it behaves correctly now.

              I'll give it a try next time I'm on site.  What was the nature of the fix?

              Best,

              1 Reply Last reply Reply Quote 0
              • C
                cmb
                last edited by

                slbd used to use fping to determine if a WAN was online. There is some kernel change in FreeBSD 7.0 that causes problems because fping sees replies from pings initiated by other processes.  Usually RRD for quality graph and slbd for monitor IP are both pinging the gateway IPs on your WAN (the fact that two processes are pinging the same thing is something we're eliminating in 1.3, but is too significant a change to pull into a maintenance release).

                Now, slbd runs a shell script (for easy changing and testing, because the process being run is hard coded into the slbd binary) which runs FreeBSD's ping. It knows which replies are supposed to go where, and should behave properly unlike fping. The ping in FreeBSD 7.0 supports everything we were doing with fping. This should hopefully be resolved now.

                1 Reply Last reply Reply Quote 0
                • N
                  NickC
                  last edited by

                  Confirm flapping stopped. Thanks for the fix.

                  Nick.

                  1 Reply Last reply Reply Quote 0
                  • E
                    eri--
                    last edited by

                    Can you test that it behaves propperly if you disconnect one of the wans even in failover or loadbalance?
                    This would help pushing the 1.2.1 release.

                    1 Reply Last reply Reply Quote 0
                    • N
                      NickC
                      last edited by

                      I'm running multiple failover (not balance) multi-WAN on a CARP cluster.
                      Watching syslog messages as they come through I unplugged the phone line so the ping would fail but leave interfaces up.

                      It took 30s for a the message to come through:
                      "ICMP poll failed…marking service DOWN"

                      Plugged back in and "marking service as UP"

                      I don't know how long it took before but I think it was a little more responsive than this. If you think I'm just seeing a delay in the syslog pathway I can time it a more carefully using the logs.

                      Nick.

                      1 Reply Last reply Reply Quote 0
                      • E
                        eri--
                        last edited by

                        Nothing has changed in that way apart the good thing that it is working now.
                        If you wish /usr/local/sbin/slbd.sh has the command to check the status. As far as i am conerned you may replace it with anything you please just return the status.

                        Maybe worth confirming that it is the syslog latency though 30sec are not that bad too :P.

                        1 Reply Last reply Reply Quote 0
                        • C
                          cwadge
                          last edited by

                          I'm discovering that on the latest nightly of 1.2.1rc1, the interface does get marked down after a few seconds. But unfortunately, the failover never actually takes places. If the interface goes down, it's simply down until you bring it back up. The downed network never falls back to the other gateway.

                          1 Reply Last reply Reply Quote 0
                          • C
                            cwadge
                            last edited by

                            @cwadge:

                            I'm discovering that on the latest nightly of 1.2.1rc1, the interface does get marked down after a few seconds. But unfortunately, the failover never actually takes places. If the interface goes down, it's simply down until you bring it back up. The downed network never falls back to the other gateway.

                            Ahhh, please disregard this. After some further troubleshooting, it turned out that the core router I was using to gauge uptime for that interface could be reached through either interface.

                            However, that does bring up two interesting points.

                            • It took about 1 minute for the connection to completely fail over. The hardware is a dual 600MHz P3 with 384mb RAM, but it seems to be the loadbalancer that's taking so long to recognize that it's down, not the filter reload afterwords.

                            • In this situation, I can only assume (until I dig a little deeper) that the PFSense box automatically started pinging the other gateway's core router through the gateway that was up. I'm not sure if this is considered a bug or just an undesirable feature… but ultimately, what's the difference?

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.