Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Strange behavior with gateway

    Scheduled Pinned Locked Moved Problems Installing or Upgrading pfSense Software
    25 Posts 3 Posters 333 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      dond @stephenw10
      last edited by

      @stephenw10

      I have 3 links.

      LINK1 - TIER1
      LINK2 - TIER2
      LINK3 - TIER3

      Then everything works. When we go to TIER3, it assumes it's STARLINK.

      I understand why external services break, and also, on Route, the default globe is TIER3, even though the other two links are working normally. So, I have to take down the STARLINK interface to get back to TIER1.

      stephenw10S 1 Reply Last reply Reply Quote 0
      • D
        dond @stephenw10
        last edited by

        @stephenw10

        Another thing I noticed is that if I define the Monirotin IP with 8.8.8.8 or 1.1.1.1 it gives a DPINGER error, so I even left the gateway itself and created a static route, the errors disappeared but this instability in the gateways returned.

        DNET_PPPOE 8.8.8.8: sendto error: 13
        Jul 24 17:22:44 dpinger 38309 DNET_PPPOE 8.8.8.8: sendto error: 13
        Jul 24 17:22:45 dpinger 38309 DNET_PPPOE 8.8.8.8: sendto error: 13
        Jul 24 17:22:45 dpinger 38309 DNET_PPPOE 8.8.8.8: sendto error: 13

        1 Reply Last reply Reply Quote 0
        • D
          dond @stephenw10
          last edited by

          @stephenw10

          How are you checking that? You see it in the gateway group status? - Yes

          Is the pfSense default IPv4 gateway set to the failover group? Or Automatic?
          failover group

          In automatic mode the default gateway will simply move to the next gateway if the existing one goes down.

          This pfSense works perfectly and has been running for over years. It started showing this after the upgrade.

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator @dond
            last edited by

            @dond said in Strange behavior with gateway:

            When we go to TIER3, it assumes it's STARLINK.

            Hmm, what exactly do you mean by that? How are you 'going to tier 3'?

            But importantly where are you using that gateway group? Is it set as the system default IPv4 gateway?

            Here?
            Screenshot from 2025-07-24 23-41-34.png

            D 1 Reply Last reply Reply Quote 0
            • D
              dond @stephenw10
              last edited by

              @stephenw10

              When I refer to tier 3, I mean the position of this link in the gateway group when configuring FailOver.

              I created the group and set the link to TIER 3.

              My default group is FailOver, the group of gateways I created.

              chpalmerC 1 Reply Last reply Reply Quote 0
              • chpalmerC
                chpalmer @dond
                last edited by

                @dond Some information that you might run into on yootoob is either outdated or just plain wrong in case you have referred to that service when originally setting your system up..

                This is my setting for comparison-

                failover.jpg

                What I do not know is how IPv6 affects this as I do not use it here.

                Triggering snowflakes one by one..
                Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                D 1 Reply Last reply Reply Quote 0
                • D
                  dond @chpalmer
                  last edited by dond

                  @chpalmer

                  6b8121ad-bc6b-4372-9603-1c1f5c877486-image.png

                  894f622d-6909-4b06-8fc3-adf6f7f1fef0-image.png

                  I removed STARLINK so as not to interrupt the night crew.

                  But if I enable it and put it in the gateway group, after a few minutes it becomes the default.

                  chpalmerC 1 Reply Last reply Reply Quote 0
                  • chpalmerC
                    chpalmer @dond
                    last edited by chpalmer

                    @dond and with that big Starlink outage today I can see why.. LOL.

                    I am trying to figure out what I can do to replicate your setup here..

                    (starlink outage is what Elon gets for insinuating that a robot could take over as a rollerskate wearing carhop waitress) x. com thing.. 🤣

                    Triggering snowflakes one by one..
                    Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                    D 1 Reply Last reply Reply Quote 0
                    • D
                      dond @chpalmer
                      last edited by

                      @chpalmer LOL...

                      In short, what happens is that if the starlink link is enabled, I don't know why pfsesnne assumes it as the main one even though it is not defined in the gateway group.

                      chpalmerC 1 Reply Last reply Reply Quote 0
                      • chpalmerC
                        chpalmer @dond
                        last edited by

                        @dond Im curious if it has to do with monitoring the addresses your first two links are in your first graphic. I know that in the past some have had issues using Googles IP there but cannot remember specifics.

                        Will your actual gateways answer to a ping? or are they to close in the scope of things to let it work?

                        Triggering snowflakes one by one..
                        Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                        D 1 Reply Last reply Reply Quote 0
                        • D
                          dond @chpalmer
                          last edited by

                          @chpalmer

                          5a11fbf7-a033-497e-a815-a53bda0dc9fb-image.png

                          In a way, yes.

                          What I expect is that when I define the gateway group, it will assume the tier I defined.

                          In IP Monitorin, I defined it this way and saw an error in my logs with dpinger.
                          Jul 24 18:29:19 dpinger 54194 DNET_PPPOE 8.8.8.8: sendto error: 13
                          Jul 24 18:29:20 dpinger 54194 DNET_PPPOE 8.8.8.8: sendto error: 13
                          Jul 24 18:29:20 dpinger 54194 DNET_PPPOE 8.8.8.8: sendto error: 13

                          chpalmerC 1 Reply Last reply Reply Quote 0
                          • chpalmerC
                            chpalmer @dond
                            last edited by

                            @dond Do you have the "Gateways" widget on your dashboard? Does it show any loss to any of the gateways?

                            Here since my secondary is just that I simply use the actual modem address to monitor which will never go down unless it loses power just because I expect that my tier1 gateway will take back over when it comes back up and it always does.

                            Should be true on the highest numerical tier (in your case) 3.. you should not have to ping very far out at all if it is working correctly.

                            Just trying to rule things out.. and thinking out loud.

                            Triggering snowflakes one by one..
                            Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                            D 1 Reply Last reply Reply Quote 0
                            • D
                              dond @chpalmer
                              last edited by

                              @chpalmer

                              c5a7e96d-a685-4507-93cf-dab57ac1fd3d-image.png

                              This is what is strangest in my dashboard, the two normal likes visually

                              chpalmerC 1 Reply Last reply Reply Quote 0
                              • chpalmerC
                                chpalmer @dond
                                last edited by

                                @dond

                                widget.jpg

                                Set your weight for all of them to one. See if that does not work...

                                Triggering snowflakes one by one..
                                Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                D 1 Reply Last reply Reply Quote 0
                                • D
                                  dond @chpalmer
                                  last edited by

                                  @chpalmer said in Strange behavior with gateway:

                                  Set your weight for all of them to one. See if that does not work...

                                  By default it was 1, I changed it in an attempt to fix this, but I'm back now.

                                  I'm waiting for the staff to finalize the billing. I'll leave everything as it was and do a new check. I'll highlight everything and come back here.

                                  chpalmerC 1 Reply Last reply Reply Quote 1
                                  • chpalmerC
                                    chpalmer @dond
                                    last edited by

                                    @dond

                                    Good luck. Be monitoring from the sidelines.

                                    Triggering snowflakes one by one..
                                    Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      Hmm, if you set the default to the failover group it should show the tiers in the gateway list like:
                                      Screenshot from 2025-07-25 01-08-54.png

                                      Your screenshot above doesn't show that.

                                      When starlink becomes the default do the other two gateways still show on-line as expected? Or is something actually breaking the other two gateways somehow?

                                      chpalmerC D 2 Replies Last reply Reply Quote 0
                                      • chpalmerC
                                        chpalmer @stephenw10
                                        last edited by

                                        @stephenw10 https://forum.netgate.com/post/1221361

                                        ???

                                        Triggering snowflakes one by one..
                                        Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                        stephenw10S 1 Reply Last reply Reply Quote 0
                                        • D
                                          dond @stephenw10
                                          last edited by

                                          @stephenw10 said in Strange behavior with gateway:

                                          When starlink becomes the default do the other two gateways still show on-line as expected? Or is something actually breaking the other two gateways somehow?

                                          Reply

                                          It remains online, then I take down the starlink and then the main one comes back on.

                                          1 Reply Last reply Reply Quote 0
                                          • stephenw10S
                                            stephenw10 Netgate Administrator
                                            last edited by

                                            What's shown in the logs when it switches the default to Starlink?

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.