Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Carp Failover not smooth....

    Scheduled Pinned Locked Moved HA/CARP/VIPs
    7 Posts 4 Posters 1.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K
      Kevin S Pare
      last edited by

      I have carp setup, states syncing etc.

      but when I do a traceroute to the natted IP, it hits the router ip first. so when I do a carp failover it doesn't use the states and it drops a few packets.

      So what am I missing here? at this point we stopped syncing states becuase there really isnt much point the failover works all the same.

      from an external machine, you can see the ip change for the hop just before, which is the wan interface of the router.

      I missing something but not sure what!

      S B 2 Replies Last reply Reply Quote 0
      • S
        SteveITS Galactic Empire @Kevin S Pare
        last edited by

        @Kevin-S-Pare A traceroute shows the router it talks to not the shared/CARP IP. Because that router answers.

        The states should sync. Do you have the same hardware and order in both?

        https://docs.netgate.com/pfsense/en/latest/troubleshooting/high-availability.html#state-synchronization-problems-pfsync

        Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
        When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
        Upvote 👍 helpful posts!

        K 1 Reply Last reply Reply Quote 0
        • K
          Kevin S Pare @SteveITS
          last edited by

          @SteveITS One router is a Netgate 8200, the other is a Netgate 6100.

          Makes no difference if I sync states or not when I ping the ip of the webserver, the packet loss is the same.
          Ironically, when I fail back, it comes back smoothly.

          Both routers are running 24.11

          We host alot of citrix connections and thats where we notice it most.

          1 Reply Last reply Reply Quote 0
          • B
            bp81 @Kevin S Pare
            last edited by bp81

            @Kevin-S-Pare said in Carp Failover not smooth....:

            I have carp setup, states syncing etc.

            but when I do a traceroute to the natted IP, it hits the router ip first. so when I do a carp failover it doesn't use the states and it drops a few packets.

            So what am I missing here? at this point we stopped syncing states becuase there really isnt much point the failover works all the same.

            from an external machine, you can see the ip change for the hop just before, which is the wan interface of the router.

            I missing something but not sure what!

            I'm a little unclear on your exact configuration here. Your first statement was when doing a traceroute (I assume you are doing this from a host outside the router's LAN network, ie, across an internet connection) you're seeing the packets go to the WAN address of the router (the WAN address, NOT the CARP address) then the final hop after the router's WAN address is to the CARP address. Is my perception here correct?

            @Kevin-S-Pare said in Carp Failover not smooth....:

            @SteveITS One router is a Netgate 8200, the other is a Netgate 6100.

            Makes no difference if I sync states or not when I ping the ip of the webserver, the packet loss is the same.
            Ironically, when I fail back, it comes back smoothly.

            Both routers are running 24.11

            We host alot of citrix connections and thats where we notice it most.

            Typically it is not recommended to run two different pieces of hardware in a CARP/HA cluster. Sometimes you can get away with it, sometimes you can't, and sometimes it kind of works but has issues.

            K 1 Reply Last reply Reply Quote 0
            • K
              Kevin S Pare @bp81
              last edited by

              @bp81 said in Carp Failover not smooth....:

              @Kevin-S-Pare said in Carp Failover not smooth....:

              I have carp setup, states syncing etc.

              but when I do a traceroute to the natted IP, it hits the router ip first. so when I do a carp failover it doesn't use the states and it drops a few packets.

              So what am I missing here? at this point we stopped syncing states becuase there really isnt much point the failover works all the same.

              from an external machine, you can see the ip change for the hop just before, which is the wan interface of the router.

              I missing something but not sure what!

              I'm a little unclear on your exact configuration here. Your first statement was when doing a traceroute (I assume you are doing this from a host outside the router's LAN network, ie, across an internet connection) you're seeing the packets go to the WAN address of the router (the WAN address, NOT the CARP address) then the final hop after the router's WAN address is to the CARP address. Is my perception here correct?

              @Kevin-S-Pare said in Carp Failover not smooth....:

              @SteveITS One router is a Netgate 8200, the other is a Netgate 6100.

              Makes no difference if I sync states or not when I ping the ip of the webserver, the packet loss is the same.
              Ironically, when I fail back, it comes back smoothly.

              Both routers are running 24.11

              We host alot of citrix connections and thats where we notice it most.

              Typically it is not recommended to run two different pieces of hardware in a CARP/HA cluster. Sometimes you can get away with it, sometimes you can't, and sometimes it kind of works but has issues.

              Its primarily two different network cards. but they are the same card. I've tested it with identical devices and the same issue happens.

              anyway, big picture, we walked away from this. in the event of a router failure we will have packet loss anyway and it will failover. the only advantage was to fail the router live during the day for maintenance. We really dont need to do this. the goal of a redundant router has been fulfilled. if we really need to do a firmware upgrade we can just failover at night when usage/imact is low. not a big deal.

              R 1 Reply Last reply Reply Quote 0
              • R
                RobertK 1 @Kevin S Pare
                last edited by

                @Kevin-S-Pare You might consider that in case of a failover event to BACKUP unit, the BACKUP unit's ARP cache table is basically empty. So if the states are synced that is great, you will not experience complete session breaks, because of the failover but the BACKUP unit needs a few secs to build up the ARP cache for the local IP/MAC pairs from the active sessions.

                K 1 Reply Last reply Reply Quote 0
                • K
                  Kevin S Pare @RobertK 1
                  last edited by

                  @RobertK-1 You know...I had not considered that, you may be right. either way. it doesnt switch smooth without some drop, so i've just accepted that, and it does work well as it is. I was just chasing the possibility if a fail over with no network loss..pretty hard.

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post
                  Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.