Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    CARP interfaces work separately

    Scheduled Pinned Locked Moved HA/CARP/VIPs
    ha carp
    16 Posts 3 Posters 1.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DerelictD
      Derelict LAYER 8 Netgate @Jakub_
      last edited by

      @jakub_ Take the secondary node out of maintenance mode and test again.

      There is pretty much no valid reason to ever put a secondary node in maintenance mode.

      Swing traffic from the primary to the secondary by putting the primary in maintenance mode.

      Swing it back by taking the primary out of maintenance mode.

      Chattanooga, Tennessee, USA
      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
      Do Not Chat For Help! NO_WAN_EGRESS(TM)

      Jakub_J 1 Reply Last reply Reply Quote 1
      • V
        viragomann @Jakub_
        last edited by viragomann

        @jakub_
        Seems that you have assigned the same IP to both nodes:
        inet xx.xx.xx.170 netmask 0xffffffff broadcast xx.xx.xx.170

        Possibly you used here accidentally IP alias type instead of CARP VIP.

        Jakub_J 1 Reply Last reply Reply Quote 1
        • Jakub_J
          Jakub_ @Derelict
          last edited by

          @derelict
          I just did it.
          Everything switched over correctly.
          Tomorrow when I'm in the server room I'll do a wire pull test and let you know what the results are.

          1 Reply Last reply Reply Quote 0
          • Jakub_J
            Jakub_ @viragomann
            last edited by

            @viragomann
            Yes you are right I corrected it, it should be CARP

            DerelictD 1 Reply Last reply Reply Quote 0
            • DerelictD
              Derelict LAYER 8 Netgate @Jakub_
              last edited by

              @jakub_ said in CARP interfaces work separately:

              @viragomann
              Yes you are right I corrected it, it should be CARP

              Or an IP alias with the interface set to the existing CARP VIP on the interface, not the interface itself.

              Chattanooga, Tennessee, USA
              A comprehensive network diagram is worth 10,000 words and 15 conference calls.
              DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
              Do Not Chat For Help! NO_WAN_EGRESS(TM)

              Jakub_J 2 Replies Last reply Reply Quote 0
              • Jakub_J
                Jakub_ @Derelict
                last edited by

                @derelict
                Ok, I did the tests everything switches correctly.
                I don't know how it happened that the maintenance mode was on.

                1 Reply Last reply Reply Quote 1
                • Jakub_J
                  Jakub_ @Derelict
                  last edited by

                  @derelict
                  This morning the problem returned.
                  First the first 7200U (master) traffic stalled , I put it in "CARP maitenence mode " the backup switched to the master but, the stalled master only half switched to the backup role (see pictures).
                  When I turned off "Maitenence mode" on this first 7200 on the second one only half returned to the backup role. The issue was fixed by turning CARPA off and on.
                  But it looks poor because HA should be reliable on this critical link.
                  I got screen shots and ifconfig's from both.
                  interfaces.png

                  V 1 Reply Last reply Reply Quote 0
                  • V
                    viragomann @Jakub_
                    last edited by

                    @jakub_
                    Something CARP relating in the system log?

                    The reason for interfaces in master state on both nodes is often that the secondary (with higher skew) doesn't get the advertisements from the master.
                    So ensure that the interfaces of both can communicate properly using the CARP protocol.

                    Jakub_J 1 Reply Last reply Reply Quote 0
                    • Jakub_J
                      Jakub_ @viragomann
                      last edited by

                      @viragomann
                      Not much :

                      Apr 19 08:27:00 Node1 sshguard[7411]: Now monitoring attacks.
                      Apr 19 08:39:30 Node1 php-fpm[94281]: /status_logs_filter.php: Successful login for user 'xxxxx' from: xx.xxx.xxx.10 (Local Database Fallback)
                      Apr 19 08:42:30 Node1 check_reload_status[392]: Syncing firewall
                      Apr 19 08:42:30 Node1 check_reload_status[392]: Carp backup event
                      Apr 19 08:42:30 Node1 kernel: carp: 1@ix0: MASTER -> BACKUP (more frequent advertisement received)
                      Apr 19 08:42:30 Node1 kernel: carp: 2@ix1: MASTER -> BACKUP (more frequent advertisement received)
                      Apr 19 08:42:30 Node1 kernel: in_scrubprefix: err=65, prefix delete failed
                      Apr 19 08:42:30 Node1 check_reload_status[392]: Carp backup event
                      Apr 19 08:42:36 Node1 check_reload_status[392]: Carp master event
                      Apr 19 08:42:36 Node1 kernel: carp: 2@ix1: BACKUP -> MASTER (master timed out)
                      Apr 19 08:43:00 Node1 sshguard[7411]: Exiting on signal.
                      Apr 19 08:43:00 Node1 sshguard[55540]: Now monitoring attacks.
                      Apr 19 08:44:00 Node1 sshguard[55540]: Exiting on signal.

                      forum.jpg

                      But the carp only worked after my intervention.

                      DerelictD 1 Reply Last reply Reply Quote 0
                      • DerelictD
                        Derelict LAYER 8 Netgate @Jakub_
                        last edited by

                        @jakub_ You have to figure out why the CARP heartbeats from the MASTER node are not making it to the secondary node.

                        pcap for CARP on that interface on the primary node. You should see advskew=0 heartbeats.

                        pcap for CARP on the secondary node. You should see those heartbeats. If you do not and see the heartbeats from the secondary (advskew=100) instead your Layer 2 is broken.

                        If the protocol is set for CARP on the pcap page it will properly decode the advbase/advskew so you can tell them apart. They will be from the same virtual MAC address so you can't tell by that.

                        Chattanooga, Tennessee, USA
                        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                        Do Not Chat For Help! NO_WAN_EGRESS(TM)

                        Jakub_J 2 Replies Last reply Reply Quote 0
                        • Jakub_J
                          Jakub_ @Derelict
                          last edited by Jakub_

                          This post is deleted!
                          1 Reply Last reply Reply Quote 0
                          • Jakub_J
                            Jakub_ @Derelict
                            last edited by Jakub_

                            @derelict

                            Hi again, I checked the vrrp packages :
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=2 advbase=1 advskew=100 authlen=7 counter=14661700377225625920
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=99 advbase=1 advskew=0 authlen=7 counter=316479634456754718
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=99 advbase=1 advskew=0 authlen=7 counter=316479634456754719
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=2 advbase=1 advskew=100 authlen=7 counter=14661700377225625921
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=99 advbase=1 advskew=0 authlen=7 counter=316479634456754720
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=2 advbase=1 advskew=100 authlen=7 counter=14661700377225625922
                            IP xx.xx.xx.3 > 224.0.0.18: CARPv2-advertise 36: vhid=99 advbase=1 advskew=0 authlen=7 counter=316479634456754721

                            I sorted out the vrrp and they look ok, my only doubt is the address xx.xx.xx.xx.3 is the physical interface of the master and not the CARP VIP. unless that is ok ?

                            DerelictD 1 Reply Last reply Reply Quote 0
                            • DerelictD
                              Derelict LAYER 8 Netgate @Jakub_
                              last edited by Derelict

                              @jakub_ Yes. The advertisements are sourced from the interface IP address and CARP MAC.

                              Not sure why you are seen advertisements from both the primary (advskew 0) and secondary (advskew 100) there.

                              Chattanooga, Tennessee, USA
                              A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                              DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                              Do Not Chat For Help! NO_WAN_EGRESS(TM)

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.