Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    new if_pppoe Backend - getting HA/CARP to work like in MPD

    Scheduled Pinned Locked Moved Development
    42 Posts 3 Posters 3.8k Views 4 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P Offline
      perrin @zjamali
      last edited by

      @zjamali Did you try a manual reconcile?
      Can you post the log output and your config?

      zjamaliZ 2 Replies Last reply Reply Quote 0
      • zjamaliZ Offline
        zjamali @perrin
        last edited by

        This post is deleted!
        1 Reply Last reply Reply Quote 0
        • zjamaliZ Offline
          zjamali @perrin
          last edited by zjamali

          @perrin as below the only log i have. i clicked the reconcile now button.

          06450cd0-5f10-4563-a1af-c5f7f754c933-image.png

          660df45e-cc52-4427-a8a6-599566b008ab-image.png

          adf66155-9568-4bb0-883a-883a9bede5b6-image.png

          P 1 Reply Last reply Reply Quote 0
          • P Offline
            perrin @zjamali
            last edited by

            @zjamali i suspect that i might have an old pkg in the github repo. can you please check the file pppoe_ha_even.php (in /usr/local/sbin) and check if the function reconcile_all (line 176ff) looks like this:

            function reconcile_all() {
                $rows = ppha_get_rows();
                if (!$rows){ ha_log("Reconcile: no mappings configured"); return; }
                ha_log("Running reconcile for all configured mappings");
                $vips = config_get_path('virtualip/vip', []);
                foreach ($rows as $row) {
                    if (empty($row['enabled']) || empty($row['vipref']) || empty($row['iface'])) continue;
                    $vip = $vips[$row['vipref']] ?? null;
                    if (!$vip || ($vip['mode'] ?? '')!=='carp') continue;
                    $vhid = (int)($vip['vhid'] ?? -1); if ($vhid<0) continue;
            
                    $state = get_carp_state_for_vhid($vhid) ?? 'INIT';
                    $friendly = (string)$row['iface'];
                    $real = real_ifname_for_friendly($friendly);
                    if (!$real){ ha_log("Reconcile: {$friendly} real if not found; skip"); continue; }
            
                    if ($state==='MASTER'){ ha_log("Reconcile: VHID {$vhid} MASTER - UP {$friendly} ({$real})"); iface_up($real); }
                    elseif ($state==='BACKUP'){ ha_log("Reconcile: VHID {$vhid} BACKUP - DOWN {$friendly} ({$real})"); iface_down($real); }
                    elseif ($state==='INIT'){ ha_log("Reconcile: VHID {$vhid} INIT - DOWN {$friendly} ({$real})"); iface_down($real); }
                    else { ha_log("Reconcile: VHID {$vhid} {$state} - no action"); }
                }
            }
            

            the script should log the set interface states (UP, DOWN) in the log - thats why I am wondering...

            zjamaliZ 1 Reply Last reply Reply Quote 0
            • zjamaliZ Offline
              zjamali @perrin
              last edited by

              @perrin i have compared with yours above, its match

              07a8f498-519d-4529-8c1b-831f7d5fea4e-image.png

              zjamaliZ 1 Reply Last reply Reply Quote 0
              • zjamaliZ Offline
                zjamali @zjamali
                last edited by zjamali

                seems like $rows not getting any value and not go into the foreach loop

                too soon, its already have the return for no mapping

                P 1 Reply Last reply Reply Quote 0
                • P Offline
                  perrin @zjamali
                  last edited by

                  @zjamali said in new if_pppoe Backend - getting HA/CARP to work like in MPD:

                  seems like $rows not getting any value and not go into the foreach loop

                  yes, this is what i am suspecting as well. can you check your config.xml and look for the <pppoeha> section. it should look something like this:

                   <pppoeha>
                                          <config>
                                                  <row>
                                                          <enabled>ON</enabled>
                                                          <iface>wan</iface>
                                                          <vipref>17</vipref>
                                                  </row>
                                          </config>
                                  </pppoeha>
                  
                  
                  zjamaliZ 1 Reply Last reply Reply Quote 0
                  • zjamaliZ Offline
                    zjamali @perrin
                    last edited by

                    @perrin said in new if_pppoe Backend - getting HA/CARP to work like in MPD:

                    yes, this is what i am suspecting as well. can you check your config.xml and look for the <pppoeha> section. it should look something like this:

                     <pppoeha>
                                            <config>
                                                    <row>
                                                            <enabled>ON</enabled>
                                                            <iface>wan</iface>
                                                            <vipref>17</vipref>
                                                    </row>
                                            </config>
                                    </pppoeha>
                    
                    

                    Where i can find this config.xml?

                    P 1 Reply Last reply Reply Quote 0
                    • P Offline
                      perrin @zjamali
                      last edited by

                      @zjamali ah sorry. you can either download a backup (under backup/restore) or directly on the box with ssh do something like:

                      grep -A10 pppoeha /conf/config.xml
                      
                      zjamaliZ 1 Reply Last reply Reply Quote 0
                      • zjamaliZ Offline
                        zjamali @perrin
                        last edited by

                        @perrin

                        8f2b1f12-3b3a-4c8c-b766-4c46b18e92d6-image.png

                        zjamaliZ 1 Reply Last reply Reply Quote 0
                        • zjamaliZ Offline
                          zjamali @zjamali
                          last edited by zjamali

                          said in new if_pppoe Backend - getting HA/CARP to work like in MPD:

                          @perrin

                          8f2b1f12-3b3a-4c8c-b766-4c46b18e92d6-image.png

                          is it because vipref == 0? my first vhid comes with id = 0

                          Yup, that cause it. i changed to VHID LAN, id != 0, its appear in log

                          b9192824-2109-4fc4-9669-2606abe34436-image.png

                          P 1 Reply Last reply Reply Quote 0
                          • P Offline
                            perrin @zjamali
                            last edited by

                            @zjamali great, thanks for figuring that out. I need to check why it's not working with vipref=0.

                            currently i have no idea why this happens. vipref 0 is just the first item in the vips. config_get_path is a standard pfsense function.

                            Maybe it is something with the way you configured that vip? is your first VIP configured differently ffrom the one you were using later?

                            zjamaliZ 1 Reply Last reply Reply Quote 0
                            • zjamaliZ Offline
                              zjamali @perrin
                              last edited by

                              @perrin Its the first vip configured in both pfsense node. So it gets id = 0.

                              P 1 Reply Last reply Reply Quote 0
                              • P Offline
                                perrin @zjamali
                                last edited by

                                @zjamali this is the way the dropdown in the PPPoE-HA GUI looks in my production firewall:

                                2115036b-f0fa-4528-a8e0-b08059022544-grafik.png
                                in my case VHID 18 is the one that is configured for failover.

                                Can you check if yours maybe starts with VHID 0?

                                zjamaliZ 1 Reply Last reply Reply Quote 0
                                • zjamaliZ Offline
                                  zjamali @perrin
                                  last edited by zjamali

                                  @perrin Mine also start with VHID 1 but if you go to Firewall -> Virtual IP, there is listing of all VIP, you hover on the edit button for first VHID, the url link will say its id=0

                                  id = 0 is for internal system id for record creation whilst VHID 1 is for user POV, if i am not mistaken.

                                  P 2 Replies Last reply Reply Quote 0
                                  • P Offline
                                    perrin @zjamali
                                    last edited by

                                    @zjamali yep, same here. I'll debug why it is not working on the first VIP later.
                                    Can you temporarely work with a different VIP?

                                    zjamaliZ 1 Reply Last reply Reply Quote 0
                                    • zjamaliZ Offline
                                      zjamali @perrin
                                      last edited by

                                      @perrin said in new if_pppoe Backend - getting HA/CARP to work like in MPD:

                                      @zjamali yep, same here. I'll debug why it is not working on the first VIP later.
                                      Can you temporarely work with a different VIP?

                                      Should be OK. no issue

                                      1 Reply Last reply Reply Quote 0
                                      • P Offline
                                        perrin @zjamali
                                        last edited by perrin

                                        @zjamali said in new if_pppoe Backend - getting HA/CARP to work like in MPD:

                                        @perrin Mine also start with VHID 1 but if you go to Firewall -> Virtual IP, there is listing of all VIP, you hover on the edit button for first VHID, the url link will say its id=0

                                        id = 0 is for internal system id for record creation whilst VHID 1 is for user POV, if i am not mistaken.

                                        I tried reproducing the behaviour by removing all carp VIPs from my test firewall and adding just a single new one so it gets "id=0". In my test VM the script behaved as expected:

                                        Sep 17 07:46:31 	pppoe-ha 	1464 	VHID 1 BACKUP -> DOWN wan (pppoe0)
                                        Sep 17 07:46:31 	pppoe-ha 	1464 	Handle CARP command for 1@vtnet0.510 - BACKUP 
                                        

                                        and

                                        Sep 17 07:46:35 	pppoe-ha 	52762 	VHID 1 MASTER -> UP wan (pppoe0)
                                        Sep 17 07:46:35 	pppoe-ha 	52762 	Handle CARP command for 1@vtnet0.510 - MASTER 
                                        

                                        so, there must be some differences in the config between your and my firewall.

                                        this is the Virtual IP definition in the my config XML:

                                        <vip>
                                        			<mode>carp</mode>
                                        			<interface>opt12</interface>
                                        			<vhid>1</vhid>
                                        			[remaining data ommited]
                                        </vip>
                                        

                                        so, in my case it starts with vhid = 1 instead of zero. can you confirm this in your installation?

                                        zjamaliZ 1 Reply Last reply Reply Quote 1
                                        • zjamaliZ Offline
                                          zjamali @perrin
                                          last edited by

                                          @perrin

                                          The record that i having the issue is this

                                          b0fb1eb6-070c-481c-bff5-e607d1f6631a-image.png

                                          Check if your opt12 with vhid 1, when you hover the edit button, id = 0. that causing the trouble when selected on the mapping. If i using other carp vip, it can reconcile

                                          P 1 Reply Last reply Reply Quote 0
                                          • P Offline
                                            perrin @zjamali
                                            last edited by

                                            @zjamali Yep, in my case my VHID18 is ID=0

                                            but in my case this VIP also works:

                                            Sep 17 08:08:42 	pppoe-ha 	41559 	VHID 18 MASTER -> UP wan (pppoe0)
                                            Sep 17 08:08:42 	pppoe-ha 	41559 	Handle CARP command for 18@vtnet0.510 - MASTER
                                            Sep 17 08:08:39 	pppoe-ha 	28341 	VHID 18 BACKUP -> DOWN wan (pppoe0)
                                            Sep 17 08:08:39 	pppoe-ha 	28341 	Handle CARP command for 18@vtnet0.510 - BACKUP 
                                            

                                            Can you please confirm that your VIP correctly switches from MASTER to BACKUP?
                                            Also your vhid 2 network overlaps with vhid 101 and vhid 3 with 102

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.