Carp switching from primary to secondary
-
We have a carp setup with several VIPs.
The sync interface is on its own nic with a direct connect cable to the secondary.A few times now the secondary became the master.
I was logged into the primary via the carp IP at the time.How to do I troubleshoot this kind of thing?
WAN is igb2
HA sync is igb0this from the system log on primary.
Dec 16 16:12:29 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:12:29 kernel: igb0: link state changed to UP
Dec 16 16:12:29 check_reload_status: Linkup starting igb0
Dec 16 16:12:27 check_reload_status: Linkup starting igb0
Dec 16 16:12:27 kernel: igb0: link state changed to DOWN
Dec 16 16:11:49 check_reload_status: Reloading filter
Dec 16 16:11:49 php: rc.newwanip: rc.newwanip: on (IP address: 10.150.0.10) (interface: HA_SYNC[opt1]) (real interface: igb0).
Dec 16 16:11:49 php: rc.newwanip: rc.newwanip: Informational is starting igb0.
Dec 16 16:11:47 check_reload_status: rc.newwanip starting igb0
Dec 16 16:11:47 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:11:45 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:11:45 kernel: igb0: link state changed to UP
Dec 16 16:11:45 check_reload_status: Linkup starting igb0
Dec 16 16:11:43 check_reload_status: Linkup starting igb0
Dec 16 16:11:43 kernel: igb0: link state changed to DOWN
Dec 16 16:11:20 check_reload_status: Reloading filter
Dec 16 16:11:20 php: rc.newwanip: rc.newwanip: on (IP address: 10.150.0.10) (interface: HA_SYNC[opt1]) (real interface: igb0).
Dec 16 16:11:20 php: rc.newwanip: rc.newwanip: Informational is starting igb0.
Dec 16 16:11:17 check_reload_status: rc.newwanip starting igb0
Dec 16 16:11:17 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:11:15 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:11:15 kernel: igb0: link state changed to UP
Dec 16 16:11:15 check_reload_status: Linkup starting igb0
Dec 16 16:11:13 check_reload_status: Linkup starting igb0
Dec 16 16:11:13 kernel: igb0: link state changed to DOWN
Dec 16 16:11:02 php: /index.php: Successful login for user 'admin' from: 70.140.50.63
Dec 16 16:11:02 php: /index.php: Successful login for user 'admin' from: 70.140.50.63
Dec 16 16:10:53 check_reload_status: Reloading filter
Dec 16 16:10:53 php: rc.newwanip: rc.newwanip: on (IP address: 10.150.0.10) (interface: HA_SYNC[opt1]) (real interface: igb0).
Dec 16 16:10:53 php: rc.newwanip: rc.newwanip: Informational is starting igb0.
Dec 16 16:10:50 check_reload_status: rc.newwanip starting igb0
Dec 16 16:10:50 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:10:48 php: rc.linkup: Hotplug event detected for HA_SYNC(opt1) but ignoring since interface is configured with static IP (10.150.0.10 )
Dec 16 16:10:48 kernel: igb0: link state changed to UP
Dec 16 16:10:48 check_reload_status: Linkup starting igb0
Dec 16 16:10:46 kernel: igb0: link state changed to DOWN
Dec 16 16:10:46 check_reload_status: Linkup starting igb0
Dec 16 16:09:45 php: /index.php: Successful login for user 'admin' from: 70.140.50.63
Dec 16 16:09:45 php: /index.php: Successful login for user 'admin' from: 70.140.50.63
Dec 16 16:09:44 php: /index.php: Successful login for user 'admin' from: 74.95.151.93
Dec 16 16:09:44 php: /index.php: Successful login for user 'admin' from: 74.95.151.93
Dec 16 16:05:03 php: /index.php: Successful login for user 'admin' from: 70.140.50.63
Dec 16 16:05:03 php: /index.php: Successful login for user 'admin' from: 70.140.50.63
Dec 16 15:46:53 php: rc.filter_synchronize: Filter sync successfully completed with https://10.150.0.11:443.
Dec 16 15:46:51 php: rc.filter_synchronize: XMLRPC sync successfully completed with https://10.150.0.11:443.
Dec 16 15:46:50 check_reload_status: Reloading filter
Dec 16 15:46:50 php: rc.filter_synchronize: Beginning XMLRPC sync to https://10.150.0.11:443.
Dec 16 15:46:49 php: /firewall_virtual_ip_edit.php: End of portal.pfsense.org configuration backup (success).
Dec 16 15:46:47 php: /firewall_virtual_ip_edit.php: Beginning https://portal.pfsense.org configuration backup.
Dec 16 15:46:47 check_reload_status: Syncing firewall
Dec 16 15:44:02 php: rc.filter_synchronize: Filter sync successfully completed with https://10.150.0.11:443.
Dec 16 15:44:00 php: rc.filter_synchronize: XMLRPC sync successfully completed with https://10.150.0.11:443.
Dec 16 15:43:58 php: rc.filter_synchronize: Beginning XMLRPC sync to https://10.150.0.11:443.
Dec 16 15:43:57 php: /firewall_virtual_ip.php: End of portal.pfsense.org configuration backup (success).
Dec 16 15:43:56 php: /firewall_virtual_ip.php: Beginning https://portal.pfsense.org configuration backup.
Dec 16 15:43:56 check_reload_status: Syncing firewall
Dec 16 15:43:29 php: rc.filter_synchronize: Filter sync successfully completed with https://10.150.0.11:443.
Dec 16 15:43:26 php: rc.filter_synchronize: XMLRPC sync successfully completed with https://10.150.0.11:443.
Dec 16 15:43:25 check_reload_status: Reloading filter
Dec 16 15:43:25 php: rc.filter_synchronize: Beginning XMLRPC sync to https://10.150.0.11:443.
Dec 16 15:43:24 php: /firewall_virtual_ip_edit.php: End of portal.pfsense.org configuration backup (success).
Dec 16 15:43:23 php: /firewall_virtual_ip_edit.php: Beginning https://portal.pfsense.org configuration backup.
Dec 16 15:43:23 check_reload_status: Syncing firewall
Dec 16 12:05:55 php: rc.filter_synchronize: Filter sync successfully completed with https://10.150.0.11:443.
Dec 16 12:05:53 php: rc.filter_synchronize: XMLRPC sync successfully completed with https://10.150.0.11:443.
Dec 16 12:05:51 php: rc.filter_synchronize: Beginning XMLRPC sync to https://10.150.0.11:443.
Dec 16 12:05:50 php: snort_check_for_rule_updates.php: End of portal.pfsense.org configuration backup (success).
Dec 16 12:05:49 php: snort_check_for_rule_updates.php: Beginning https://portal.pfsense.org configuration backup.
Dec 16 12:05:49 check_reload_status: Syncing firewall -
No suggestions?
It cant be network traffic on Sync interface since its a direct connect.
Not sure where to look and how to fix this.
What the correct procedure to swing the interface back to primary?
Last time I just rebooted the secondary but it seems a bit crude.