Gateway flipping many times per second on multi-WAN (after manual change)
-
I am on triple-WAN with failover: cable -> DSL -> cell modem. Cable had some intermittent packet loss, disconnects. pfSense was failing over to DSL and back every few minutes. I got sick of it and went to the Gateway Group setup and assigned Tier 1 (was 2) to DSL and Tier 2 (was 1) to cable WAN. After I pressed Save and Apply Changes the interface kind of froze - the page was not going anywhere, the server was not responding. I waited and waited, went to Dashboard, it also took a long while to load. I went to check logs and found the the system log was completely full of gateway flipping entries, several times per second. See below.
Aug 4 18:51:00 php-fpm 202 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:51:00 php-fpm 202 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:51:00 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:51:00 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:51:00 php-fpm 202 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:51:00 php-fpm 202 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:51:00 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:51:00 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:51:00 php-fpm 454 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:51:00 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 454 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 94796 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:59 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:59 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:59 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:59 php-fpm 98601 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:59 php-fpm 48340 /rc.dyndns.update: phpDynDNS (): (Success) IP Address Updated Successfully! Aug 4 18:50:59 php-fpm 48340 /rc.dyndns.update: phpDynDNS: updating cache file /conf/dyndns_PreferWANcustom''2.cache: x.x.x.x [WAN_DHCP IP] Aug 4 18:50:59 php-fpm 89297 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:58 php-fpm 73902 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:58 php-fpm 775 /rc.dyndns.update: phpDynDNS (): (Success) IP Address Updated Successfully! Aug 4 18:50:58 php-fpm 775 /rc.dyndns.update: phpDynDNS: updating cache file /conf/dyndns_PreferWANcustom''0.cache: y.y.y.y [WAN2_PPPOE IP] Aug 4 18:50:58 php-fpm 202 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:58 php-fpm 454 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:58 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:58 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:58 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:58 php-fpm 454 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:58 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:58 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default. Aug 4 18:50:57 php-fpm 94796 /rc.dyndns.update: Gateway, switch to: WAN_DHCP Aug 4 18:50:57 php-fpm 48340 /rc.dyndns.update: phpDynDNS (): (Success) IP Address Updated Successfully! Aug 4 18:50:57 php-fpm 48340 /rc.dyndns.update: phpDynDNS: updating cache file /conf/dyndns_PreferWANcustom''1.cache: x.x.x.x [this is the WAN_DHCP IP, not WAN2_PPPOE] Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Default gateway setting Interface WAN2_PPPOE Gateway as default. Aug 4 18:50:57 php-fpm 775 /rc.dyndns.update: Gateway, switch to: WAN2_PPPOE Aug 4 18:50:57 php-fpm 98601 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:57 php-fpm 89297 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:56 php-fpm 73902 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:56 php-fpm 202 /rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 15 days has not passed. Not updating dynamic DNS entry. Aug 4 18:50:56 php-fpm 202 /rc.dyndns.update: Default gateway setting Interface WAN_DHCP Gateway as default.
The third gateway was not affected.
I wonder if the developers look here. Along with the previous unexplained issue with multi-WAN: No dpinger session running for gateway - for no reason when switching WANs it looks like something is not right with the multi-WAN failover.
This is the first time such thing happened. When the sporadic packet loss on cable stopped I switched the cable WAN to Tier 1 without issues. A few hours later I rebooted pfSense in hopes it won't happen again. So, far so good but I haven't tried changing gateways since. I am on Plus 22.05.