Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    WAN Link Down causes pfSense to stop responding on LAN?

    Scheduled Pinned Locked Moved General pfSense Questions
    14 Posts 6 Posters 1.7k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • J
      jhg
      last edited by

      My ISP suffered a minor hiccup (hiccough for brits/aussies :-) and the WAN connection went down for a couple of minutes. AFAICT the modem (Hitron CODA56) didn't reboot. When that happened, pfSense stopped responding to LAN IP traffic (DNS, HTTP, etc), even by IP address, but was still responding to ICMP. Direct console access was unimpaired.

      Rebooting pfSense fixed the problem.

      Below is the is an extract of /var/log./system.log, with comments interspersed. I'm wondering if this is a known issue.

      Feb 14 00:41:00 janus sshguard[5815]: Exiting on signal.
      Feb 14 00:41:00 janus sshguard[89127]: Now monitoring attacks.
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS: updatedns() starting
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS custom (): _checkIP() starting.
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS custom (): [redacted].195.22 extracted from local system.
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS (): running get_failover_interface for wan. found re1
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS custom (): _detectChange() starting.
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS custom (): _checkIP() starting.
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic DNS custom (): [redacted].195.22 extracted from local system.
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: Dynamic Dns (): Current WAN IP: [redacted].195.22 Cached IP: [redacted].195.22
      Feb 14 01:01:01 janus php-cgi[61185]: rc.dyndns.update: phpDynDNS (): No change in my IP address and/or 25 days has not passed. Not updating dynamic DNS entry.
      Feb 14 03:16:00 janus sshguard[89127]: Exiting on signal.
      Feb 14 03:16:00 janus sshguard[32500]: Now monitoring attacks.
      Feb 14 05:30:00 janus sshguard[32500]: Exiting on signal.
      Feb 14 05:30:00 janus sshguard[93838]: Now monitoring attacks.
      
      === WAN link down at this point
      
      Feb 14 10:37:44 janus kernel: re1: watchdog timeout
      Feb 14 10:37:44 janus kernel: re1: link state changed to DOWN
      Feb 14 10:37:44 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:37:45 janus php-fpm[28472]: /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp, 6: dhcp6)
      Feb 14 10:37:45 janus php-fpm[28472]: /rc.linkup: DEVD Ethernet detached event for wan
      Feb 14 10:37:47 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:37:47 janus kernel: re1: link state changed to UP
      Feb 14 10:37:49 janus rc.gateway_alarm[59065]: >>> Gateway alarm: WAN_DHCP (Addr:[redacted].192.1 Alarm:down RTT:0ms RTTsd:0ms Loss:100%)
      Feb 14 10:37:49 janus check_reload_status[431]: updating dyndns WAN_DHCP
      Feb 14 10:37:49 janus check_reload_status[431]: Restarting IPsec tunnels
      Feb 14 10:37:49 janus check_reload_status[431]: Restarting OpenVPN tunnels/interfaces
      Feb 14 10:37:49 janus check_reload_status[431]: Reloading filter
      Feb 14 10:37:49 janus rc.gateway_alarm[59538]: >>> Gateway alarm: WAN_DHCP6 (Addr:fe80::21c:73ff:fe00:99%re1 Alarm:down RTT:0ms RTTsd:0ms Loss:100%)
      Feb 14 10:37:49 janus check_reload_status[431]: updating dyndns WAN_DHCP6
      Feb 14 10:37:49 janus check_reload_status[431]: Restarting IPsec tunnels
      Feb 14 10:37:49 janus check_reload_status[431]: Restarting OpenVPN tunnels/interfaces
      Feb 14 10:37:49 janus check_reload_status[431]: Reloading filter
      Feb 14 10:37:50 janus php-fpm[17998]: /rc.openvpn: Gateway, NONE AVAILABLE
      Feb 14 10:37:50 janus php-fpm[19256]: /rc.dyndns.update: Dynamic DNS: updatedns() starting
      Feb 14 10:37:50 janus php-fpm[19256]: /rc.dyndns.update: Dynamic DNS custom (): _checkIP() starting.
      Feb 14 10:37:50 janus php-fpm[19256]: /rc.dyndns.update: Dynamic DNS custom (): IP address could not be extracted from Check IP Service
      Feb 14 10:37:50 janus php-fpm[19256]: /rc.dyndns.update: Dynamic DNS (): running get_failover_interface for wan. found re1
      Feb 14 10:37:50 janus php-fpm[19256]: /rc.dyndns.update: Dynamic DNS () There was an error trying to determine the public IP for interface - wan (re1 ).
      Feb 14 10:37:51 janus dhcpleases[27274]: Could not deliver signal HUP to process 80107: No such process.
      Feb 14 10:37:53 janus kernel: re1: watchdog timeout
      Feb 14 10:37:53 janus kernel: re1: link state changed to DOWN
      Feb 14 10:37:53 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:37:55 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:37:55 janus kernel: re1: link state changed to UP
      Feb 14 10:37:56 janus check_reload_status[431]: Reloading filter
      Feb 14 10:37:56 janus php-fpm[47560]: /rc.linkup: Hotplug event detected for WAN(wan) dynamic IP address (4: dhcp, 6: dhcp6)
      Feb 14 10:37:56 janus php-fpm[47560]: /rc.linkup: DEVD Ethernet attached event for wan
      Feb 14 10:37:56 janus php-fpm[47560]: /rc.linkup: HOTPLUG: Configuring interface wan
      Feb 14 10:38:04 janus kernel: re1: watchdog timeout
      Feb 14 10:38:04 janus kernel: re1: link state changed to DOWN
      Feb 14 10:38:04 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:38:07 janus kernel: re1: link state changed to UP
      Feb 14 10:38:07 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:38:19 janus kernel: re1: watchdog timeout
      Feb 14 10:38:19 janus kernel: re1: link state changed to DOWN
      Feb 14 10:38:19 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:38:22 janus kernel: re1: link state changed to UP
      Feb 14 10:38:22 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:38:59 janus kernel: re1: watchdog timeout
      Feb 14 10:38:59 janus kernel: re1: link state changed to DOWN
      Feb 14 10:38:59 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:39:02 janus kernel: re1: link state changed to UP
      Feb 14 10:39:02 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:39:25 janus kernel: re1: watchdog timeout
      Feb 14 10:39:25 janus kernel: re1: link state changed to DOWN
      Feb 14 10:39:25 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:39:28 janus kernel: re1: link state changed to UP
      Feb 14 10:39:28 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:39:47 janus kernel: re1: watchdog timeout
      Feb 14 10:39:47 janus kernel: re1: link state changed to DOWN
      Feb 14 10:39:47 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:39:50 janus kernel: re1: link state changed to UP
      Feb 14 10:39:50 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:40:01 janus kernel: re1: watchdog timeout
      Feb 14 10:40:01 janus kernel: re1: link state changed to DOWN
      Feb 14 10:40:01 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:40:04 janus kernel: re1: link state changed to UP
      Feb 14 10:40:04 janus check_reload_status[431]: Linkup starting re1
      
      === At some point here, attempts to access the pfSense web UI and SSH time out
      === but pfSense is still responding to ping
      
      Feb 14 10:41:08 janus kernel: re1: watchdog timeout
      Feb 14 10:41:08 janus kernel: re1: link state changed to DOWN
      Feb 14 10:41:08 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:41:11 janus kernel: re1: link state changed to UP
      Feb 14 10:41:11 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:42:07 janus kernel: re1: watchdog timeout
      Feb 14 10:42:07 janus kernel: re1: link state changed to DOWN
      Feb 14 10:42:07 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:42:10 janus kernel: re1: link state changed to UP
      Feb 14 10:42:10 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:42:41 janus kernel: re1: watchdog timeout
      Feb 14 10:42:41 janus kernel: re1: link state changed to DOWN
      Feb 14 10:42:41 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:42:45 janus kernel: re1: link state changed to UP
      Feb 14 10:42:45 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:43:17 janus kernel: re1: watchdog timeout
      Feb 14 10:43:17 janus kernel: re1: link state changed to DOWN
      Feb 14 10:43:17 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:43:20 janus kernel: re1: link state changed to UP
      Feb 14 10:43:20 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:43:36 janus kernel: re1: watchdog timeout
      Feb 14 10:43:36 janus kernel: re1: link state changed to DOWN
      Feb 14 10:43:36 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:43:39 janus kernel: re1: link state changed to UP
      Feb 14 10:43:39 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:43:53 janus kernel: re1: watchdog timeout
      Feb 14 10:43:53 janus kernel: re1: link state changed to DOWN
      Feb 14 10:43:53 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:43:57 janus kernel: re1: link state changed to UP
      Feb 14 10:43:57 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:44:11 janus kernel: re1: watchdog timeout
      Feb 14 10:44:11 janus kernel: re1: link state changed to DOWN
      Feb 14 10:44:11 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:44:14 janus kernel: re1: link state changed to UP
      Feb 14 10:44:14 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:44:27 janus kernel: re1: watchdog timeout
      Feb 14 10:44:27 janus kernel: re1: link state changed to DOWN
      Feb 14 10:44:27 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:44:30 janus kernel: re1: link state changed to UP
      Feb 14 10:44:30 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:44:42 janus kernel: re1: watchdog timeout
      Feb 14 10:44:42 janus kernel: re1: link state changed to DOWN
      Feb 14 10:44:42 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:44:45 janus kernel: re1: link state changed to UP
      Feb 14 10:44:45 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:45:07 janus kernel: re1: watchdog timeout
      Feb 14 10:45:07 janus kernel: re1: link state changed to DOWN
      Feb 14 10:45:07 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:45:10 janus kernel: re1: link state changed to UP
      Feb 14 10:45:10 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:45:23 janus kernel: re1: watchdog timeout
      Feb 14 10:45:23 janus kernel: re1: link state changed to DOWN
      Feb 14 10:45:23 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:45:26 janus kernel: re1: link state changed to UP
      Feb 14 10:45:26 janus check_reload_status[431]: Linkup starting re1
      
      === Switched KVM to pfSense
      
      Feb 14 10:45:35 janus kernel: ugen0.3: <vendor 0x1a40 USB 2.0 Hub> at usbus0
      Feb 14 10:45:35 janus kernel: uhub1 on uhub0
      Feb 14 10:45:35 janus kernel: uhub1: <vendor 0x1a40 USB 2.0 Hub, class 9/0, rev 2.00/1.11, addr 26> on usbus0
      Feb 14 10:45:36 janus kernel: uhub1: 4 ports with 4 removable, self powered
      Feb 14 10:45:36 janus kernel: ugen0.4: <PixArt Dell MS116 USB Optical Mouse> at usbus0
      Feb 14 10:45:36 janus kernel: ugen0.7: <Lite-On Technology Corp. USB Multimedia Keyboard> at usbus0
      Feb 14 10:45:36 janus kernel: ukbd0 on uhub1
      Feb 14 10:45:36 janus kernel: ukbd0: <Lite-On Technology Corp. USB Multimedia Keyboard, class 0/0, rev 1.10/1.15, addr 28> on usbus0
      Feb 14 10:45:36 janus kernel: kbd2 at ukbd0
      Feb 14 10:45:36 janus kernel: uhid0 on uhub1
      Feb 14 10:45:36 janus kernel: uhid0: <Lite-On Technology Corp. USB Multimedia Keyboard, class 0/0, rev 1.10/1.15, addr 28> on usbus0
      
      === Logged in on console
      
      Feb 14 10:45:38 janus login[67888]: login on ttyv0 as root
      Feb 14 10:45:49 janus kernel: re1: watchdog timeout
      Feb 14 10:45:49 janus kernel: re1: link state changed to DOWN
      Feb 14 10:45:49 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:45:52 janus kernel: re1: link state changed to UP
      Feb 14 10:45:52 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:46:28 janus kernel: re1: watchdog timeout
      Feb 14 10:46:28 janus kernel: re1: link state changed to DOWN
      Feb 14 10:46:28 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:46:32 janus kernel: re1: link state changed to UP
      Feb 14 10:46:32 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:46:57 janus kernel: re1: watchdog timeout
      Feb 14 10:46:57 janus kernel: re1: link state changed to DOWN
      Feb 14 10:46:57 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:47:00 janus kernel: re1: link state changed to UP
      Feb 14 10:47:00 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:47:35 janus kernel: re1: watchdog timeout
      Feb 14 10:47:35 janus kernel: re1: link state changed to DOWN
      Feb 14 10:47:35 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:47:39 janus kernel: re1: link state changed to UP
      Feb 14 10:47:39 janus check_reload_status[431]: Linkup starting re1
      
      === This looks like an error relating to my attempt to access the web UI
      
      Feb 14 10:47:55 janus nginx: 2024/02/14 10:47:55 [error] 40352#100266: *15358 upstream timed out (60: Operation timed out) while reading response header from upstream, client: 192.168.10.11, server: , request: "GET / HTTP/2.0", upstream: "fastcgi://unix:/var/run/php-fpm.socket", host: "192.168.10.254"
      Feb 14 10:48:03 janus kernel: re1: watchdog timeout
      Feb 14 10:48:03 janus kernel: re1: link state changed to DOWN
      Feb 14 10:48:03 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:48:06 janus kernel: re1: link state changed to UP
      Feb 14 10:48:06 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:48:21 janus kernel: re1: watchdog timeout
      Feb 14 10:48:21 janus kernel: re1: link state changed to DOWN
      Feb 14 10:48:21 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:48:24 janus kernel: re1: link state changed to UP
      Feb 14 10:48:24 janus check_reload_status[431]: Linkup starting re1
      Feb 14 10:48:30 janus php-cgi[41600]: notify_monitor.php: Could not send the message to jim@[redacted].net -- Error: Failed to connect to ssl://smtp.[redacted].net:465 [SMTP: Failed to connect socket: php_network_getaddresses: getaddrinfo for smtp.[redacted].net failed: Name does not resolve (code: -1, response: )]
      
      === Reboot initiated from console
      
      300 lines of normal boot log removed due to post length limitation (only 32k bytes?)
      
      Feb 14 10:50:21 janus kernel: done.
      Feb 14 10:50:22 janus php-fpm[30908]: /rc.start_packages: Restarting/Starting all packages.
      Feb 14 10:50:22 janus root[89149]: Bootup complete
      Feb 14 10:50:24 janus login[12490]: login on ttyv0 as root
      Feb 14 10:50:24 janus sshguard[14794]: Now monitoring attacks.
      Feb 14 10:50:28 janus php-cgi[50006]: notify_monitor.php: Message sent to jim@[redacted].net OK
      
      === Successful login via SSH; WAN connectivity restored
      
      Feb 14 10:51:06 janus php-fpm[30908]: /index.php: Successful login for user 'admin' from: 192.168.10.11 (Local Database)
      Feb 14 10:57:52 janus sshd[91446]: Accepted password for admin from 192.168.10.11 port 57883 ssh2
      Feb 14 11:02:48 janus sshd[18257]: Accepted password for admin from 192.168.10.11 port 58342 ssh2
      

      pfSense CE on Beelink EQ12 (N100 CPU, dual 2.5Gbe Intel NICs)
      Hitron CODA56 - Comcast 2.5Gb cable

      P stephenw10S 2 Replies Last reply Reply Quote 0
      • P
        pst @jhg
        last edited by

        @jhg said in WAN Link Down causes pfSense to stop responding on LAN?:

        Feb 14 10:37:50 janus php-fpm[19256]: /rc.dyndns.update: Dynamic DNS () There was an error trying to determine the public IP for interface - wan (re1 ).

        Hi,
        I just wanted to say I have seen the same behaviour twice, but I have yet to report/debug it. I kept the logs though.

        In my case a reboot (power cycle) appeared to fail, the pfSense never became accessible through SSH and no "boot complete" signal was heard. Logging in through the cosole I noticed the boot sequence was not completed, the dynamic DNS process that runs at bootup kept trying to obtain the WAN IP address continously, but failed.

        So I think this problem is related to the DynDNS functionality that we both use. Anyone looking into fixing this in rc.dyndns.update should consider limit the number of attempts of obtaining the WAN address before giving up.

        1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator @jhg
          last edited by

          @jhg said in WAN Link Down causes pfSense to stop responding on LAN?:

          Feb 14 10:48:03 janus kernel: re1: watchdog timeout
          Feb 14 10:48:03 janus kernel: re1: link state changed to DOWN
          Feb 14 10:48:03 janus check_reload_status[431]: Linkup starting re1
          Feb 14 10:48:06 janus kernel: re1: link state changed to UP
          Feb 14 10:48:06 janus check_reload_status[431]: Linkup starting re1
          Feb 14 10:48:21 janus kernel: re1: watchdog timeout

          That looks like a driver/hardware issue. Try using the alternative realtek-kmod driver.

          Steve

          J 2 Replies Last reply Reply Quote 0
          • J
            jhg @stephenw10
            last edited by

            @stephenw10 How are those watchdog timeouts different from the dozens before (are they)? Also, those are on re1 (WAN) not re0 (LAN).

            pfSense CE on Beelink EQ12 (N100 CPU, dual 2.5Gbe Intel NICs)
            Hitron CODA56 - Comcast 2.5Gb cable

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              They are not, I just grabbed those as examples. Anytime you see watchdog timeouts on Realtek hardware you should use the alt driver.

              1 Reply Last reply Reply Quote 0
              • VioletDragonV
                VioletDragon
                last edited by

                Re0 is Realtek. Recommend replacing with an Intel Network Controller. Also looks like you are using a residential Internet Connection, if you are from UK, residential internet sucks and not maintained. I am with BT Business and Zen Business and don’t have problems.

                1 Reply Last reply Reply Quote 0
                • J
                  jhg @stephenw10
                  last edited by jhg

                  @stephenw10 said in WAN Link Down causes pfSense to stop responding on LAN?:

                  That looks like a driver/hardware issue. Try using the alternative realtek-kmod driver.

                  OK, I installed the most recent kmod driver for FreeBSD 14 from this link (took a while to find it).

                  I checked that /boot/modules/if_re.ko was there, and created /boot/loader.conf.local as directed:

                  if_re_load="YES"
                  if_re_name="/boot/modules/if_re.ko"
                  

                  After a reboot (not reroot), kldstat still doesn't list the module:

                  ]/root: kldstat
                  Id Refs Address                Size Name
                   1   23 0xffffffff80200000  339ce08 kernel
                   2    1 0xffffffff8359d000    1e2b0 opensolaris.ko
                   3    1 0xffffffff835bc000     76f8 cryptodev.ko
                   4    1 0xffffffff835c4000   5d7790 zfs.ko
                   5    1 0xffffffff84420000     2220 cpuctl.ko
                   6    1 0xffffffff84423000     3240 ichsmb.ko
                   7    1 0xffffffff84427000     2178 smbus.ko
                  

                  And the boot log messages still list the default driver:

                  /boot: dmesg | egrep 're[01]|rgephy'
                  re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xe000-0xe0ff mem 0x81400000-0x81400fff,0xa0100000-0xa0103fff irq 17 at device 0.0 on pci1
                  re0: Using 1 MSI-X message
                  re0: Chip rev. 0x4c000000
                  re0: MAC rev. 0x00000000
                  miibus0: <MII bus> on re0
                  rgephy0: <RTL8251/8153 1000BASE-T media interface> PHY 1 on miibus0
                  rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
                  re0: Using defaults for TSO: 65518/35/2048
                  re0: Ethernet address: 00:01:2e:xx:xx:xx
                  re0: netmap queues/slots: TX 1/256, RX 1/256
                  re1: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xd000-0xd0ff mem 0x81300000-0x81300fff,0xa0000000-0xa0003fff irq 18 at device 0.0 on pci2
                  re1: Using 1 MSI-X message
                  re1: Chip rev. 0x4c000000
                  re1: MAC rev. 0x00000000
                  miibus1: <MII bus> on re1
                  rgephy1: <RTL8251/8153 1000BASE-T media interface> PHY 1 on miibus1
                  rgephy1:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
                  re1: Using defaults for TSO: 65518/35/2048
                  re1: Ethernet address: 00:01:2e:xx:xx:xx
                  re1: netmap queues/slots: TX 1/256, RX 1/256
                  re0: link state changed to DOWN
                  re1: link state changed to DOWN
                  re0: link state changed to UP
                  re1: link state changed to UP
                  
                  

                  I saw that there's a directory /boot/loader.conf.d so I did

                  cp /boot/loader.conf.local /boot/loader.conf.d/realtek.conf
                  

                  But that had no effect.

                  So as a last resort I added the loader config lines to /boot/loader.conf. After reboot the lines were moved but still present, but nothing changed in dmesg or kldstat.

                  I'm out of ideas. Suggestions?

                  pfSense CE on Beelink EQ12 (N100 CPU, dual 2.5Gbe Intel NICs)
                  Hitron CODA56 - Comcast 2.5Gb cable

                  stephenw10S 1 Reply Last reply Reply Quote 0
                  • ?
                    A Former User
                    last edited by

                    I occasionally have ISP connection outages and experience what seems to be the usual pfSense issues. One is getting an IP address on WAN after the outage and the other, like you, losing the LAN access to pfSense. I do not think that’s a NIC driver issue. A year ago, I had a NETGATE SG-3100 that was having the same issues and actually I returned it because of that. In my experience the common Internet routes are better than pfSense in recovering from ISP outages.

                    I have decided to give pfSense a second chance on my own hardware this time and unfortunately I am struggling with the same issues again. Everything is fine when the ISP connection is stable, but those issues surface when it is not. One thing that seems to help with the LAN access issue, I’m still not sure, is to change the default gateway to WAN_DHCP from Automatic in System/Routing/Gateways. You may like to give it a try.

                    J 1 Reply Last reply Reply Quote 0
                    • J
                      jhg @A Former User
                      last edited by

                      @kjk54 said in WAN Link Down causes pfSense to stop responding on LAN?:

                      One thing that seems to help with the LAN access issue, I’m still not sure, is to change the default gateway to WAN_DHCP from Automatic in System/Routing/Gateways.

                      I've already got it set to WAN_DHCP (defaulted that way at install). Thanks for the suggestion.

                      pfSense CE on Beelink EQ12 (N100 CPU, dual 2.5Gbe Intel NICs)
                      Hitron CODA56 - Comcast 2.5Gb cable

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator @jhg
                        last edited by stephenw10

                        @jhg said in WAN Link Down causes pfSense to stop responding on LAN?:

                        OK, I installed the most recent kmod driver for FreeBSD 14

                        You have to use a module built against the actual kernel in pfSense. The realtek-kmod pkg is in our repo to provide that. So remove that pkg from FreeBSD and just 'pkg install' it from our repo.

                        johnpozJ J 2 Replies Last reply Reply Quote 0
                        • johnpozJ
                          johnpoz LAYER 8 Global Moderator @stephenw10
                          last edited by johnpoz

                          @stephenw10 is there really an issue where if wan is down, be it dpinger or the actual interface down that you can not access the lan.. I have never seen such an issue on any device, be it my own, or vm or multiple flavors of netgate appliances - my old company, I got few 3100's into production for sites. And even one 2440..

                          I don't recall ever running into such an issue - yeah the gui can take a few to load, believe related to dns problems on the gui page, etc. But it would load after a delay.

                          But I don't recall ever not being able to access it from the lan side.. And its not like we didn't have internet outages.. Company would only allow me to use them for the local internet connection at some smaller sites.. So they were not on 5 9's sort of sla business connections..

                          I have had issues where internet down on my sg4860, and don't recall having any such issues.. Now I do have mine currently running through a switch, so even if internet is down the interface is up.. But before I set that up I had modem direct into pfsense interface, and don't ever recall having any issues..

                          I could for sure simulate this by either pulling ethernet at the modem itself or at pfsense.. Might do that when nobody streaming plex..

                          An intelligent man is sometimes forced to be drunk to spend time with his fools
                          If you get confused: Listen to the Music Play
                          Please don't Chat/PM me for help, unless mod related
                          SG-4860 24.11 | Lab VMs 2.8, 24.11

                          VioletDragonV 1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            Nope, I've not seen that either.

                            The only time I've seen issues with that is if there's an incorrectly configured gateway on LAN or potentially a VPN. Such that when the WAN gateway goes down if the system default gateway is still set to auto the default becomes something invalid. That still shouldn't prevent access from LAN but if there are services trying to connect out they can use a lot of CPU cycles trying.

                            1 Reply Last reply Reply Quote 0
                            • VioletDragonV
                              VioletDragon @johnpoz
                              last edited by

                              @johnpoz I have only seen this activity when WAN is on the same LAN or LAGG interface with WAN in a VLAN but not seen this on a separate Interface I.e WAN Port and LAN port or LAGG then WAN on a Separate interface.

                              1 Reply Last reply Reply Quote 0
                              • J
                                jhg @stephenw10
                                last edited by

                                @stephenw10 said in WAN Link Down causes pfSense to stop responding on LAN?:

                                @jhg said in WAN Link Down causes pfSense to stop responding on LAN?:

                                OK, I installed the most recent kmod driver for FreeBSD 14

                                You have to use a module built against the actual kernel in pfSense. The realtek-kmod pkg is in our repo to provide that. So remove that pkg from FreeBSD and just 'pkg install' it from our repo.

                                Got it (finally :-) I should have realized pfSense would have its own repos in the list. kldstat now shows the module loaded. We'll see if the problem goes away.
                                Thanks

                                pfSense CE on Beelink EQ12 (N100 CPU, dual 2.5Gbe Intel NICs)
                                Hitron CODA56 - Comcast 2.5Gb cable

                                1 Reply Last reply Reply Quote 1
                                • First post
                                  Last post
                                Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.