Re0 watchdog timeout [solved]

cheshire_cat · Nov 1, 2015, 11:05 AM

:'(
Hi,

Anyone ecounter watchdog timeout Issue?
When I download Files (28g) from server behind re0, the server beening unreachable after amount of time :(
I can still ping re0 interface but cannot ping devices behind re0.

my pfsense config:
pfsense 2.2.4
Asus J1900i-c
4GB Ram
Onboard realtek 8111g –---- re0
Intel dual port 82576 lan ---------- wan, lan

----------wan-----------------
------------|--------------------
--------pfsense---------------
----------|-----|----------------
----------|--- re0--------------
----------|-----|----------------
----------|--- n66u as AP----
----------|----------|-----------

----------	------Server--------
----------	-----------------------
--------Lan---------------------
----------	-----------------------
--------PC1---------------------

Appreciate for advise.
The syslog is full of watchdog timeout, re0 down, re0 up, loop


Oct 29 15:13:45 	kernel: re0: watchdog timeout
Oct 29 15:13:45 	kernel: re0: link state changed to DOWN
Oct 29 15:13:46 	php-fpm[76217]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:13:49 	check_reload_status: Linkup starting re0
Oct 29 15:13:49 	kernel: re0: link state changed to UP
Oct 29 15:13:50 	php-fpm[76217]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:13:50 	check_reload_status: rc.newwanip starting re0
Oct 29 15:13:51 	php-fpm[76217]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:13:51 	php-fpm[76217]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:13:52 	check_reload_status: Reloading filter
Oct 29 15:14:03 	check_reload_status: Linkup starting re0
Oct 29 15:14:03 	kernel: re0: watchdog timeout
Oct 29 15:14:03 	kernel: re0: link state changed to DOWN
Oct 29 15:14:04 	php-fpm[95478]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:07 	check_reload_status: Linkup starting re0
Oct 29 15:14:07 	kernel: re0: link state changed to UP
Oct 29 15:14:08 	php-fpm[95478]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:08 	check_reload_status: rc.newwanip starting re0
Oct 29 15:14:09 	php-fpm[95478]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:14:09 	php-fpm[95478]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:14:09 	check_reload_status: Reloading filter
Oct 29 15:14:15 	kernel: re0: watchdog timeout
Oct 29 15:14:15 	kernel: re0: link state changed to DOWN
Oct 29 15:14:15 	check_reload_status: Linkup starting re0
Oct 29 15:14:16 	php-fpm[10433]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:19 	check_reload_status: Linkup starting re0
Oct 29 15:14:19 	kernel: re0: link state changed to UP
Oct 29 15:14:20 	php-fpm[10433]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:20 	check_reload_status: rc.newwanip starting re0
Oct 29 15:14:21 	php-fpm[10433]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:14:21 	php-fpm[10433]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:14:21 	check_reload_status: Reloading filter
Oct 29 15:14:28 	check_reload_status: Linkup starting re0
Oct 29 15:14:28 	kernel: re0: watchdog timeout
Oct 29 15:14:28 	kernel: re0: link state changed to DOWN
Oct 29 15:14:29 	php-fpm[21700]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:33 	kernel: re0: link state changed to UP
Oct 29 15:14:33 	check_reload_status: Linkup starting re0
Oct 29 15:14:34 	php-fpm[21700]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:34 	check_reload_status: rc.newwanip starting re0
Oct 29 15:14:35 	php-fpm[21700]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:14:35 	php-fpm[21700]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:14:35 	check_reload_status: Reloading filter
Oct 29 15:14:42 	check_reload_status: Linkup starting re0
Oct 29 15:14:42 	kernel: re0: watchdog timeout
Oct 29 15:14:42 	kernel: re0: link state changed to DOWN
Oct 29 15:14:45 	php-fpm[50727]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:46 	check_reload_status: Linkup starting re0
Oct 29 15:14:46 	kernel: re0: link state changed to UP
Oct 29 15:14:47 	php-fpm[60064]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:47 	check_reload_status: rc.newwanip starting re0
Oct 29 15:14:48 	php-fpm[61592]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:14:48 	php-fpm[61592]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:14:48 	check_reload_status: Reloading filter
Oct 29 15:14:54 	check_reload_status: Linkup starting re0
Oct 29 15:14:54 	kernel: re0: watchdog timeout
Oct 29 15:14:54 	kernel: re0: link state changed to DOWN
Oct 29 15:14:55 	php-fpm[61592]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:58 	check_reload_status: Linkup starting re0
Oct 29 15:14:58 	kernel: re0: link state changed to UP
Oct 29 15:14:59 	php-fpm[72879]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:14:59 	check_reload_status: rc.newwanip starting re0
Oct 29 15:15:00 	php-fpm[72879]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:15:00 	php-fpm[72879]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:15:00 	check_reload_status: Reloading filter
Oct 29 15:15:03 	check_reload_status: Linkup starting re0
Oct 29 15:15:03 	kernel: re0: watchdog timeout
Oct 29 15:15:03 	kernel: re0: link state changed to DOWN
Oct 29 15:15:04 	php-fpm[72879]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:15:07 	check_reload_status: Linkup starting re0
Oct 29 15:15:07 	kernel: re0: link state changed to UP
Oct 29 15:15:08 	php-fpm[72879]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:15:08 	check_reload_status: rc.newwanip starting re0
Oct 29 15:15:09 	php-fpm[72879]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:15:09 	php-fpm[72879]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:15:09 	check_reload_status: Reloading filter
Oct 29 15:15:12 	kernel: re0: watchdog timeout
Oct 29 15:15:12 	kernel: re0: link state changed to DOWN
Oct 29 15:15:12 	check_reload_status: Linkup starting re0
Oct 29 15:15:14 	php-fpm[84806]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:15:16 	check_reload_status: Linkup starting re0
Oct 29 15:15:16 	kernel: re0: link state changed to UP
Oct 29 15:15:17 	php-fpm[84806]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:15:17 	check_reload_status: rc.newwanip starting re0
Oct 29 15:15:18 	php-fpm[84806]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:15:18 	php-fpm[84806]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:15:18 	check_reload_status: Reloading filter
Oct 29 15:17:19 	check_reload_status: Linkup starting re0
Oct 29 15:17:19 	kernel: re0: watchdog timeout
Oct 29 15:17:19 	kernel: re0: link state changed to DOWN
Oct 29 15:17:21 	php-fpm[21182]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:17:23 	check_reload_status: Linkup starting re0
Oct 29 15:17:23 	kernel: re0: link state changed to UP
Oct 29 15:17:24 	php-fpm[21182]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:17:24 	check_reload_status: rc.newwanip starting re0
Oct 29 15:17:25 	php-fpm[30297]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:17:25 	php-fpm[30297]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:17:25 	check_reload_status: Reloading filter
Oct 29 15:18:07 	check_reload_status: Linkup starting re0
Oct 29 15:18:07 	kernel: re0: watchdog timeout
Oct 29 15:18:07 	kernel: re0: link state changed to DOWN
Oct 29 15:18:08 	php-fpm[83035]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:18:11 	check_reload_status: Linkup starting re0
Oct 29 15:18:11 	kernel: re0: link state changed to UP
Oct 29 15:18:12 	php-fpm[83035]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:18:12 	check_reload_status: rc.newwanip starting re0
Oct 29 15:18:14 	php-fpm[83035]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:18:14 	php-fpm[83035]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:18:14 	check_reload_status: Reloading filter
Oct 29 15:21:04 	check_reload_status: Linkup starting re0
Oct 29 15:21:04 	kernel: re0: watchdog timeout
Oct 29 15:21:04 	kernel: re0: link state changed to DOWN
Oct 29 15:21:05 	php-fpm[75201]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:21:08 	check_reload_status: Linkup starting re0
Oct 29 15:21:08 	kernel: re0: link state changed to UP
Oct 29 15:21:09 	php-fpm[75201]: /rc.linkup: Hotplug event detected for OPT1(opt1) but ignoring since interface is configured with static IP (192.168.10.1 )
Oct 29 15:21:09 	check_reload_status: rc.newwanip starting re0
Oct 29 15:21:10 	php-fpm[75201]: /rc.newwanip: rc.newwanip: Info: starting on re0.
Oct 29 15:21:10 	php-fpm[75201]: /rc.newwanip: rc.newwanip: on (IP address: 192.168.10.1) (interface: OPT1[opt1]) (real interface: re0).
Oct 29 15:21:10 	check_reload_status: Reloading filter

doktornotor · Oct 29, 2015, 8:57 AM

Advice == replace ShitTek NICs.

cheshire_cat · Oct 29, 2015, 1:11 PM

maybe you are right about that lol.
I just found some forum said that….it just a old issue from FreeBSD 8.X and now still exist on 9.X

cheshire_cat · Nov 1, 2015, 11:14 AM

It seem solved after enabling Flow Control and Master on my re0 interface.

also need to add parameters in /boot/loader.conf
hw.re.msi_disable=1
hw.pci.enable_msix=0
hw.pci.enable_msi=0

I am not network expert, I dont know what these parameters but these two steps save my life. :D

PS. This steps also solved my old old old issue: network performance 50% of gigabit speed

solo16 · Mar 31, 2016, 4:21 PM

@cheshire_cat:

It seem solved after enabling Flow Control and Master on my re0 interface.

also need to add parameters in /boot/loader.conf
hw.re.msi_disable=1
hw.pci.enable_msix=0
hw.pci.enable_msi=0

I am not network expert, I dont know what these parameters but these two steps save my life. :D

PS. This steps also solved my old old old issue: network performance 50% of gigabit speed

Hi,
I'm also having the same problem I got frequent re0 (LAN) watchdog timeout issue, with the powerd off no such problem.

So, may I ask you how to enable the flowcontrol and master?

Thanks!

cheshire_cat · Apr 27, 2016, 4:21 AM

@solo16:

@cheshire_cat:

It seem solved after enabling Flow Control and Master on my re0 interface.

also need to add parameters in /boot/loader.conf
hw.re.msi_disable=1
hw.pci.enable_msix=0
hw.pci.enable_msi=0

I am not network expert, I dont know what these parameters but these two steps save my life. :D

PS. This steps also solved my old old old issue: network performance 50% of gigabit speed

Hi,
I'm also having the same problem I got frequent re0 (LAN) watchdog timeout issue, with the powerd off no such problem.

So, may I ask you how to enable the flowcontrol and master?

Thanks!

Interface -> "your realtek interface" -> Advanced

Napsterbater · Dec 8, 2016, 8:18 PM

I'm having these issues, I have no "Native" interfaces though, they are all VLANs, any way to set this on the base interface?

dotdash · Dec 8, 2016, 10:06 PM

You could do it with the shellcmd package.

80sricky · Jul 22, 2017, 10:46 AM

Hi apologise for resurrecting an old thread but how do you add the parameters to the boot\loader?

Thanks

ptt · Jul 22, 2017, 12:30 PM

You "add" to "loader.conf.local" ;)

https://doc.pfsense.org/index.php/Tuning_and_Troubleshooting_Network_Cards#Adding_to_loader.conf.local

Areomayo · Sep 8, 2017, 11:55 PM

The above did not solve my problem alone rather a combination.

What fixed it for me was uploading a compiled version of realtek driver 1.92 if_re.ko to /boot/kernel/ and in /boot/loeader.conf.local add the following line: if_re_load="YES" then reboot and wupti.

I also however tick the 3 Disable hardware offloadings in System - Advanced - Networking

Heres some links that helped me solve my issue including the compiled if_re.ko, i hope it helps others having same problem.
https://bugs.freenas.org/issues/1850
https://www.ateamsystems.com/tech-blog/freebsd-pfsense-link-state-re0-watchdog-timeout-errors/

bgbird03 · Nov 12, 2017, 1:29 AM

@Areomayo:

The above did not solve my problem alone rather a combination.

What fixed it for me was uploading a compiled version of realtek driver 1.92 if_re.ko to /boot/kernel/ and in /boot/loeader.conf.local add the following line: if_re_load="YES" then reboot and wupti.

I also however tick the 3 Disable hardware offloadings in System - Advanced - Networking

Heres some links that helped me solve my issue including the compiled if_re.ko, i hope it helps others having same problem.
https://bugs.freenas.org/issues/1850
https://www.ateamsystems.com/tech-blog/freebsd-pfsense-link-state-re0-watchdog-timeout-errors/

How did you upload that compiled file to the /boot/kernel? I'm ready to do this and can't figure it out (I'm new to this – obviously).

Thanks!