1541 no carrier on ix0
-
We have a HA pair of 1541 running PFsense+ 24.11 connected to a stack of Extreme Networks X450G2-48p-10G4 through 10Gbase-T SFP+ to the ix0 ports on the LAN of the 1541s.
After a year in service the primary one started dropping the ix0 interface, only fully removing power by unplugging both PSUs after shutting down will get it working again. It will work for a couple days to a couple weeks before again showing no carrier on the ix0 interface.
Any ideas what the cause could be and how to fix?
-
@bredick
Looks like hardware problem. Try to replace the card. Is it pcie card installed in 1541? -
@w0w
It's one of the onboard ports, and with it being part of an HA pair with VLANs on the interface changing interfaces to the add-in card is a pretty major task, as far as I can tell. Kind of hoping Netgate TAC can determine it is a hardware problem and replace it rather than go through the effort of moving interfaces around. -
Any sort of error logged when it loses link? Anything shown in the switch logs?
If you swap the ix0/ix1 port assignment does the error follow it? Ports on the switch?
-
@stephenw10
Good question on the logs, I'll have to look when I am at home since I can't access it from the LAN here while it is not working.Have not tried swapping interfaces between ix0 and ix1 due to the VLANs and CARP failover making that a task that requires some effort and downtime. Interface ix1 is my sync interface, and that stays up, though that is just a straight 3 inch cable between the two 1541s, so not much to go wrong there, though if it was also going down hardware would be more likely.
I have tried changing out the 10Gbast-T SFP+ module in the switch and swapping ports, the port on the firewall shows link and no activity, switch just logs that the interface is disconnected, does not seem to be that the switch is taking it down for any reason.
-
@bredick
I had an overheating Intel X550 card where the ix0 interface was also dropping out with "no carrier". Additional cooling extended the time before failure, but it’s important to understand that the card was likely already damaged. -
@bredick said in 1541 no carrier on ix0:
Have not tried swapping interfaces between ix0 and ix1 due to the VLANs and CARP failover making that a task that requires some effort and downtime.
You need to download the configuration file and swap all instances of ix0 with ix1, and vice versa. Ideally, make a backup and create a boot environment snapshot/clone before making any changes. After that, restore the modified configuration file.
-
The fact it's in HA makes it more difficult. You would probably have to swap it on both nodes.
In the 1541 the ix NICs are in the SoC so I would not expect overheating to be an issue if the CPU is still within limits. But possibly some other component like a PHY. Certainly check the fans and sensor readings between the two nodes.
