Netgate 7100, IX1 shows 00::00 mac address

LamboJ

@stephenw10 said in Netgate 7100, IX1 shows 00::00 mac address:

Hmm, odd. What module do you have in it?

Do you see any errors logged at boot for it when the driver attaches?

I don't have any additional modules installed. Just the stock XG-7100 1U purchased from Netgate. ix0 works perfectly fine. Only ix1 shows the blank MAC.

I don't see any errors logged on boot.

stephenw10

So you're not actually using IX1?

Try a full power cycle on the 7100. We have seen the ix NICs present unexpected behaviour when booted with an unsupported module that can only be cleared by full power cycle. Rebooting is insufficient.

LamboJ

@stephenw10 said in Netgate 7100, IX1 shows 00::00 mac address:

So you're not actually using IX1?

Try a full power cycle on the 7100. We have seen the ix NICs present unexpected behaviour when booted with an unsupported module that can only be cleared by full power cycle. Rebooting is insufficient.

Sorry I'm not clear what you mean when you say "So you're not actually using IX1"? I didn't install or add any modules myself. I'm just using the appliance purchased directly from Netgate. There were 2 SFP+ ports (ix0, and ix1), and 8 x RJ-45 ports. This is what it looks like: https://docs.netgate.com/pfsense/en/latest/solutions/_images/xg-7100-1u-io-ports.png

I did try rebooting, but it didn't help.

tinyplum

@LamboJ
I also observed the same issue with ix0 on the WAN.
To overcome I did just as you mention and applied a valid MAC address to the interface.
Et vio la. I received a dhcp lease and all was good.
I believe it was due to a not fully supported SFP+ module. Logs did not show unsupported SFP+ module, but the speed and feature information about the interface was lacking.

stephenw10

@LamboJ said in Netgate 7100, IX1 shows 00::00 mac address:

Sorry I'm not clear what you mean when you say "So you're not actually using IX1"? I didn't install or add any modules myself.

I meant you would need to add an SFP/SFP+ module to the ix0 port to connect anything to it. So if you don't have a module inserted I assume you are not trying to use the NIC.

What firmware (BIOS) version are you running? Check System > Netgate Firmware Upgrade or as reported in the System Info widget on the dashboard.

Vendor: coreboot
Version: ADI_PLCC-01.00.00.20
Release Date: Sun Dec 5 2021

LamboJ

@stephenw10 said in Netgate 7100, IX1 shows 00::00 mac address:

@LamboJ said in Netgate 7100, IX1 shows 00::00 mac address:

Sorry I'm not clear what you mean when you say "So you're not actually using IX1"? I didn't install or add any modules myself.

I meant you would need to add an SFP/SFP+ module to the ix0 port to connect anything to it. So if you don't have a module inserted I assume you are not trying to use the NIC.

What firmware (BIOS) version are you running? Check System > Netgate Firmware Upgrade or as reported in the System Info widget on the dashboard.
Vendor: coreboot
Version: ADI_PLCC-01.00.00.20
Release Date: Sun Dec 5 2021

When you say module are you referring to the SFP+ transceiver inserted into the slot? I'm using an FS brand SFP+ transceiver coded for Intel.

Bios version:
Vendor: coreboot
Version: ADI_PLCC-01.00.00.11
Release Date: Tue Jan 8 2019

stephenw10

Ah, OK so you do have an SFP+ module in the port and it does work but only if you spoof the MAC address to something valid?

OK so check the output of: ifconfig -vvvm ix1

The remove the module and reboot and check it again. Does it correctly show no module present and the expected MAC address?

LamboJ

@stephenw10 said in Netgate 7100, IX1 shows 00::00 mac address:

Ah, OK so you do have an SFP+ module in the port and it does work but only if you spoof the MAC address to something valid?

^ That's correct

OK so check the output of: ifconfig -vvvm ix1

The remove the module and reboot and check it again. Does it correctly show no module present and the expected MAC address?

This is what I get with it plugged in:

ix1: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
	description: WAN
	options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether 00:00:00:00:00:00
	inet6 fe80::208:a2ff:fe0e:dca5%ix1 prefixlen 64 scopeid 0x2
	media: Ethernet autoselect (10Gbase-Twinax <full-duplex,rxpause,txpause>)
	status: active
	supported media:
		media autoselect
		media 10Gbase-Twinax
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	drivername: ix1
	plugged: SFP/SFP+/SFP28 Unknown (RJ45)
	vendor: FS PN: SFP-10G-T SN: F2032324059 DATE: 2021-11-23

	SFF8472 DUMP (0xA0 0..127 range):
	 03 04 22 00 00 00 00 00 04 00 00 06 67 02 00 00
	 00 00 1e 00 46 53 20 20 20 20 20 20 20 20 20 20
	 20 20 20 20 00 00 1b 21 53 46 50 2d 31 30 47 2d
	 54 20 20 20 20 20 20 20 41 20 20 20 00 00 00 0f
	 00 3a 00 00 46 32 30 33 32 33 32 34 30 35 39 20
	 20 20 20 20 32 31 31 31 32 33 20 20 00 00 00 88
	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
	 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

This is what I get when it's unplugged:

ix1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WAN
	options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether 00:00:00:00:00:00
	inet6 fe80::208:a2ff:fe0e:dca5%ix1 prefixlen 64 scopeid 0x2
	media: Ethernet autoselect
	status: no carrier
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	drivername: ix1

stephenw10

Hmm, weird. Does it still show that if you do a full power cycle after removing the SFP module?

Ah, just spotted that you're running a much older Coreboot version. It looks like it has probably never been upgraded?

You should upgrade that to the current version. However in order to do so you will need to running pfSense 23.05.1. You can do that from the Net Installer though.

The Netgate Firmware Upgrade package is installed there by default.

LamboJ

@stephenw10 said in Netgate 7100, IX1 shows 00::00 mac address:

Hmm, weird. Does it still show that if you do a full power cycle after removing the SFP module?

Ah, just spotted that you're running a much older Coreboot version. It looks like it has probably never been upgraded?

You should upgrade that to the current version. However in order to do so you will need to running pfSense 23.05.1. You can do that from the Net Installer though.

The Netgate Firmware Upgrade package is installed there by default.

Yeah, same thing happens after power cycling.

I'm running pfSense 24.03-RELEASE.

How do I upgrade coreboot?

stephenw10

The Netgate Firmware Upgrade package will do it but the last version that works with the 7100 is 23.05.1 so it will need to be temporarily downgraded to that.

LamboJ

@stephenw10 said in Netgate 7100, IX1 shows 00::00 mac address:

The Netgate Firmware Upgrade package will do it but the last version that works with the 7100 is 23.05.1 so it will need to be temporarily downgraded to that.

How do I downgrade to 23.05.1?

stephenw10

If you have a ZFS install it's possible you have a BE snapshot from 23.05.1. Check in System > Boot Environments.

Otherwise it would need to be reinstalled to 23.05.1. That can be done from the Net Installer:
https://docs.netgate.com/pfsense/en/latest/solutions/xg-7100-1u/reinstall-pfsense.html#reinstalling-pfsense-plus-software