pfSense not enabling port

georgelza · Oct 28, 2024, 10:38 AM

Hi all

Ok, I got the i5-1335 Topton unit as me new pfSense host, got it configured with 4 x 2.5GbE and 2 x 10GbE SFP's.

For now got it cabled using the Cat6 via the 2.5GbEports, working...

Trying to get the 10GbE SFP+ ports working...
I've created a new clan, assigned it to ix0 and enabled the interface. Got it going into a Unifi Pro Max.
Dell SFP+'s on both sides, brand new, Fiber cabling brand new.

Port is showing dead on the unifi side.

Anyone have any ideas.

Gertjan · Oct 28, 2024, 11:41 AM

@georgelza

This :

pfSense not enabling port

can be explained by this

dead on the unifi side.

as both side needs to 'work'.

georgelza · Oct 28, 2024, 11:51 AM

@Gertjan ye... ok, figured it's dead on one or both sides...
how do i enable... is there a magic button somewhere i need to click on.

Gertjan · Oct 28, 2024, 12:52 PM

@georgelza

"Dell SFP+" neither "Unifi Pro Max" aren't discussed a lot on this forum.

From what I know on "SFP+" (modules) : can't you login to them and have a chat ?

stephenw10 · Oct 28, 2024, 9:11 PM

Check the output of ifconfig -vvm ix0 at the CLI.

georgelza · Oct 29, 2024, 5:27 AM

@stephenw10

[2.7.2-RELEASE]/root: ifconfig -vvm ix0
ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: LAN
	options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether a8:b8:e0:05:ef:51
	inet6 fe80::aab8:e0ff:fe05:ef51%ix0 prefixlen 64 scopeid 0x3
	media: Ethernet autoselect
	status: no carrier
	supported media:
		media autoselect
		media 10Gbase-SR
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	plugged: SFP/SFP+/SFP28 100GBASE-SR4 or 25GBASE-SR (LC)
	vendor: DELL EMC PN: M14MK SN: CN04HG0011J31FP DATE: 2021-01-22
	module temperature: 49.36 C voltage: 3.28 Volts
	lane 1: RX power: 0.71 mW (-1.51 dBm) TX bias: 6.40 mA

Gertjan · Oct 29, 2024, 7:21 AM

@georgelza

I see :

	supported media:
		media autoselect
		media 10Gbase-SR

and

plugged: SFP/SFP+/SFP28 plugged: SFP/SFP+/SFP28 100GBASE-SR4 or 25GBASE-SR (LC) (LC)

Does "plugged" means : plugged into the ix0 interface ?
Clearly, 10Gbase-SR is not 100GBASE-SR4 neither 25GBASE-SR (LC).

georgelza · Oct 29, 2024, 8:46 AM

@Gertjan

Hi there

Everything is plugged in. both switch side and Topton (pfSense) side.

SFP+ on both sides are the same. Clearly my Unifi switch is seeing the SFP+'s correctly, well it knows it's a Dell/EMC (and they def as per the below diagram)
would hurt if the Topton can't use them as I have a bag full... and would not want to have to buy... if i don't need to.

🔒 Log in to view

G

Gblenn · Oct 29, 2024, 9:25 AM

@georgelza Isn't that the DELL M14MK a dual mode 10G/25G module? Or at least it seems to be recognized as such, looking at what you pasted from ifconfig -vm ix0. So my guess it is not set correctly on the pfsense side, (not 10G) and you need to manually set it to 10G and not autonegotiate?

georgelza · Oct 29, 2024, 9:35 AM

@Gblenn

how would i change the setting.

sorry dont have DAC cable.

G

Gblenn · Oct 29, 2024, 9:50 AM

@georgelza You can set it in Interfaces / WAN, LAN under Speed and Duplex. There's a drop down that should show the alternativs pfsense thinks your card has.

If you can't access the UI, I guess you would need to execute something like:
ifconfig ix0 media 10000baseT mediaopt full-duplex

It might be that it should be this instead?
ifconfig ix0 media 10Gbase-T mediaopt full-duplex

georgelza · Oct 29, 2024, 10:31 AM

@Gblenn

thanks, will try... of course doing this... while connected to network over which this run's gets interesting when you break it, go cable directly into pfSense to get to console to reset back to copper and then retry ;)
G

Gblenn · Oct 29, 2024, 11:23 AM

@georgelza Well, depends on how you have it set up. You mentioned you have the 2.5G ports working. So if you can access the UI from one of those ports, you should be fine...

georgelza · Oct 29, 2024, 1:15 PM

@Gblenn

/root: ifconfig ix0 media 10Gbase-T mediaopt full-duplex
ifconfig: SIOCSIFMEDIA (media): Device not configured

Gblenn · Oct 29, 2024, 1:15 PM

@georgelza Hmm, I see in the listing you made earlier (ifconfig -vm ix0) that it sais supported media is 10Gbase-SR.
So perhaps if you try with that instead on 10Gbase-T??

As in ifconfig ix0 media 10Gbase-SR mediaopt full-duplex

georgelza · Oct 29, 2024, 1:24 PM

@Gblenn said in pfSense not enabling port:

As in ifconfig ix0 media 10Gbase-SR mediaopt full-duplex

Glad we thinking same direction.
tried this earlier and got as per below.

[2.7.2-RELEASE]/root: ifconfig ix0 media 10Gbase-SR mediaopt full-duplex
ifconfig: SIOCSIFMEDIA (media): Device not configured

Gblenn · Oct 29, 2024, 1:31 PM

@georgelza Ok, that's too bad...
Are you able to log into pfsense UI via one of the 2.5G ports? If so, what does it show you in the drop down for these interfaces??

🔒 Log in to view

georgelza · Oct 29, 2024, 1:36 PM

@Gblenn

See attached... Little something bout my network, i connect via cable or wifi to core switch which connects "currently" via 2.5GbE Cat6 copper to pfSense.

This link that I'm trying to get configured is to replace that primary copper link between my core switch and the pfSense.

🔒 Log in to view

Gblenn · Oct 29, 2024, 1:38 PM

@georgelza Ok, so what happens then if you select the 10Gbase-SR in that drop down and save and Apply?

stephenw10 · Oct 29, 2024, 1:39 PM

Yeah try setting it from the GUI.

A good test here might be to try to link two ports on pfSense directly. Obviously they can't pass traffic but if they link in that scenario it implies a link negotiation issue with the switch/modules.