SFP Troubleshoot

Annwenn

Hello,
We're using a Netgate XG1537 and we want to use both SFP+ ports.
We can't make them work. We tried with several different SFP modules but without success.
Both SFP ports have the same problem
Pfsense+ accepts the module well but no network crosses

ipconfig -vm ix0

ix0: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500

  description: TEST

  options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
  capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
  ether 3c:ec:ef:32:91:6e

  inet 192.168.7.1 netmask 0xffffff00 broadcast 192.168.7.255

  inet6 fe80::3eec:efff:fe32:916e%ix0 prefixlen 64 scopeid 0x1

  media: Ethernet autoselect (1000baseSX <full-duplex,rxpause,txpause>)

  status: active

  supported media:

    media autoselect

    media 1000baseSX

  nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
  plugged: SFP/SFP+/SFP28 1000BASE-SX (LC)

  vendor: OEM PN: GLC-SX-MMD      SN: CSGE1MC1376 DATE: 2022-12-07

  module temperature: 43.13 C voltage: 3.27 Volts

  lane 1: RX power: 0.24 mW (-6.17 dBm) TX bias: 3.98 mA

What is strange is that only one LED lights up, as if a single strand is detected.
We checked with switches that the modules and cables were functional.

Pfsense :

Switch :

A little help would be welcome.
Thanks a lot.

stephenw10

What does Status > Interfaces show for that NIC? Errors? Packets?

Steve

Annwenn

@stephenw10
Thanks for the reply.
Here's what the interface is all about:


TEST Interface (opt1, ix0)

Status
    up 
MAC Address
    3c:ec:ef:32:91:6e 
IPv4 Address
    192.168.7.1 
Subnet mask IPv4
    255.255.255.0 
IPv6 Link Local
    fe80::3eec:efff:fe32:916e%ix0 
MTU
    1500 
Media
    1000baseSX <full-duplex,rxpause,txpause> 
Plugged
    SFP/SFP+/SFP28 1000BASE-SX (LC) 
Vendor
    OEM PN: GLC-SX-MMD SN: CSGE1MC1376 DATE: 2022-12-07 
In/out packets
    10/0 (3 KiB/0 B) 
In/out packets (pass)
    10/0 (3 KiB/0 B) 
In/out packets (block)
    126/0 (40 KiB/0 B) 
In/out errors
    0/0 
Collisions
    0 
Interrupts
    178 (0/s)

No problems spotted .

Thanks

danjeman

@Annwenn Not exactly the same but recently had an issue with a Netgate 6100 trying to use SFP sx in the SFP+ ports.. module detected in pfsense+ but was seeing no carrier regardless of module used. As soon as i used the sfp port on the 6100 it all worked.

stephenw10

Ok so it's seeing IN packets but not sending anything; 0 OUT packets. Is it simply not configured to send anything on the interface?

Annwenn

@stephenw10
We've set up a dhcp server on this interface but nothing gets through.
Packet Tracer doesn't see anything.
What exactly is the meaning of the two triangles on top of the SFP ports?

@danjeman
Yes I have the same question about the compatibility between sfp and sfp+.

stephenw10

So a pcap on that interface shows no traffic at all even though the packet counters are showing some incoming packets?

Is it only ever that LED you see lit? The other 'down arrow' LED doesn't flash?

Steve

Annwenn

@stephenw10
Yes, exactly.
No traffic.
The downward one never flashes.
I'm going to try to get spf+ modules and install the community version because I'm going around in circles :(