Newbie question - is the 6100 directly compatible with this fiber connection?

seanmcb

So I'm in a similar situation.

I also have a Nokia GPON ONT SFP G-010S-A MREV: 01 ICS: 01. This was provided by my ISP. When plugged into an Adran 854-v6 they also provided, everything works.

I'd like to replace that Adtran with a Netgate 6100 running pfsense+ 24.03.

I've plugged the Nokia SFP into the 6100's WAN3 and ifconfig -vvvm ix0 gives:

[24.03-RELEASE][admin@pfSense.home.arpa]/root: ifconfig -vvvm ix0
ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WAN3
	options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether 90:ec:77:XX:XX:XX
	inet6 fe80::92ec:77ff:feXX:XXXX%ix0 prefixlen 64 scopeid 0x5
	media: Ethernet autoselect
	status: no carrier
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	drivername: ix0
	plugged: SFP/SFP+/SFP28 100G SWDM4 (SC)
	vendor: ALCATELLUCENT PN: 3FE46541AA SN: ALCLF9XXXXXX DATE: 2019-10-12
	module temperature: 0.00 C voltage: 0.00 Volts
	lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA

So it does see it!

But is it a bad sign that temperature/voltage/power are zero/inf?

There appear to be little lights adjacent to the 6100's SFP port (or are they holes?), but they are not illuminated. What does that mean?

I've configured my WAN with VLAN and PPPoE per various forum threads, I believe correctly, and so I'm starting to think these two hardware are not compatible?

Thanks for any pointers...

stephenw10

@seanmcb said in Newbie question - is the 6100 directly compatible with this fiber connection?:

But is it a bad sign that temperature/voltage/power are zero/inf?

Not necessarily since it's pretending to be something else and probably doesn't pass the real fibre values anyway.

@seanmcb said in Newbie question - is the 6100 directly compatible with this fiber connection?:

There appear to be little lights adjacent to the 6100's SFP port (or are they holes?), but they are not illuminated. What does that mean?

Those are the link LEDs and should light if it links to the module.

It must show link in the NIC before pppoe will even start trying.

Since it offers no media options other than autoselect your options are limited.

Does it link in WAN1 or WAN2? The GPON module I have for testing does work there:

[24.08-DEVELOPMENT][admin@8200-2.stevew.lan]/root: ifconfig -vvm ix2
ix2: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
	description: WAN2
	options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether 00:08:a2:12:e2:c9
	inet6 fe80::208:a2ff:fe12:e2c9%ix2 prefixlen 64 scopeid 0x7
	media: Ethernet autoselect (1000baseT <full-duplex,rxpause,txpause>)
	status: active
	supported media:
		media autoselect
		media 10baseT/UTP
		media 100baseTX
		media 1000baseT
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	drivername: ix2

Though none of the module info is passed to it because it's a combo port.

It too fails to link in the 10G ports:
But it does pass the temp and voltage data:

[24.08-DEVELOPMENT][admin@8200-2.stevew.lan]/root: ifconfig -vvm ix0
ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
	description: WAN3
	options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether 00:08:a2:12:e2:ca
	inet6 fe80::208:a2ff:fe12:e2ca%ix0 prefixlen 64 scopeid 0x5
	media: Ethernet autoselect
	status: no carrier
	supported media:
		media autoselect
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	drivername: ix0
	plugged: SFF 1X Copper Passive (Optical pigtail)
	vendor: UBNT PN: UF-INSTANT SN: UBNTb9999286 DATE: 2014-01-23
	module temperature: 48.00 C voltage: 3.22 Volts
	lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 6.87 mA

seanmcb

@stephenw10 said in Newbie question - is the 6100 directly compatible with this fiber connection?:

Those are the link LEDs and should light if it links to the module.

I've now tried all 4 sfp ports (WAN 1,2,3,4) and there are never any lights illuminated (WAN 1 & 2 seem to have no lights?).

It must show link in the NIC before pppoe will even start trying.

Ah, so I am at square one.

Does it link in WAN1 or WAN2? The GPON module I have for testing does work there:

No carrier in all 4 cases. In fact only in WAN3 does it identify the device at all.

Is there a different Netgate device where this is more likely to work? (I've been testing on a spare 6100 from work, and was going to buy one for home if I can get it working).

I'd be happy to have it work at "just" 1 gigabit.

stephenw10

The combo ports on WAN 1 and 2 use the LEDs on the RJ-45 port when it links. That port can only link at 1G though so I wonder if it's trying to link at 2.5G. Are there any settings available on the module if you boot it in something else?

If you use an external NIC it may provide more options like multiple connection rates. The Intel X550 NIC for example is known to allow 2.5 and 5G. But not necessarily for that module. No real way to know without trying it unfortunately.

seanmcb

I've also found an interesting github repo "All about Nokia G-010S-A GPON SFP".

And from there, patches to pfsense to enable 2.5 gig support in Broadcom drivers.

But again, I'd be happy to have this working at even 1 gig.

seanmcb

@stephenw10 said in Newbie question - is the 6100 directly compatible with this fiber connection?:

The combo ports on WAN 1 and 2 use the LEDs on the RJ-45 port when it links. That port can only link at 1G though so I wonder if it's trying to link at 2.5G. Are there any settings available on the module if you boot it in something else?

Ha, again we post almost simultaneously!

I'll check 1 & 2 again then looking at the RJ-45 lights.

I don't have any other hardware with SFP ports for any other testing.

seanmcb

So I've since found this doc that talks about setting hw.ix.unsupported_sfp=1 and was quite excited, but even after setting this, I still have no lights and "no carrier" in WAN3.

Does this mean any other Intel-based network card will be unlikely to work either?

stephenw10

Not necessarily. It fails to link in ix3 because it's a combo port that can only link at 1G. It's probably either trying to link at 2.5G or trying to link at some fixed rate when the NIC is trying to negotiate.

ix0/1 can only link at 1G or 10G and will use 10G by default.

Did you try setting ix3 to 1G fixed rather than auto-negotiate?

seanmcb

@stephenw10 said in Newbie question - is the 6100 directly compatible with this fiber connection?:

Did you try setting ix3 to 1G fixed rather than auto-negotiate?

No. How do I try that? With the dev.ix.0.advertise_speed sysctl?

stephenw10

No in ix3 there should be speed settings available in the interface config.