XG-7100 SFP to Adtran 5660 CenturyLink CPE



  • Re: SFP incompatibility on Netgate XG-7100

    I'm having this exact issue. I want a fiber handoff from the CTL CPE Adtran to my XG-7100. I've tried multiple SFP modules including Ubiquiti, Cisco and Ciena. I can connect and pass traffic from my XG-7100 to a Ubiquiti switch and to a Ciena router.

    However, I when I connect to an Adtran 5660 it will show a connection on the PfSense side but show "DOWN DOWN" on the Adtran side. I worked with CTL techs for hours with no success. It may well be an issue with the Adtran. I've even swapped the SFP modules on the Adtran uplink and they work just fine whatever combination I use. Anyone else have this issue?

    Here is the output from the connection to the Adtran. It looks like it should be working.

    ifconfig -vvvvv ix0
    ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
            options=e400bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
            ether 00:08:a2:01:02:03
            hwaddr 00:08:a2:01:02:03
            inet6 fe80::208:::0%ix0 prefixlen 64 scopeid 0x1
            inet 3.2.1.218 netmask 0xfffffff8 broadcast 3.2.1.223
            nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
            media: Ethernet autoselect (1000baseSX <full-duplex,rxpause,txpause>)
            status: active
            plugged: SFP/SFP+/SFP28 1000BASE-SX (LC)
            vendor: UBNT PN: UF-MM-1G SN: FT123456789 DATE: 2019-05-17
            module temperature: 29.43 C Voltage: 3.25 Volts
            RX: 0.23 mW (-6.31 dBm) TX: 0.26 mW (-5.84 dBm)
    
            SFF8472 DUMP (0xA0 0..127 range):
            03 04 07 00 00 00 01 00 00 00 00 01 0D 00 00 00
            37 37 00 00 55 42 4E 54 20 20 20 20 20 20 20 20
            20 20 20 20 00 00 00 00 55 46 2D 4D 4D 2D 31 47
            20 20 20 20 20 20 20 20 20 20 20 20 03 52 00 20
            00 0A 00 00 46 54 31 39 30 35 31 37 30 33 36 33
            38 20 20 20 31 39 30 35 31 37 00 00 68 90 01 6F
            20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
            20 20 20 20 20 20 20 20 20 20 20 20 20 20 20 20
    

    I'm running PfSense 2.4.5

    Jake


  • Netgate Administrator

    The first thing to try there, of you have not already, is to set ix0 to a fixed speed and duplex at 1000-SX.

    Steve



  • I did try that. CTL also set that on the Adtran.


  • Netgate Administrator

    Hmm, hard to see how it can show as receiving signal and negotiate a speed if the other end never shows as UP.
    Are they looking at the right port? 😕
    Not sure what we can do there...

    Steve



  • I doubt this is it but have you tried a crossover cable? (just to rule that out)

    Is it possible the interface on the Adtran is just bad? Ive had a couple of failures myself with a couple of their decks over the years. If their supplied equipment is not new it should be suspect. Sometimes Centurylink equipment has been in some bad places. Will the interface show up if connected to your switch directly?



  • Just tossing this out....

    I don't know what an Intel x553 [which is what's being identified in the XG-7100] is but when I worked at Cisco we sold Intel x520's in the servers. You must use a supported SFP module to get these to work.

    https://www.intel.com/content/www/us/en/support/articles/000005528/network-and-i-o/ethernet-products.html

    A fair a mount of customers had been displease that our own Cisco SFP did not work - go figure. This is not the case with the Intel x710 line.

    I'm wondering if you used a passive twinax to connect the devices if it would work. If it does you know you have a SFP adapter issue.

    Thanks,


  • Netgate Administrator

    We have certainly seen unsupported modules but usually the driver rejects them outright when that happens.

    I've never seen one detect the module and show it capabilities and even auto-negotiate a link at the correct and still not pass traffic as we're seeing here. 😕



  • @chpalmer Good question. CTL sent out replacement for the new Adtran and it has the same problem. I thought maybe the Adtran SFP port wasn't turned up but when I use the exact same SFP module and plug it into my Unifi switch it comes up on both sides just fine. The port on the Adtran is a combo port and the copper side works just fine with a copper port on the XG-7100.



  • @gordon_cents I agree as that is what I thought initially but when I move the SFP module from the XG-7100 to to my Unifi switch using SFP it works fine. The Adtran and the Unifi switch connect fine. I'm very confused. CTL has tried to help but I think the vendor, Adtran, needs to get involved to dig deeper.



  • @stephenw10 It's really perplexing. I may have not mentioned that using the exact same SFP modules I moved the connection from the Adtran to my Unifi switch. Set pfSense to DHCP on the ix0 interface and had connectivity to the switch and was passing data.

    Question: I'm thinking of trying out 2.5 (which, you know is based on FreeBSD 12) just to see if it fixes this. Do you think that's a good idea?



  • @jake said in XG-7100 SFP to Adtran 5660 CenturyLink CPE:

    Adtran 5660

    Maybe some sort of spanning tree issue? Can you provide a Network Diagram? I know when I make multiple connections to a ISP using different equipment, but using virtual interfaces on my side I have to increment the MAC address otherwise I won't pull a IP address. Do you have access to the Adtran's CLI (Just a shot in the dark) it is very similar to Cisco. Could give us a clue as to what is going on.


  • Netgate Administrator

    @jake said in XG-7100 SFP to Adtran 5660 CenturyLink CPE:

    I'm thinking of trying out 2.5 (which, you know is based on FreeBSD 12) just to see if it fixes this. Do you think that's a good idea?

    If you're able to test it then, yes, it does have newer drivers. Bare in mind though that you cannot downgrade easily. You would have to re-install 2.4.5 and you would need a 2.4.5 config to restore into it so be sure to back that up before you upgrade to 2.5.

    Steve



  • @mikeisfly Not sure if it's a STP issue. The network is really basic from the ISP side we only have a single provider. Basically:

    Centurylink Fiber -> CPE Cienna -> CPE Adtran -> XG-7100
    (CPE meaning Customer Premise Equipment owned and managed by the Telco)

    We are just upgrading speeds from 100 mb to 1000 mb. As part of that they sent a new Adtran router (exact same model, don't ask me why) We will disconnect the old Adtran when the new service is turned up.

    The ISP IPs are static. Unfortunately, I don't have access to the Adtran as it's CenturyLink's


  • Netgate Administrator

    Hmm, so presumably if you connected it via the switch it would work?



  • @jake said in XG-7100 SFP to Adtran 5660 CenturyLink CPE:

    @mikeisfly Not sure if it's a STP issue. The network is really basic from the ISP side we only have a single provider. Basically:

    Centurylink Fiber -> CPE Cienna -> CPE Adtran -> XG-7100
    (CPE meaning Customer Premise Equipment owned and managed by the Telco)

    We are just upgrading speeds from 100 mb to 1000 mb. As part of that they sent a new Adtran router (exact same model, don't ask me why) We will disconnect the old Adtran when the new service is turned up.

    The ISP IPs are static. Unfortunately, I don't have access to the Adtran as it's CenturyLink's

    I'm familiar with both pieces of equipment as I use to work for Comcast. Do you have a EDI (Ethernet Dedicated Internet) connections as well as a PRI circuit? Why are you using the Adtran? I know they tell you what you need just trying to get an idea of the services they are providing you. If you are getting Ethernet services the Ciena Switch (probably a 3916) is more than capable. Typically what we would do at Comcast if you were getting a 500 Mbps symmetrical connection (Internet Services) with a PRI circuit, the customer hand off port for the Internet connection would be port 1 of the Ciena while Port 2 of the Ciena would feed your Adtran and the customer would connect their PBX to the T1 port.



  • @stephenw10 I had that thought also. I'm not sure the right way to configure the Unifi switch. Would a LAGG setup with those two ports work or would port mirroring better? I don't think there is a layer 2 bridge option or is that just port mirroring?



  • @mikeisfly We do have an "EDI" ( in Comcast terms) :) I've done lots of Comcast fiber EDI's, EPL's and ENS's lately for clients. They work great on the CPE Junipers with handoffs to an Adtran doing PRI or SIP signaling. I haven't done a fiber handoff with SFPs on a XG-7100 yet with Comcast's Junipers. Have you done so?

    Sorry, back on topic. Since directly to the Ciena works fine I thought that too. CTL tells me they are blind without the Adtran device. They use it to do remote management and diagnostics. Also, we have CTL SIP trunks that are handed off from the Adtran and it also acts as a SBC and provides QOS. Data is one port and another port is SIP on the Adtran.

    I guess, could bring it up as a work around as you stated. I like that idea. Go with a direct handoff from the Ciena for data and the other port on the Ciena for SIP trunks via the Adtran.


  • Netgate Administrator

    You shouldn't need to lagg, mirror or bridge. The ports just need to be switched, in the same layer 2 segment internally.

    So add them both as access ports on a separate VLAN for example.

    Steve



  • @stephenw10 Following your suggestion I was able to "bridge," by making a new VLAN assigned to both ports, the fiber connection through my Unifi switch.

    I also updated the firewall to the latest development build but it didn't change anything. Thanks for everyone's help.



  • @jake said in XG-7100 SFP to Adtran 5660 CenturyLink CPE:

    @mikeisfly We do have an "EDI" ( in Comcast terms) :) I've done lots of Comcast fiber EDI's, EPL's and ENS's lately for clients. They work great on the CPE Junipers with handoffs to an Adtran doing PRI or SIP signaling. I haven't done a fiber handoff with SFPs on a XG-7100 yet with Comcast's Junipers. Have you done so?

    Sorry, back on topic. Since directly to the Ciena works fine I thought that too. CTL tells me they are blind without the Adtran device. They use it to do remote management and diagnostics. Also, we have CTL SIP trunks that are handed off from the Adtran and it also acts as a SBC and provides QOS. Data is one port and another port is SIP on the Adtran.

    I guess, could bring it up as a work around as you stated. I like that idea. Go with a direct handoff from the Ciena for data and the other port on the Ciena for SIP trunks via the Adtran.

    I personally haven't done it as I use to train the guys that would go out and do the installs but with the setup I had in my lab PfSense was always rock solid. I only had a 1Gbps symmetrical connection. I had several Adtrans as well but I only used them for PRI circuits so the guys could practice connecting the a PBX system. Ciena has a oob telnet server in it as well as a remote management VLAN for remote monitoring and such so I'm not sure why Century Link is not using that, but I don't want to get off topic for your specific problem.


  • Netgate Administrator

    Ah, glad you were able to get something up and running. Still unclear why that was required though.

    Steve


Log in to reply