Cisco 3850 10G Switch

scott9041

I am attempting to move my LAN port from a 1G link to a 10G link.

I have a Cisco 3850 switch and a Netgate 6100. I have attempted to connect them via a 10Gtek (ASF-100-T80) and a FINISAR (FTLX8574D3BCL) on both sides of the link.

I currently have my main computer attached to the switch via the above 10Gtek, and it works great. Similarly, I have the above 10Gtek connecting the ISP fiber ONT/ONU to the firewall. It runs at 10G with no problem.

It is only when I attempt to connect the switch to the firewall that I encounter issues. It does not pass traffic, but it appears that is passing traffic (activity lights).

Thank you in advance. Any assistance would be greatly appreciated.

stephenw10

Which port are you using on the 6100?

Do you have it set to a fixed rate or autoselect? Does it offer fixed speeds? I would expect the Finisar fiber module to be more likely to work.

scott9041

Stephen,

Thanks for the reply. I do not set a speed on either side of the link.

On the Cisco, I use the four port 10G SFP uplink module. The four port uplink module is 10G only, regardless of the type of SFP (10G copper or 10G fiber).

stephenw10

So on the 6100 ports ix0 or ix1 should support 10G.

What do you see if you run: ifconfig -vvvm ix0

Or ix1 if that's what you're using.

scott9041

Stephen,

It is ix1. Here is the ifconfig output:

ix1: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
        description: 10GLAN
        options=4e138bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
        capabilities=4f53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
        ether 90:ec:77:1b:6b:97
        inet6 fe80::92ec:77ff:fe1b:6b97%ix1 prefixlen 64 scopeid 0x6
        media: Ethernet autoselect (10Gbase-SR <full-duplex,rxpause,txpause>)
        status: active
        supported media:
                media autoselect
                media 10Gbase-SR
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        drivername: ix1
        plugged: SFP/SFP+/SFP28 10G Base-SR (LC)
        vendor: CISCO-AVAGO PN: SFBR-7700SDZ-CS2 SN: AGD13163253 DATE: 2009-04-17
        module temperature: 56.09 C voltage: 3.30 Volts
        lane 1: RX power: 0.51 mW (-2.96 dBm) TX bias: 5.84 mA

        SFF8472 DUMP (0xA0 0..127 range):
         03 04 07 10 00 00 00 00 00 00 00 06 67 00 00 00
         08 02 00 1e 43 49 53 43 4f 2d 41 56 41 47 4f 20
         20 20 20 20 00 00 17 6a 53 46 42 52 2d 37 37 30
         30 53 44 5a 2d 43 53 32 42 35 20 20 03 52 00 fa
         00 1a 00 00 41 47 44 31 33 31 36 33 32 35 33 20
         20 20 20 20 30 39 30 34 31 37 20 20 68 f0 03 ee
         00 00 06 e8 f8 9a 2b 8f 55 8d 22 87 ab b2 b2 6f
         1c 4e 42 00 00 00 00 00 00 00 00 00 b7 cf 04 c1

Thanks!

stephenw10

Ok so it sees the module and signal on the fiber and is linked and UP.

It's not either of the modules you mentioned though, did you try a different one?
vendor: CISCO-AVAGO PN: SFBR-7700SDZ-CS2

It has no IP addresses. Is that supposed to be pulling IPs via DHCP?

scott9041

Stephen,

Somehow the Netgate is picking up the four port module that is plugged into the my Cisco switch. The current SFP units that are plugged into the switch and Netgate are the FINISAR (FTLX8574D3BCL).

What happens is this. When I delete my internal network, DHCP, etc on the LAN1 and disable LAN1, then put the same information on ix1, it won’t pass traffic.

stephenw10

Are you sure you are connected to ix1 and not ix0?

They are not in the expected order on the 6100:
https://docs.netgate.com/pfsense/en/latest/solutions/netgate-6100/io-ports.html#networking-ports

WAN3 is ix0 and WAN4 is ix1.

The LAN should normally have a static IP and it's not showing the ifconfig output.

scott9041

@stephenw10 said in Cisco 3850 10G Switch:

Are you sure you are connected to ix1 and not ix0? YES

They are not in the expected order on the 6100:
https://docs.netgate.com/pfsense/en/latest/solutions/netgate-6100/io-ports.html#networking-ports

WAN3 is ix0 and WAN4 is ix1.

The LAN should normally have a static IP and it's not showing the ifconfig output. **I AM TRYING TO MOVE MY INTERNAL NETWORK (192.168.x.x) FROM LAN PORT 1 TO ix1. WOULD YOU LIKE ME TO PUT AN IP ix1? Thanks for all your assistance! **

stephenw10

You should just be able to reassign LAN from igc0 to ix1. All the settings on it currently will still apply.

I expect the LAN to have IP so it should appear on that interface but it's possible you're not using a static LAN?

scott9041

Yes. I use a static IP for both LAN and WAN. I will try changing the LAN interface to the fiber connection and see if that works. Thanks!

scott9041

Stephen,

I was able to move the interface to the 10G port. Thanks for all of your help and pointing me in the right direction.

Scott