Intel Ethernet Controller I225-LM Support?

stephenw10

One of our devs has two of the QNAP cards and reports no issues running full line rate between them for hours using the latest code in FreeBSD. So I suspect we just need to pull that code in somewhere. Not sure where though as it appears to have been in 2.6 for a while now...

bk150

I have 2 separate 1-port LM rev03 QNAP cards. I have been running them for months now on 2.5.2 CE with hardware offloading disabled with no issues.

igc0@pci0:1:0:0:        class=0x020000 card=0xc0011baa chip=0x15f28086 rev=0x03 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Intel(R) Ethernet Controller I225-LM'
    class      = network
    subclass   = ethernet

igc1@pci0:3:0:0:        class=0x020000 card=0xc0011baa chip=0x15f28086 rev=0x03 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Intel(R) Ethernet Controller I225-LM'
    class      = network
    subclass   = ethernet

Here is a speedtest:

alt text

Here is my monitoring for a remote endpoint over a WG tunnel in Chicago:

alt text

lra

@xiazuojie said in Intel Ethernet Controller I225-LM Support?:

@skzs012
It looks like we have the exact same issue, i.e. link goes down with high inbounding traffic while outgoing traffic works fine.

Possibly this could be related to the ethernet flow control setting of the connected device? If the i225 port is connected to a switch, try disabling flow control on that switch port.

skzs012

@lra I tried! But he made the same mistake. I sent the card back today and ordered an I225-V from Amazon 8-10 days to get here. If you arrive then I will report what the situation is!

n1ck31

@stephenw10 said in Intel Ethernet Controller I225-LM Support?:

X710-T2

Are you able to confirm if the X710-T2L will run 2.5G in the latest stable build?

stephenw10

No I don't have any 10Gbase-T NICs to test personally. I only going on what has been reported by others here.

Steve

ndemmon

Heh, so I got back into my project this morning and discovered that when I put it in production with my Verizon home 5G box and I'm actually testing the QNAP card at 2.5Gb, link drops under heavy bursting for me as well.

My professional take:

Same behavior with the latest freeBSD driver
If I force the speed to 1Gb, it works fine
Link drops usually aren't a driver issue, the driver is usually just reporting what the hardware says
Link drops can be initiated on either end of the link. With Steve saying that one of the devs has two of these cards running line rate between them for hours, the problem might be with the Verizon box
It could also be a firmware or cable issue. 2.5GbT is much touchier on cables than 1GbT is, but less touchy than 10GbT.

I'll dig in a little on the link down path in the driver to see if there's anything obvious, and I could probably do some cable swaps and investigate the firmware angle before giving up completely...but I may just run at 1Gb for a while.

ndemmon

~~After 2 more minutes of thinking...the fact that the problem happens when I'm transmitting a burst but not when receiving a burst makes it more likely that the Verizon box is losing lock in its receiver and bouncing link to restore it. When I get to it, my next test would be using my spare 2.5Gb card in server with a mature driver and connect it to the second port of my pfsense card, and leave the first port at 1Gb connected to Verizon.

If I get a good speedtest out of that, the problem should either be the cable or the Verizon box.~~ Edit: Never mind, got my traffic directions turned around in my head.

stephenw10

Mmm, that seems like the opposite of what others were reporting too; link failing under receive load.

ndemmon

@stephenw10

Oh, duh. Ignore last post, got my directions reversed. When speedtest is downloading, the verizon box is transmitting therefore the QNAP card is receiving. Firmware (which drives the signal tuning that occurs on the RX side of the channel) just became a more likely lead.

skzs012

@ndemmon
I sent it back and ordered an I225-V card I wonder if it works with a 2Gb internet connection. Forcing me to drop the connection to 1Gb as well. Now I have 2 wan connections in parallel from ONT so I have 2Gb connection with load balancing. Because of NAT, I want a 2.5Gb network card for a PPPoE connection.

skzs012

Hi!
I got the new Intel I225-V card unfortunately the same situation as before discarding the load

stephenw10

It's a rev b3 chip? I see no issues with the card I have based on that chip.

skzs012

@stephenw10

igc0@pci0:3:0:0:        class=0x020000 card=0x00008086 chip=0x15f38086 rev=0x03 hdr=0x00
   vendor     = 'Intel Corporation'
   device     = 'Intel(R) Ethernet Controller I225-V'
   class      = network
   subclass   = ethernet

stephenw10

Hmm, and you see it actually lose link? What's it connected to?

skzs012

@stephenw10 direct ONT connects to DHCP
Drops the connection at download speed.

stephenw10

Does it drop the link though?

Do you see flow control enabled? ifconfig -v igc0

Can you test against something other than the ONT? I can't replicate that locally.

skzs012

@stephenw10 Unfortunately, I can't test it with any other device.

igc0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
       description: Wan_Prob
       options=e120bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS                                                                                                                     UM,WOL_MAGIC,VLAN_HWFILTER,RXCSUM_IPV6,TXCSUM_IPV6>
       ether 8c:0e:60:9d:a9:ef
       inet6 fe80::8e0e:60ff:fe9d:a9ef%igc0 prefixlen 64 scopeid 0x6
       inet 192.168.0.167 netmask 0xffffff00 broadcast 192.168.0.255
       media: Ethernet autoselect (2500Base-T <full-duplex>)
       status: active
       nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

stephenw10

Ah, well first try disabling checksum offload.

How quickly do you see this? Testing over 10mins between igc NICs here is OK:

[22.01-BETA][admin@6100.stevew.lan]/root: iperf3 -c 192.168.78.10 -P 4 -i 60 -t 600 -R
Connecting to host 192.168.78.10, port 5201
Reverse mode, remote host 192.168.78.10 is sending
[  5] local 192.168.78.1 port 3020 connected to 192.168.78.10 port 5201
[  7] local 192.168.78.1 port 36193 connected to 192.168.78.10 port 5201
[  9] local 192.168.78.1 port 45944 connected to 192.168.78.10 port 5201
[ 11] local 192.168.78.1 port 20231 connected to 192.168.78.10 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-60.00  sec  4.08 GBytes   583 Mbits/sec                  
[  7]   0.00-60.00  sec  4.07 GBytes   583 Mbits/sec                  
[  9]   0.00-60.00  sec  4.07 GBytes   583 Mbits/sec                  
[ 11]   0.00-60.00  sec  4.07 GBytes   583 Mbits/sec                  
[SUM]   0.00-60.00  sec  16.3 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5]  60.00-120.00 sec  4.06 GBytes   582 Mbits/sec                  
[  7]  60.00-120.00 sec  4.06 GBytes   582 Mbits/sec                  
[  9]  60.00-120.00 sec  4.06 GBytes   581 Mbits/sec                  
[ 11]  60.00-120.00 sec  4.06 GBytes   581 Mbits/sec                  
[SUM]  60.00-120.00 sec  16.2 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 120.00-180.00 sec  4.07 GBytes   583 Mbits/sec                  
[  7] 120.00-180.00 sec  4.07 GBytes   583 Mbits/sec                  
[  9] 120.00-180.00 sec  4.07 GBytes   582 Mbits/sec                  
[ 11] 120.00-180.00 sec  4.07 GBytes   582 Mbits/sec                  
[SUM] 120.00-180.00 sec  16.3 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 180.00-240.00 sec  4.07 GBytes   582 Mbits/sec                  
[  7] 180.00-240.00 sec  4.07 GBytes   582 Mbits/sec                  
[  9] 180.00-240.00 sec  4.06 GBytes   582 Mbits/sec                  
[ 11] 180.00-240.00 sec  4.07 GBytes   582 Mbits/sec                  
[SUM] 180.00-240.00 sec  16.3 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 240.00-300.00 sec  4.08 GBytes   584 Mbits/sec                  
[  7] 240.00-300.00 sec  4.08 GBytes   584 Mbits/sec                  
[  9] 240.00-300.00 sec  4.08 GBytes   584 Mbits/sec                  
[ 11] 240.00-300.00 sec  4.08 GBytes   584 Mbits/sec                  
[SUM] 240.00-300.00 sec  16.3 GBytes  2.34 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 300.00-360.00 sec  4.07 GBytes   582 Mbits/sec                  
[  7] 300.00-360.00 sec  4.07 GBytes   582 Mbits/sec                  
[  9] 300.00-360.00 sec  4.06 GBytes   582 Mbits/sec                  
[ 11] 300.00-360.00 sec  4.06 GBytes   582 Mbits/sec                  
[SUM] 300.00-360.00 sec  16.3 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 360.00-420.00 sec  4.07 GBytes   582 Mbits/sec                  
[  7] 360.00-420.00 sec  4.07 GBytes   583 Mbits/sec                  
[  9] 360.00-420.00 sec  4.06 GBytes   582 Mbits/sec                  
[ 11] 360.00-420.00 sec  4.07 GBytes   582 Mbits/sec                  
[SUM] 360.00-420.00 sec  16.3 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 420.00-480.00 sec  4.08 GBytes   585 Mbits/sec                  
[  7] 420.00-480.00 sec  4.08 GBytes   585 Mbits/sec                  
[  9] 420.00-480.00 sec  4.08 GBytes   584 Mbits/sec                  
[ 11] 420.00-480.00 sec  4.08 GBytes   584 Mbits/sec                  
[SUM] 420.00-480.00 sec  16.3 GBytes  2.34 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 480.00-540.00 sec  4.08 GBytes   584 Mbits/sec                  
[  7] 480.00-540.00 sec  4.07 GBytes   583 Mbits/sec                  
[  9] 480.00-540.00 sec  4.07 GBytes   583 Mbits/sec                  
[ 11] 480.00-540.00 sec  4.07 GBytes   583 Mbits/sec                  
[SUM] 480.00-540.00 sec  16.3 GBytes  2.33 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[  5] 540.00-600.00 sec  4.08 GBytes   584 Mbits/sec                  
[  7] 540.00-600.00 sec  4.08 GBytes   584 Mbits/sec                  
[  9] 540.00-600.00 sec  4.08 GBytes   584 Mbits/sec                  
[ 11] 540.00-600.00 sec  4.08 GBytes   584 Mbits/sec                  
[SUM] 540.00-600.00 sec  16.3 GBytes  2.34 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-600.00 sec  40.7 GBytes   583 Mbits/sec    0             sender
[  5]   0.00-600.00 sec  40.7 GBytes   583 Mbits/sec                  receiver
[  7]   0.00-600.00 sec  40.7 GBytes   583 Mbits/sec    0             sender
[  7]   0.00-600.00 sec  40.7 GBytes   583 Mbits/sec                  receiver
[  9]   0.00-600.00 sec  40.7 GBytes   582 Mbits/sec    0             sender
[  9]   0.00-600.00 sec  40.7 GBytes   582 Mbits/sec                  receiver
[ 11]   0.00-600.00 sec  40.7 GBytes   583 Mbits/sec    0             sender
[ 11]   0.00-600.00 sec  40.7 GBytes   583 Mbits/sec                  receiver
[SUM]   0.00-600.00 sec   163 GBytes  2.33 Gbits/sec    0             sender
[SUM]   0.00-600.00 sec   163 GBytes  2.33 Gbits/sec                  receiver

iperf Done.

Steve

skzs012

@stephenw10 do you mean that? dev.igc.0.fc=0
Unfortunately I can't do an Iperf test because there is no device on ONT but PfSense