Intel E810 in errors (rx_length_errors) on untagged VLAN of trunked port

Louis89 · Jul 27, 2024, 6:45 AM

I have a pfSense 24.03 install connecting to all LANs via a single VLAN trunk through a single port of an Intel E810 adapter. The curiosity is that I see a high "In Error" count that continuously increases only on the untagged VLAN of this trunk port, all errors show as "rx_length_errors". All other tagged VLAN interfaces on this port do not show any errors. I have not identified any issues with the untagged VLAN network as a result of these errors. The switch that this adapter is connected to does not show any errors. The E810 is running the latest firmware from Intel and an "ice" driver compiled from Intel's latest source.
I have a similar setup at three other sites, but trunking over "ix", "igb", and "mvneta" adapters. I've never seen "in errors" like this with any of those systems.

Since the errors don't appear to be causing any real problems, I'm not too concerned. But I'm curious if anyone else has seen behavior like this and might know more about what exactly is happening. One thought I had was that maybe the tagged traffic on the trunk is not being filtered out on the untagged interface leading to "rx_length_errors". It's ideal that the tagged packets are being dropped on the untagged interface, but it leads to an ugly error counter on the interface statistics. Maybe it's due to something funny with how the pfSense/BSD driver for the E810 deals with VLAN tag filtering? Or could this be causing some real problem I haven't realized yet?

keyser · Jul 27, 2024, 6:45 AM

@Louis89 I don’t think your theory is correct.
It is much more likely that you have something on your native LAN sending jumbo sized frames (larger that 1500 data bytes on the ethernet layer).

Louis89 · Jul 28, 2024, 4:23 PM

@keyser I agree, but the switch and the E810 port both report an MTU setting of 1500. All the ports on the switch report an MTU of 1500, but no errors on any of the switch ports. I also tried swapping out the machine running pfSense on the same network with one that uses an "ix" adapter instead, no errors with the "ix" adapter. It is quite odd, I'm not sure what I'm missing...

stephenw10 · Jul 29, 2024, 2:58 PM

Is untagged traffic actually used there? Is the switch configured to send untagged traffic on that port if not?

Louis89 · Aug 5, 2024, 3:52 AM

@stephenw10 Yes, untagged traffic is being used on this port. The switch is configured to send VLAN 1 as untagged traffic.

Following are the interface stats for the switch port connected to ice, and pfSense for the untagged ice interface showing In errors. The interface hasn't been up for long so counts are low, but the In error (rx_length_errors) count on this one interface in pfSense continuously increases. I hope it is helpful.
Switch:

100GigabitEthernet1/2/2 is up, line protocol is up
  Port up for 25 minute(s) 57 second(s)
  Hardware is 100GigabitEthernet, address is XXXX.XXXX.XXXX (bia XXXX.XXXX.XXXX)
  Interface type is 100 Gig Fiber
  Configured speed optic-based, actual 100Gbit, configured duplex fdx, actual fdx
  Configured FEC on, actual on
  Configured mdi mode AUTO, actual MDI
  Tagged member of 7 L2 VLANs, untagged in VLAN 1, port state is FORWARDING
  BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled
  Link Error Dampening is Disabled
  STP configured to ON, priority is level0, mac-learning is enabled
  MACsec is Disabled
  Flow Control is config enabled, oper enabled, negotiation disabled
  Mirror disabled, Monitor disabled
  Mac-notification is disabled
  VLAN-Mapping is disabled
  Not member of any active trunks
  Not member of any configured trunks
  No port name
  IPG MII 96 bits-time, IPG GMII 96 bits-time
  MTU 1500 bytes
  MMU Mode is Store-and-forward
  300 second input rate: 302720 bits/sec, 328 packets/sec, 0.00% utilization
  300 second output rate: 6938752 bits/sec, 627 packets/sec, 0.00% utilization
  7445521 packets input, 7154424994 bytes, 0 no buffer
  Received 295 broadcasts, 553 multicasts, 7444673 unicasts
  0 input errors, 0 CRC, 0 frame, 0 ignored
  0 runts, 0 giants
  6851608 packets output, 7397758203 bytes, 0 underruns
  Transmitted 2560 broadcasts, 11508 multicasts, 6837540 unicasts
  0 output errors, 0 collisions
  Relay Agent Information option: Disabled
  Protected: No
  MAC Port Security: Disabled

UC Egress queues:
Queue counters      Queued packets    Dropped Packets
         0             6834052                   0
         1                   0                   0
         2                   0                   0
         3                   0                   0
         4                 953                   0
         5                 297                   0
         6                   0                   0
         7                6274                   0
         8                   0                   0


MC Egress queues:
Queue counters    Queued packets    Dropped Packets
         0                6329                   0
         1                   0                   0
         2                   0                   0
         3                   0                   0
         4                2827                   0
         5                 878                   0
         6                   0                   0
         7                   0                   0
         8                   0                   0
         9                   0                   0

Oversubscribed ingress drop counters:
High priority drop                     0
Low priority drop                     0
Total drop                             0

pfSense:

dev.ice.0.hw.mac.remote_faults: 0
dev.ice.0.hw.mac.local_faults: 0
dev.ice.0.hw.mac.illegal_bytes: 0
dev.ice.0.hw.mac.crc_errors: 0
dev.ice.0.hw.mac.xoff_recvd: 0
dev.ice.0.hw.mac.xoff_txd: 956
dev.ice.0.hw.mac.xon_recvd: 0
dev.ice.0.hw.mac.xon_txd: 1
dev.ice.0.hw.mac.tx_dropped: 0
dev.ice.0.hw.mac.tx_frames_big: 0
dev.ice.0.hw.mac.tx_frames_1024_1522: 26410755
dev.ice.0.hw.mac.tx_frames_512_1023: 116028
dev.ice.0.hw.mac.tx_frames_256_511: 248774
dev.ice.0.hw.mac.tx_frames_128_255: 223537
dev.ice.0.hw.mac.tx_frames_65_127: 2966972
dev.ice.0.hw.mac.tx_frames_64: 127055
dev.ice.0.hw.mac.rx_discards: 0
dev.ice.0.hw.mac.rx_length_errors: 80819
dev.ice.0.hw.mac.rx_jabber: 0
dev.ice.0.hw.mac.rx_oversized: 0
dev.ice.0.hw.mac.rx_fragmented: 0
dev.ice.0.hw.mac.rx_undersize: 0
dev.ice.0.hw.mac.rx_frames_big: 0
dev.ice.0.hw.mac.rx_frames_1024_1522: 7604799
dev.ice.0.hw.mac.rx_frames_512_1023: 222828
dev.ice.0.hw.mac.rx_frames_256_511: 367921
dev.ice.0.hw.mac.rx_frames_128_255: 438290
dev.ice.0.hw.mac.rx_frames_65_127: 4388773
dev.ice.0.hw.mac.rx_frames_64: 39925
dev.ice.0.hw.mac.p_xon2xoff.7: 0
dev.ice.0.hw.mac.p_xon2xoff.6: 0
dev.ice.0.hw.mac.p_xon2xoff.5: 0
dev.ice.0.hw.mac.p_xon2xoff.4: 0
dev.ice.0.hw.mac.p_xon2xoff.3: 0
dev.ice.0.hw.mac.p_xon2xoff.2: 0
dev.ice.0.hw.mac.p_xon2xoff.1: 0
dev.ice.0.hw.mac.p_xon2xoff.0: 0
dev.ice.0.hw.mac.p_xoff_txd.7: 0
dev.ice.0.hw.mac.p_xoff_txd.6: 0
dev.ice.0.hw.mac.p_xoff_txd.5: 0
dev.ice.0.hw.mac.p_xoff_txd.4: 0
dev.ice.0.hw.mac.p_xoff_txd.3: 0
dev.ice.0.hw.mac.p_xoff_txd.2: 0
dev.ice.0.hw.mac.p_xoff_txd.1: 0
dev.ice.0.hw.mac.p_xoff_txd.0: 0
dev.ice.0.hw.mac.p_xon_txd.7: 0
dev.ice.0.hw.mac.p_xon_txd.6: 0
dev.ice.0.hw.mac.p_xon_txd.5: 0
dev.ice.0.hw.mac.p_xon_txd.4: 0
dev.ice.0.hw.mac.p_xon_txd.3: 0
dev.ice.0.hw.mac.p_xon_txd.2: 0
dev.ice.0.hw.mac.p_xon_txd.1: 0
dev.ice.0.hw.mac.p_xon_txd.0: 0
dev.ice.0.hw.mac.p_xoff_recvd.7: 0
dev.ice.0.hw.mac.p_xoff_recvd.6: 0
dev.ice.0.hw.mac.p_xoff_recvd.5: 0
dev.ice.0.hw.mac.p_xoff_recvd.4: 0
dev.ice.0.hw.mac.p_xoff_recvd.3: 0
dev.ice.0.hw.mac.p_xoff_recvd.2: 0
dev.ice.0.hw.mac.p_xoff_recvd.1: 0
dev.ice.0.hw.mac.p_xoff_recvd.0: 0
dev.ice.0.hw.mac.p_xon_recvd.7: 0
dev.ice.0.hw.mac.p_xon_recvd.6: 0
dev.ice.0.hw.mac.p_xon_recvd.5: 0
dev.ice.0.hw.mac.p_xon_recvd.4: 0
dev.ice.0.hw.mac.p_xon_recvd.3: 0
dev.ice.0.hw.mac.p_xon_recvd.2: 0
dev.ice.0.hw.mac.p_xon_recvd.1: 0
dev.ice.0.hw.mac.p_xon_recvd.0: 0
dev.ice.0.hw.mac.bcast_pkts_txd: 3619
dev.ice.0.hw.mac.mcast_pkts_txd: 2026
dev.ice.0.hw.mac.ucast_pkts_txd: 30087476
dev.ice.0.hw.mac.good_octets_txd: 39786553129
dev.ice.0.hw.mac.bcast_pkts_rcvd: 41573
dev.ice.0.hw.mac.mcast_pkts_rcvd: 78153
dev.ice.0.hw.mac.ucast_pkts_rcvd: 12942810
dev.ice.0.hw.mac.good_octets_rcvd: 11180746288
dev.ice.0.dscp2tc_map.56-63: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.48-55: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.40-47: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.32-39: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.24-31: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.16-23: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.8-15: 0,0,0,0,0,0,0,0
dev.ice.0.dscp2tc_map.0-7: 0,0,0,0,0,0,0,0
dev.ice.0.link_active_on_if_down: 1
dev.ice.0.allow_no_fec_modules_in_auto: 0
dev.ice.0.pfc_mode: 0
dev.ice.0.pfc: 0
dev.ice.0.up2tc_map: 0,0,0,0,0,0,0,0
dev.ice.0.ets_min_rate: 100,0,0,0,0,0,0,0
dev.ice.0.fw_lldp_agent: 0
dev.ice.0.advertise_speed: 1696
dev.ice.0.fc: 3<Full>
dev.ice.0.negotiated_fec: RS-FEC
dev.ice.0.requested_fec: RS-FEC
dev.ice.0.current_speed: 100 Gbps
dev.ice.0.ddp_version: ICE OS Default Package version 1.3.36.0, track id 0xc0000001
dev.ice.0.temp: 63
dev.ice.0.pba_number: K91258-000
dev.ice.0.fw_version: fw 7.5.4 api 1.7 nvm 4.50 etid 8001d8b6 netlist 4.3.2000-3.25.0.a2703c1c oem 1.3597.0
dev.ice.0.vsi.0.sw.cso.rx_l4_err: 0
dev.ice.0.vsi.0.sw.cso.rx_sctp_err: 0
dev.ice.0.vsi.0.sw.cso.rx_udp_err: 0
dev.ice.0.vsi.0.sw.cso.rx_tcp_err: 0
dev.ice.0.vsi.0.sw.cso.rx_l3_err: 0
dev.ice.0.vsi.0.sw.cso.rx_ip6_err: 0
dev.ice.0.vsi.0.sw.cso.rx_ip4_err: 0
dev.ice.0.vsi.0.sw.cso.tx_l4_err: 0
dev.ice.0.vsi.0.sw.cso.tx_l3_err: 0
dev.ice.0.vsi.0.sw.cso.tx_ip6: 28246
dev.ice.0.vsi.0.sw.cso.tx_ip4: 21423464
dev.ice.0.vsi.0.sw.cso.tx_sctp: 0
dev.ice.0.vsi.0.sw.cso.tx_udp: 50955
dev.ice.0.vsi.0.sw.cso.tx_tcp: 903
dev.ice.0.vsi.0.hw.tx_errors: 0
dev.ice.0.vsi.0.hw.rx_no_desc: 0
dev.ice.0.vsi.0.hw.rx_errors: 80819
dev.ice.0.vsi.0.hw.rx_discards: 0
dev.ice.0.vsi.0.hw.bcast_pkts_txd: 3619
dev.ice.0.vsi.0.hw.mcast_pkts_txd: 2026
dev.ice.0.vsi.0.hw.ucast_pkts_txd: 30087476
dev.ice.0.vsi.0.hw.good_octets_txd: 39666180645
dev.ice.0.vsi.0.hw.bcast_pkts_rcvd: 41573
dev.ice.0.vsi.0.hw.mcast_pkts_rcvd: 13587
dev.ice.0.vsi.0.hw.ucast_pkts_rcvd: 12938852
dev.ice.0.vsi.0.hw.good_octets_rcvd: 11167514355
dev.ice.0.vsi.0.rxqs.15.tc: 0
dev.ice.0.vsi.0.rxqs.15.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.15.rx_bytes: 882905680
dev.ice.0.vsi.0.rxqs.15.rx_packets: 1055875
dev.ice.0.vsi.0.rxqs.14.tc: 0
dev.ice.0.vsi.0.rxqs.14.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.14.rx_bytes: 258123337
dev.ice.0.vsi.0.rxqs.14.rx_packets: 572700
dev.ice.0.vsi.0.rxqs.13.tc: 0
dev.ice.0.vsi.0.rxqs.13.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.13.rx_bytes: 705005746
dev.ice.0.vsi.0.rxqs.13.rx_packets: 806158
dev.ice.0.vsi.0.rxqs.12.tc: 0
dev.ice.0.vsi.0.rxqs.12.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.12.rx_bytes: 1408111633
dev.ice.0.vsi.0.rxqs.12.rx_packets: 1446943
dev.ice.0.vsi.0.rxqs.11.tc: 0
dev.ice.0.vsi.0.rxqs.11.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.11.rx_bytes: 630359670
dev.ice.0.vsi.0.rxqs.11.rx_packets: 796073
dev.ice.0.vsi.0.rxqs.10.tc: 0
dev.ice.0.vsi.0.rxqs.10.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.10.rx_bytes: 133811946
dev.ice.0.vsi.0.rxqs.10.rx_packets: 394220
dev.ice.0.vsi.0.rxqs.9.tc: 0
dev.ice.0.vsi.0.rxqs.9.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.9.rx_bytes: 748382695
dev.ice.0.vsi.0.rxqs.9.rx_packets: 792313
dev.ice.0.vsi.0.rxqs.8.tc: 0
dev.ice.0.vsi.0.rxqs.8.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.8.rx_bytes: 520032859
dev.ice.0.vsi.0.rxqs.8.rx_packets: 723884
dev.ice.0.vsi.0.rxqs.7.tc: 0
dev.ice.0.vsi.0.rxqs.7.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.7.rx_bytes: 1301408957
dev.ice.0.vsi.0.rxqs.7.rx_packets: 1139247
dev.ice.0.vsi.0.rxqs.6.tc: 0
dev.ice.0.vsi.0.rxqs.6.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.6.rx_bytes: 657357668
dev.ice.0.vsi.0.rxqs.6.rx_packets: 804895
dev.ice.0.vsi.0.rxqs.5.tc: 0
dev.ice.0.vsi.0.rxqs.5.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.5.rx_bytes: 1214393647
dev.ice.0.vsi.0.rxqs.5.rx_packets: 1152397
dev.ice.0.vsi.0.rxqs.4.tc: 0
dev.ice.0.vsi.0.rxqs.4.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.4.rx_bytes: 849780262
dev.ice.0.vsi.0.rxqs.4.rx_packets: 1007090
dev.ice.0.vsi.0.rxqs.3.tc: 0
dev.ice.0.vsi.0.rxqs.3.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.3.rx_bytes: 692483385
dev.ice.0.vsi.0.rxqs.3.rx_packets: 959926
dev.ice.0.vsi.0.rxqs.2.tc: 0
dev.ice.0.vsi.0.rxqs.2.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.2.rx_bytes: 733654339
dev.ice.0.vsi.0.rxqs.2.rx_packets: 637115
dev.ice.0.vsi.0.rxqs.1.tc: 0
dev.ice.0.vsi.0.rxqs.1.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.1.rx_bytes: 246293420
dev.ice.0.vsi.0.rxqs.1.rx_packets: 298219
dev.ice.0.vsi.0.rxqs.0.tc: 0
dev.ice.0.vsi.0.rxqs.0.rx_desc_errs: 0
dev.ice.0.vsi.0.rxqs.0.rx_bytes: 133434642
dev.ice.0.vsi.0.rxqs.0.rx_packets: 406969
dev.ice.0.vsi.0.txqs.15.tc: 0
dev.ice.0.vsi.0.txqs.15.mss_too_small: 0
dev.ice.0.vsi.0.txqs.15.tx_bytes: 5009863414
dev.ice.0.vsi.0.txqs.15.tx_packets: 3553266
dev.ice.0.vsi.0.txqs.14.tc: 0
dev.ice.0.vsi.0.txqs.14.mss_too_small: 0
dev.ice.0.vsi.0.txqs.14.tx_bytes: 3269769756
dev.ice.0.vsi.0.txqs.14.tx_packets: 2472339
dev.ice.0.vsi.0.txqs.13.tc: 0
dev.ice.0.vsi.0.txqs.13.mss_too_small: 0
dev.ice.0.vsi.0.txqs.13.tx_bytes: 1354191371
dev.ice.0.vsi.0.txqs.13.tx_packets: 1125846
dev.ice.0.vsi.0.txqs.12.tc: 0
dev.ice.0.vsi.0.txqs.12.mss_too_small: 0
dev.ice.0.vsi.0.txqs.12.tx_bytes: 1236800898
dev.ice.0.vsi.0.txqs.12.tx_packets: 893641
dev.ice.0.vsi.0.txqs.11.tc: 0
dev.ice.0.vsi.0.txqs.11.mss_too_small: 0
dev.ice.0.vsi.0.txqs.11.tx_bytes: 616951915
dev.ice.0.vsi.0.txqs.11.tx_packets: 656204
dev.ice.0.vsi.0.txqs.10.tc: 0
dev.ice.0.vsi.0.txqs.10.mss_too_small: 0
dev.ice.0.vsi.0.txqs.10.tx_bytes: 6960714692
dev.ice.0.vsi.0.txqs.10.tx_packets: 5073471
dev.ice.0.vsi.0.txqs.9.tc: 0
dev.ice.0.vsi.0.txqs.9.mss_too_small: 0
dev.ice.0.vsi.0.txqs.9.tx_bytes: 3194825575
dev.ice.0.vsi.0.txqs.9.tx_packets: 2359203
dev.ice.0.vsi.0.txqs.8.tc: 0
dev.ice.0.vsi.0.txqs.8.mss_too_small: 0
dev.ice.0.vsi.0.txqs.8.tx_bytes: 990671878
dev.ice.0.vsi.0.txqs.8.tx_packets: 1446170
dev.ice.0.vsi.0.txqs.7.tc: 0
dev.ice.0.vsi.0.txqs.7.mss_too_small: 0
dev.ice.0.vsi.0.txqs.7.tx_bytes: 3754786493
dev.ice.0.vsi.0.txqs.7.tx_packets: 2801144
dev.ice.0.vsi.0.txqs.6.tc: 0
dev.ice.0.vsi.0.txqs.6.mss_too_small: 0
dev.ice.0.vsi.0.txqs.6.tx_bytes: 3518980176
dev.ice.0.vsi.0.txqs.6.tx_packets: 2727480
dev.ice.0.vsi.0.txqs.5.tc: 0
dev.ice.0.vsi.0.txqs.5.mss_too_small: 0
dev.ice.0.vsi.0.txqs.5.tx_bytes: 238001259
dev.ice.0.vsi.0.txqs.5.tx_packets: 198912
dev.ice.0.vsi.0.txqs.4.tc: 0
dev.ice.0.vsi.0.txqs.4.mss_too_small: 0
dev.ice.0.vsi.0.txqs.4.tx_bytes: 2640622212
dev.ice.0.vsi.0.txqs.4.tx_packets: 1839632
dev.ice.0.vsi.0.txqs.3.tc: 0
dev.ice.0.vsi.0.txqs.3.mss_too_small: 0
dev.ice.0.vsi.0.txqs.3.tx_bytes: 695883943
dev.ice.0.vsi.0.txqs.3.tx_packets: 693558
dev.ice.0.vsi.0.txqs.2.tc: 0
dev.ice.0.vsi.0.txqs.2.mss_too_small: 0
dev.ice.0.vsi.0.txqs.2.tx_bytes: 3445477515
dev.ice.0.vsi.0.txqs.2.tx_packets: 2387285
dev.ice.0.vsi.0.txqs.1.tc: 0
dev.ice.0.vsi.0.txqs.1.mss_too_small: 0
dev.ice.0.vsi.0.txqs.1.tx_bytes: 1891045884
dev.ice.0.vsi.0.txqs.1.tx_packets: 1297858
dev.ice.0.vsi.0.txqs.0.tc: 0
dev.ice.0.vsi.0.txqs.0.mss_too_small: 0
dev.ice.0.vsi.0.txqs.0.tx_bytes: 726804139
dev.ice.0.vsi.0.txqs.0.tx_packets: 566434
dev.ice.0.vsi.0.tx_itr: 50
dev.ice.0.vsi.0.rx_itr: 50
dev.ice.0.enable_health_events: 1
dev.ice.0.iflib.rxq15.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq15.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq15.rxq_fl0.cidx: 131
dev.ice.0.iflib.rxq15.rxq_fl0.pidx: 130
dev.ice.0.iflib.rxq15.cpu: 15
dev.ice.0.iflib.rxq14.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq14.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq14.rxq_fl0.cidx: 284
dev.ice.0.iflib.rxq14.rxq_fl0.pidx: 283
dev.ice.0.iflib.rxq14.cpu: 14
dev.ice.0.iflib.rxq13.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq13.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq13.rxq_fl0.cidx: 270
dev.ice.0.iflib.rxq13.rxq_fl0.pidx: 269
dev.ice.0.iflib.rxq13.cpu: 13
dev.ice.0.iflib.rxq12.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq12.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq12.rxq_fl0.cidx: 31
dev.ice.0.iflib.rxq12.rxq_fl0.pidx: 30
dev.ice.0.iflib.rxq12.cpu: 12
dev.ice.0.iflib.rxq11.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq11.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq11.rxq_fl0.cidx: 425
dev.ice.0.iflib.rxq11.rxq_fl0.pidx: 424
dev.ice.0.iflib.rxq11.cpu: 11
dev.ice.0.iflib.rxq10.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq10.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq10.rxq_fl0.cidx: 1004
dev.ice.0.iflib.rxq10.rxq_fl0.pidx: 1003
dev.ice.0.iflib.rxq10.cpu: 10
dev.ice.0.iflib.rxq09.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq09.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq09.rxq_fl0.cidx: 761
dev.ice.0.iflib.rxq09.rxq_fl0.pidx: 760
dev.ice.0.iflib.rxq09.cpu: 9
dev.ice.0.iflib.rxq08.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq08.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq08.rxq_fl0.cidx: 940
dev.ice.0.iflib.rxq08.rxq_fl0.pidx: 939
dev.ice.0.iflib.rxq08.cpu: 8
dev.ice.0.iflib.rxq07.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq07.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq07.rxq_fl0.cidx: 559
dev.ice.0.iflib.rxq07.rxq_fl0.pidx: 558
dev.ice.0.iflib.rxq07.cpu: 7
dev.ice.0.iflib.rxq06.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq06.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq06.rxq_fl0.cidx: 31
dev.ice.0.iflib.rxq06.rxq_fl0.pidx: 30
dev.ice.0.iflib.rxq06.cpu: 6
dev.ice.0.iflib.rxq05.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq05.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq05.rxq_fl0.cidx: 397
dev.ice.0.iflib.rxq05.rxq_fl0.pidx: 396
dev.ice.0.iflib.rxq05.cpu: 5
dev.ice.0.iflib.rxq04.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq04.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq04.rxq_fl0.cidx: 498
dev.ice.0.iflib.rxq04.rxq_fl0.pidx: 497
dev.ice.0.iflib.rxq04.cpu: 4
dev.ice.0.iflib.rxq03.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq03.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq03.rxq_fl0.cidx: 438
dev.ice.0.iflib.rxq03.rxq_fl0.pidx: 437
dev.ice.0.iflib.rxq03.cpu: 3
dev.ice.0.iflib.rxq02.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq02.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq02.rxq_fl0.cidx: 187
dev.ice.0.iflib.rxq02.rxq_fl0.pidx: 186
dev.ice.0.iflib.rxq02.cpu: 2
dev.ice.0.iflib.rxq01.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq01.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq01.rxq_fl0.cidx: 235
dev.ice.0.iflib.rxq01.rxq_fl0.pidx: 234
dev.ice.0.iflib.rxq01.cpu: 1
dev.ice.0.iflib.rxq00.rxq_fl0.buf_size: 2048
dev.ice.0.iflib.rxq00.rxq_fl0.credits: 1023
dev.ice.0.iflib.rxq00.rxq_fl0.cidx: 441
dev.ice.0.iflib.rxq00.rxq_fl0.pidx: 440
dev.ice.0.iflib.rxq00.cpu: 0
dev.ice.0.iflib.txq15.r_abdications: 0
dev.ice.0.iflib.txq15.r_restarts: 0
dev.ice.0.iflib.txq15.r_stalls: 0
dev.ice.0.iflib.txq15.r_starts: 3553268
dev.ice.0.iflib.txq15.r_drops: 0
dev.ice.0.iflib.txq15.r_enqueues: 3553288
dev.ice.0.iflib.txq15.ring_state: pidx_head: 0008 pidx_tail: 0008 cidx: 0008 state: IDLE
dev.ice.0.iflib.txq15.txq_cleaned: 3573769
dev.ice.0.iflib.txq15.txq_processed: 3573777
dev.ice.0.iflib.txq15.txq_in_use: 9
dev.ice.0.iflib.txq15.txq_cidx_processed: 17
dev.ice.0.iflib.txq15.txq_cidx: 9
dev.ice.0.iflib.txq15.txq_pidx: 18
dev.ice.0.iflib.txq15.no_tx_dma_setup: 0
dev.ice.0.iflib.txq15.txd_encap_efbig: 0
dev.ice.0.iflib.txq15.tx_map_failed: 0
dev.ice.0.iflib.txq15.no_desc_avail: 0
dev.ice.0.iflib.txq15.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq15.m_pullups: 20536
dev.ice.0.iflib.txq15.mbuf_defrag: 0
dev.ice.0.iflib.txq15.cpu: 15
dev.ice.0.iflib.txq14.r_abdications: 0
dev.ice.0.iflib.txq14.r_restarts: 0
dev.ice.0.iflib.txq14.r_stalls: 0
dev.ice.0.iflib.txq14.r_starts: 2472348
dev.ice.0.iflib.txq14.r_drops: 0
dev.ice.0.iflib.txq14.r_enqueues: 2473236
dev.ice.0.iflib.txq14.ring_state: pidx_head: 1300 pidx_tail: 1300 cidx: 1300 state: IDLE
dev.ice.0.iflib.txq14.txq_cleaned: 3275668
dev.ice.0.iflib.txq14.txq_processed: 3275676
dev.ice.0.iflib.txq14.txq_in_use: 9
dev.ice.0.iflib.txq14.txq_cidx_processed: 924
dev.ice.0.iflib.txq14.txq_cidx: 916
dev.ice.0.iflib.txq14.txq_pidx: 925
dev.ice.0.iflib.txq14.no_tx_dma_setup: 0
dev.ice.0.iflib.txq14.txd_encap_efbig: 0
dev.ice.0.iflib.txq14.tx_map_failed: 0
dev.ice.0.iflib.txq14.no_desc_avail: 0
dev.ice.0.iflib.txq14.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq14.m_pullups: 803335
dev.ice.0.iflib.txq14.mbuf_defrag: 0
dev.ice.0.iflib.txq14.cpu: 14
dev.ice.0.iflib.txq13.r_abdications: 0
dev.ice.0.iflib.txq13.r_restarts: 0
dev.ice.0.iflib.txq13.r_stalls: 0
dev.ice.0.iflib.txq13.r_starts: 1125853
dev.ice.0.iflib.txq13.r_drops: 0
dev.ice.0.iflib.txq13.r_enqueues: 1126304
dev.ice.0.iflib.txq13.ring_state: pidx_head: 1952 pidx_tail: 1952 cidx: 1952 state: IDLE
dev.ice.0.iflib.txq13.txq_cleaned: 1593521
dev.ice.0.iflib.txq13.txq_processed: 1593529
dev.ice.0.iflib.txq13.txq_in_use: 9
dev.ice.0.iflib.txq13.txq_cidx_processed: 185
dev.ice.0.iflib.txq13.txq_cidx: 177
dev.ice.0.iflib.txq13.txq_pidx: 186
dev.ice.0.iflib.txq13.no_tx_dma_setup: 0
dev.ice.0.iflib.txq13.txd_encap_efbig: 0
dev.ice.0.iflib.txq13.tx_map_failed: 0
dev.ice.0.iflib.txq13.no_desc_avail: 0
dev.ice.0.iflib.txq13.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq13.m_pullups: 467669
dev.ice.0.iflib.txq13.mbuf_defrag: 0
dev.ice.0.iflib.txq13.cpu: 13
dev.ice.0.iflib.txq12.r_abdications: 0
dev.ice.0.iflib.txq12.r_restarts: 0
dev.ice.0.iflib.txq12.r_stalls: 0
dev.ice.0.iflib.txq12.r_starts: 893652
dev.ice.0.iflib.txq12.r_drops: 0
dev.ice.0.iflib.txq12.r_enqueues: 893969
dev.ice.0.iflib.txq12.ring_state: pidx_head: 1041 pidx_tail: 1041 cidx: 1041 state: IDLE
dev.ice.0.iflib.txq12.txq_cleaned: 1373488
dev.ice.0.iflib.txq12.txq_processed: 1373496
dev.ice.0.iflib.txq12.txq_in_use: 9
dev.ice.0.iflib.txq12.txq_cidx_processed: 312
dev.ice.0.iflib.txq12.txq_cidx: 304
dev.ice.0.iflib.txq12.txq_pidx: 313
dev.ice.0.iflib.txq12.no_tx_dma_setup: 0
dev.ice.0.iflib.txq12.txd_encap_efbig: 0
dev.ice.0.iflib.txq12.tx_map_failed: 0
dev.ice.0.iflib.txq12.no_desc_avail: 0
dev.ice.0.iflib.txq12.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq12.m_pullups: 479933
dev.ice.0.iflib.txq12.mbuf_defrag: 0
dev.ice.0.iflib.txq12.cpu: 12
dev.ice.0.iflib.txq11.r_abdications: 0
dev.ice.0.iflib.txq11.r_restarts: 0
dev.ice.0.iflib.txq11.r_stalls: 0
dev.ice.0.iflib.txq11.r_starts: 656204
dev.ice.0.iflib.txq11.r_drops: 0
dev.ice.0.iflib.txq11.r_enqueues: 656207
dev.ice.0.iflib.txq11.ring_state: pidx_head: 0847 pidx_tail: 0847 cidx: 0847 state: IDLE
dev.ice.0.iflib.txq11.txq_cleaned: 692893
dev.ice.0.iflib.txq11.txq_processed: 692901
dev.ice.0.iflib.txq11.txq_in_use: 9
dev.ice.0.iflib.txq11.txq_cidx_processed: 677
dev.ice.0.iflib.txq11.txq_cidx: 669
dev.ice.0.iflib.txq11.txq_pidx: 678
dev.ice.0.iflib.txq11.no_tx_dma_setup: 0
dev.ice.0.iflib.txq11.txd_encap_efbig: 0
dev.ice.0.iflib.txq11.tx_map_failed: 0
dev.ice.0.iflib.txq11.no_desc_avail: 0
dev.ice.0.iflib.txq11.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq11.m_pullups: 36716
dev.ice.0.iflib.txq11.mbuf_defrag: 0
dev.ice.0.iflib.txq11.cpu: 11
dev.ice.0.iflib.txq10.r_abdications: 0
dev.ice.0.iflib.txq10.r_restarts: 0
dev.ice.0.iflib.txq10.r_stalls: 0
dev.ice.0.iflib.txq10.r_starts: 5073465
dev.ice.0.iflib.txq10.r_drops: 0
dev.ice.0.iflib.txq10.r_enqueues: 5073482
dev.ice.0.iflib.txq10.ring_state: pidx_head: 0586 pidx_tail: 0586 cidx: 0586 state: IDLE
dev.ice.0.iflib.txq10.txq_cleaned: 5138342
dev.ice.0.iflib.txq10.txq_processed: 5138350
dev.ice.0.iflib.txq10.txq_in_use: 9
dev.ice.0.iflib.txq10.txq_cidx_processed: 942
dev.ice.0.iflib.txq10.txq_cidx: 934
dev.ice.0.iflib.txq10.txq_pidx: 943
dev.ice.0.iflib.txq10.no_tx_dma_setup: 0
dev.ice.0.iflib.txq10.txd_encap_efbig: 0
dev.ice.0.iflib.txq10.tx_map_failed: 0
dev.ice.0.iflib.txq10.no_desc_avail: 0
dev.ice.0.iflib.txq10.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq10.m_pullups: 64868
dev.ice.0.iflib.txq10.mbuf_defrag: 0
dev.ice.0.iflib.txq10.cpu: 10
dev.ice.0.iflib.txq09.r_abdications: 0
dev.ice.0.iflib.txq09.r_restarts: 0
dev.ice.0.iflib.txq09.r_stalls: 0
dev.ice.0.iflib.txq09.r_starts: 2359201
dev.ice.0.iflib.txq09.r_drops: 0
dev.ice.0.iflib.txq09.r_enqueues: 2359250
dev.ice.0.iflib.txq09.ring_state: pidx_head: 2002 pidx_tail: 2002 cidx: 2002 state: IDLE
dev.ice.0.iflib.txq09.txq_cleaned: 2476265
dev.ice.0.iflib.txq09.txq_processed: 2476273
dev.ice.0.iflib.txq09.txq_in_use: 9
dev.ice.0.iflib.txq09.txq_cidx_processed: 241
dev.ice.0.iflib.txq09.txq_cidx: 233
dev.ice.0.iflib.txq09.txq_pidx: 242
dev.ice.0.iflib.txq09.no_tx_dma_setup: 0
dev.ice.0.iflib.txq09.txd_encap_efbig: 0
dev.ice.0.iflib.txq09.tx_map_failed: 0
dev.ice.0.iflib.txq09.no_desc_avail: 0
dev.ice.0.iflib.txq09.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq09.m_pullups: 116450
dev.ice.0.iflib.txq09.mbuf_defrag: 0
dev.ice.0.iflib.txq09.cpu: 9
dev.ice.0.iflib.txq08.r_abdications: 0
dev.ice.0.iflib.txq08.r_restarts: 0
dev.ice.0.iflib.txq08.r_stalls: 0
dev.ice.0.iflib.txq08.r_starts: 1446159
dev.ice.0.iflib.txq08.r_drops: 0
dev.ice.0.iflib.txq08.r_enqueues: 1446670
dev.ice.0.iflib.txq08.ring_state: pidx_head: 0782 pidx_tail: 0782 cidx: 0782 state: IDLE
dev.ice.0.iflib.txq08.txq_cleaned: 2061607
dev.ice.0.iflib.txq08.txq_processed: 2061615
dev.ice.0.iflib.txq08.txq_in_use: 9
dev.ice.0.iflib.txq08.txq_cidx_processed: 303
dev.ice.0.iflib.txq08.txq_cidx: 295
dev.ice.0.iflib.txq08.txq_pidx: 304
dev.ice.0.iflib.txq08.no_tx_dma_setup: 0
dev.ice.0.iflib.txq08.txd_encap_efbig: 0
dev.ice.0.iflib.txq08.tx_map_failed: 0
dev.ice.0.iflib.txq08.no_desc_avail: 0
dev.ice.0.iflib.txq08.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq08.m_pullups: 615470
dev.ice.0.iflib.txq08.mbuf_defrag: 0
dev.ice.0.iflib.txq08.cpu: 8
dev.ice.0.iflib.txq07.r_abdications: 0
dev.ice.0.iflib.txq07.r_restarts: 0
dev.ice.0.iflib.txq07.r_stalls: 0
dev.ice.0.iflib.txq07.r_starts: 2801146
dev.ice.0.iflib.txq07.r_drops: 0
dev.ice.0.iflib.txq07.r_enqueues: 2801205
dev.ice.0.iflib.txq07.ring_state: pidx_head: 1589 pidx_tail: 1589 cidx: 1589 state: IDLE
dev.ice.0.iflib.txq07.txq_cleaned: 2876211
dev.ice.0.iflib.txq07.txq_processed: 2876219
dev.ice.0.iflib.txq07.txq_in_use: 9
dev.ice.0.iflib.txq07.txq_cidx_processed: 827
dev.ice.0.iflib.txq07.txq_cidx: 819
dev.ice.0.iflib.txq07.txq_pidx: 828
dev.ice.0.iflib.txq07.no_tx_dma_setup: 0
dev.ice.0.iflib.txq07.txd_encap_efbig: 0
dev.ice.0.iflib.txq07.tx_map_failed: 0
dev.ice.0.iflib.txq07.no_desc_avail: 0
dev.ice.0.iflib.txq07.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq07.m_pullups: 75084
dev.ice.0.iflib.txq07.mbuf_defrag: 0
dev.ice.0.iflib.txq07.cpu: 7
dev.ice.0.iflib.txq06.r_abdications: 0
dev.ice.0.iflib.txq06.r_restarts: 0
dev.ice.0.iflib.txq06.r_stalls: 0
dev.ice.0.iflib.txq06.r_starts: 2727485
dev.ice.0.iflib.txq06.r_drops: 0
dev.ice.0.iflib.txq06.r_enqueues: 2727785
dev.ice.0.iflib.txq06.ring_state: pidx_head: 1897 pidx_tail: 1897 cidx: 1897 state: IDLE
dev.ice.0.iflib.txq06.txq_cleaned: 3150601
dev.ice.0.iflib.txq06.txq_processed: 3150609
dev.ice.0.iflib.txq06.txq_in_use: 9
dev.ice.0.iflib.txq06.txq_cidx_processed: 785
dev.ice.0.iflib.txq06.txq_cidx: 777
dev.ice.0.iflib.txq06.txq_pidx: 786
dev.ice.0.iflib.txq06.no_tx_dma_setup: 0
dev.ice.0.iflib.txq06.txd_encap_efbig: 0
dev.ice.0.iflib.txq06.tx_map_failed: 0
dev.ice.0.iflib.txq06.no_desc_avail: 0
dev.ice.0.iflib.txq06.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq06.m_pullups: 423147
dev.ice.0.iflib.txq06.mbuf_defrag: 0
dev.ice.0.iflib.txq06.cpu: 6
dev.ice.0.iflib.txq05.r_abdications: 0
dev.ice.0.iflib.txq05.r_restarts: 0
dev.ice.0.iflib.txq05.r_stalls: 0
dev.ice.0.iflib.txq05.r_starts: 198912
dev.ice.0.iflib.txq05.r_drops: 0
dev.ice.0.iflib.txq05.r_enqueues: 198913
dev.ice.0.iflib.txq05.ring_state: pidx_head: 0257 pidx_tail: 0257 cidx: 0257 state: IDLE
dev.ice.0.iflib.txq05.txq_cleaned: 324283
dev.ice.0.iflib.txq05.txq_processed: 324291
dev.ice.0.iflib.txq05.txq_in_use: 9
dev.ice.0.iflib.txq05.txq_cidx_processed: 707
dev.ice.0.iflib.txq05.txq_cidx: 699
dev.ice.0.iflib.txq05.txq_pidx: 708
dev.ice.0.iflib.txq05.no_tx_dma_setup: 0
dev.ice.0.iflib.txq05.txd_encap_efbig: 0
dev.ice.0.iflib.txq05.tx_map_failed: 0
dev.ice.0.iflib.txq05.no_desc_avail: 0
dev.ice.0.iflib.txq05.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq05.m_pullups: 125387
dev.ice.0.iflib.txq05.mbuf_defrag: 0
dev.ice.0.iflib.txq05.cpu: 5
dev.ice.0.iflib.txq04.r_abdications: 0
dev.ice.0.iflib.txq04.r_restarts: 0
dev.ice.0.iflib.txq04.r_stalls: 0
dev.ice.0.iflib.txq04.r_starts: 1839641
dev.ice.0.iflib.txq04.r_drops: 0
dev.ice.0.iflib.txq04.r_enqueues: 1839974
dev.ice.0.iflib.txq04.ring_state: pidx_head: 0870 pidx_tail: 0870 cidx: 0870 state: IDLE
dev.ice.0.iflib.txq04.txq_cleaned: 2429187
dev.ice.0.iflib.txq04.txq_processed: 2429195
dev.ice.0.iflib.txq04.txq_in_use: 9
dev.ice.0.iflib.txq04.txq_cidx_processed: 267
dev.ice.0.iflib.txq04.txq_cidx: 259
dev.ice.0.iflib.txq04.txq_pidx: 268
dev.ice.0.iflib.txq04.no_tx_dma_setup: 0
dev.ice.0.iflib.txq04.txd_encap_efbig: 0
dev.ice.0.iflib.txq04.tx_map_failed: 0
dev.ice.0.iflib.txq04.no_desc_avail: 0
dev.ice.0.iflib.txq04.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq04.m_pullups: 589597
dev.ice.0.iflib.txq04.mbuf_defrag: 0
dev.ice.0.iflib.txq04.cpu: 4
dev.ice.0.iflib.txq03.r_abdications: 0
dev.ice.0.iflib.txq03.r_restarts: 0
dev.ice.0.iflib.txq03.r_stalls: 0
dev.ice.0.iflib.txq03.r_starts: 693558
dev.ice.0.iflib.txq03.r_drops: 0
dev.ice.0.iflib.txq03.r_enqueues: 693587
dev.ice.0.iflib.txq03.ring_state: pidx_head: 1363 pidx_tail: 1363 cidx: 1363 state: IDLE
dev.ice.0.iflib.txq03.txq_cleaned: 1048273
dev.ice.0.iflib.txq03.txq_processed: 1048281
dev.ice.0.iflib.txq03.txq_in_use: 9
dev.ice.0.iflib.txq03.txq_cidx_processed: 729
dev.ice.0.iflib.txq03.txq_cidx: 721
dev.ice.0.iflib.txq03.txq_pidx: 730
dev.ice.0.iflib.txq03.no_tx_dma_setup: 0
dev.ice.0.iflib.txq03.txd_encap_efbig: 0
dev.ice.0.iflib.txq03.tx_map_failed: 0
dev.ice.0.iflib.txq03.no_desc_avail: 0
dev.ice.0.iflib.txq03.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq03.m_pullups: 354758
dev.ice.0.iflib.txq03.mbuf_defrag: 0
dev.ice.0.iflib.txq03.cpu: 3
dev.ice.0.iflib.txq02.r_abdications: 0
dev.ice.0.iflib.txq02.r_restarts: 0
dev.ice.0.iflib.txq02.r_stalls: 0
dev.ice.0.iflib.txq02.r_starts: 2387279
dev.ice.0.iflib.txq02.r_drops: 0
dev.ice.0.iflib.txq02.r_enqueues: 2387303
dev.ice.0.iflib.txq02.ring_state: pidx_head: 1383 pidx_tail: 1383 cidx: 1383 state: IDLE
dev.ice.0.iflib.txq02.txq_cleaned: 3138607
dev.ice.0.iflib.txq02.txq_processed: 3138615
dev.ice.0.iflib.txq02.txq_in_use: 9
dev.ice.0.iflib.txq02.txq_cidx_processed: 55
dev.ice.0.iflib.txq02.txq_cidx: 47
dev.ice.0.iflib.txq02.txq_pidx: 56
dev.ice.0.iflib.txq02.no_tx_dma_setup: 0
dev.ice.0.iflib.txq02.txd_encap_efbig: 0
dev.ice.0.iflib.txq02.tx_map_failed: 0
dev.ice.0.iflib.txq02.no_desc_avail: 0
dev.ice.0.iflib.txq02.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq02.m_pullups: 751336
dev.ice.0.iflib.txq02.mbuf_defrag: 0
dev.ice.0.iflib.txq02.cpu: 2
dev.ice.0.iflib.txq01.r_abdications: 0
dev.ice.0.iflib.txq01.r_restarts: 0
dev.ice.0.iflib.txq01.r_stalls: 0
dev.ice.0.iflib.txq01.r_starts: 1297857
dev.ice.0.iflib.txq01.r_drops: 0
dev.ice.0.iflib.txq01.r_enqueues: 1297859
dev.ice.0.iflib.txq01.ring_state: pidx_head: 1475 pidx_tail: 1475 cidx: 1475 state: IDLE
dev.ice.0.iflib.txq01.txq_cleaned: 1767918
dev.ice.0.iflib.txq01.txq_processed: 1767926
dev.ice.0.iflib.txq01.txq_in_use: 9
dev.ice.0.iflib.txq01.txq_cidx_processed: 502
dev.ice.0.iflib.txq01.txq_cidx: 494
dev.ice.0.iflib.txq01.txq_pidx: 503
dev.ice.0.iflib.txq01.no_tx_dma_setup: 0
dev.ice.0.iflib.txq01.txd_encap_efbig: 0
dev.ice.0.iflib.txq01.tx_map_failed: 0
dev.ice.0.iflib.txq01.no_desc_avail: 0
dev.ice.0.iflib.txq01.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq01.m_pullups: 470079
dev.ice.0.iflib.txq01.mbuf_defrag: 0
dev.ice.0.iflib.txq01.cpu: 1
dev.ice.0.iflib.txq00.r_abdications: 0
dev.ice.0.iflib.txq00.r_restarts: 0
dev.ice.0.iflib.txq00.r_stalls: 0
dev.ice.0.iflib.txq00.r_starts: 566418
dev.ice.0.iflib.txq00.r_drops: 0
dev.ice.0.iflib.txq00.r_enqueues: 566437
dev.ice.0.iflib.txq00.ring_state: pidx_head: 1189 pidx_tail: 1189 cidx: 1189 state: IDLE
dev.ice.0.iflib.txq00.txq_cleaned: 1018256
dev.ice.0.iflib.txq00.txq_processed: 1018264
dev.ice.0.iflib.txq00.txq_in_use: 9
dev.ice.0.iflib.txq00.txq_cidx_processed: 408
dev.ice.0.iflib.txq00.txq_cidx: 400
dev.ice.0.iflib.txq00.txq_pidx: 409
dev.ice.0.iflib.txq00.no_tx_dma_setup: 0
dev.ice.0.iflib.txq00.txd_encap_efbig: 0
dev.ice.0.iflib.txq00.tx_map_failed: 0
dev.ice.0.iflib.txq00.no_desc_avail: 0
dev.ice.0.iflib.txq00.mbuf_defrag_failed: 0
dev.ice.0.iflib.txq00.m_pullups: 451063
dev.ice.0.iflib.txq00.mbuf_defrag: 0
dev.ice.0.iflib.txq00.cpu: 0
dev.ice.0.iflib.override_nrxds: 0
dev.ice.0.iflib.override_ntxds: 0
dev.ice.0.iflib.use_logical_cores: 0
dev.ice.0.iflib.separate_txrx: 0
dev.ice.0.iflib.core_offset: 0
dev.ice.0.iflib.tx_abdicate: 0
dev.ice.0.iflib.rx_budget: 0
dev.ice.0.iflib.disable_msix: 0
dev.ice.0.iflib.override_qs_enable: 0
dev.ice.0.iflib.override_nrxqs: 0
dev.ice.0.iflib.override_ntxqs: 0
dev.ice.0.iflib.driver_version: 1.37.11-k
dev.ice.0.%parent: pci2
dev.ice.0.%pnpinfo: vendor=0x8086 device=0x1592 subvendor=0x8086 subdevice=0x0002 class=0x020000
dev.ice.0.%location: slot=0 function=0 dbsf=pci0:2:0:0 handle=\_SB_.PCI0.SE1_.S00_
dev.ice.0.%driver: ice
dev.ice.0.%desc: Intel(R) Ethernet Network Adapter E810-C-Q2 - 1.37.11-k

I noticed another issue. In my initial post I mentioned that the E810 is running the latest driver compiled from Intel's source, but I may be mistaken. It seems like the if_{driver name}_load="YES" setting to load a driver from module instead of iflib doesn't work the same with ice. ice_ddp_load="YES" works fine to load ice_ddp.ko, but if_ice_load="YES" doesn't seem to replace the iflib ice driver with if_ice.ko from modules. I've done this with ix and ixl drivers without any issues, but ice is somehow different. Following is the interface boot information.

module ice already present!
...
ice0: <Intel(R) Ethernet Network Adapter E810-C-Q2 - 1.37.11-k> mem 0x380800000000-0x380801ffffff,0x380802000000-0x38080200ffff irq 16 at device 0.0 on pci2
ice0: Loading the iflib ice driver
ice0: DDP package already present on device: ICE OS Default Package version 1.3.36.0, track id 0xc0000001.
ice0: fw 7.5.4 api 1.7 nvm 4.50 etid 8001d8b6 netlist 4.3.2000-3.25.0.a2703c1c oem 1.3597.0
ice0: Using 16 Tx and Rx queues
ice0: Reserving 16 MSI-X interrupts for iRDMA
ice0: Using MSI-X interrupts with 33 vectors
ice0: Using 1024 TX descriptors and 1024 RX descriptors
ice0: Ethernet address: XX:XX:XX:XX:XX:XX
ice0: PCI Express Bus: Speed 16.0GT/s Width x16
ice0: Firmware LLDP agent disabled
ice0: link state changed to DOWN
ice0: netmap queues/slots: TX 16/1024, RX 16/1024

Also notice the "module ice already present!" message by itself at the start of the boot log. This is different than what I see when an iflib driver is replaced with a module, like the following...

module_register: cannot register pci/ix from kernel; already loaded from if_ix.ko
Module pci/ix failed to register: 17
module_register: cannot register pci/ixl from kernel; already loaded from if_ixl.ko
Module pci/ixl failed to register: 17

stephenw10 · Aug 5, 2024, 1:26 PM

Hmm, so it's not that it reports under or oversized frames but that they don't match the expected size. Feels like a hardware offloading issue perhaps.

What options do you have enabled there?: ifconfig -vm ice0

Louis89 · Aug 5, 2024, 3:18 PM

@stephenw10 Perhaps. All hardware offloading is enabled. I tested this system with a variety of hardware offloading options and found all enabled to provide the best performance while using the least resources. I hadn't noticed any stability issues during testing, but I may have simply missed the rx_length_errors appearing only when some offloading setting was enabled.

Following is the output of ifconfig -vm ice0

ice0: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
	description: LAN_ADMIN
	options=4e507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	capabilities=4f507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
	ether xx:xx:xx:xx:xx:xx
	inet 192.168.0.1 netmask 0xffffff00 broadcast 192.168.0.255
	inet6 fe80::xxxx:xxxx:xxxx:xxxx%ice0 prefixlen 64 scopeid 0x3
	inet6 fe80::1:1%ice0 prefixlen 64 scopeid 0x3
	inet6 2600:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx prefixlen 64
	media: Ethernet autoselect (100G-CAUI4 <full-duplex,rxpause,txpause>)
	status: active
	supported media:
		media autoselect
		media 100G-CAUI4
		media 100GBase-CR4
		media 50G-LAUI2
		media 50GBase-CR2
		media 25G-AUI
		media 25GBase-CR1
		media 25GBase-CR-S
		media 25GBase-CR
		media 10Gbase-Twinax
	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
	drivername: ice0
	plugged: QSFP28 Unknown (No separable connector)
	vendor: FS PN: Q28-PC015 SN: C2402153131-2 DATE: 2024-02-05
	module temperature: 0.00 C voltage: 0.00 Volts
	lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
	lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
	lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
	lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA

stephenw10 · Aug 5, 2024, 3:56 PM

Mmm, I would have though it would have been a much bigger impact if it was really reporting good packets as bad.

Unfortunately I have no 100G gear to test with.