Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Intel E810 in errors (rx_length_errors) on untagged VLAN of trunked port

    Scheduled Pinned Locked Moved Hardware
    8 Posts 3 Posters 732 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • L
      Louis89
      last edited by

      I have a pfSense 24.03 install connecting to all LANs via a single VLAN trunk through a single port of an Intel E810 adapter. The curiosity is that I see a high "In Error" count that continuously increases only on the untagged VLAN of this trunk port, all errors show as "rx_length_errors". All other tagged VLAN interfaces on this port do not show any errors. I have not identified any issues with the untagged VLAN network as a result of these errors. The switch that this adapter is connected to does not show any errors. The E810 is running the latest firmware from Intel and an "ice" driver compiled from Intel's latest source.
      I have a similar setup at three other sites, but trunking over "ix", "igb", and "mvneta" adapters. I've never seen "in errors" like this with any of those systems.

      Since the errors don't appear to be causing any real problems, I'm not too concerned. But I'm curious if anyone else has seen behavior like this and might know more about what exactly is happening. One thought I had was that maybe the tagged traffic on the trunk is not being filtered out on the untagged interface leading to "rx_length_errors". It's ideal that the tagged packets are being dropped on the untagged interface, but it leads to an ugly error counter on the interface statistics. Maybe it's due to something funny with how the pfSense/BSD driver for the E810 deals with VLAN tag filtering? Or could this be causing some real problem I haven't realized yet?

      keyserK 1 Reply Last reply Reply Quote 0
      • keyserK
        keyser Rebel Alliance @Louis89
        last edited by

        @Louis89 I don’t think your theory is correct.
        It is much more likely that you have something on your native LAN sending jumbo sized frames (larger that 1500 data bytes on the ethernet layer).

        Love the no fuss of using the official appliances :-)

        L 1 Reply Last reply Reply Quote 0
        • L
          Louis89 @keyser
          last edited by

          @keyser I agree, but the switch and the E810 port both report an MTU setting of 1500. All the ports on the switch report an MTU of 1500, but no errors on any of the switch ports. I also tried swapping out the machine running pfSense on the same network with one that uses an "ix" adapter instead, no errors with the "ix" adapter. It is quite odd, I'm not sure what I'm missing...

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Is untagged traffic actually used there? Is the switch configured to send untagged traffic on that port if not?

            L 1 Reply Last reply Reply Quote 0
            • L
              Louis89 @stephenw10
              last edited by Louis89

              @stephenw10 Yes, untagged traffic is being used on this port. The switch is configured to send VLAN 1 as untagged traffic.

              Following are the interface stats for the switch port connected to ice, and pfSense for the untagged ice interface showing In errors. The interface hasn't been up for long so counts are low, but the In error (rx_length_errors) count on this one interface in pfSense continuously increases. I hope it is helpful.
              Switch:

              100GigabitEthernet1/2/2 is up, line protocol is up
                Port up for 25 minute(s) 57 second(s)
                Hardware is 100GigabitEthernet, address is XXXX.XXXX.XXXX (bia XXXX.XXXX.XXXX)
                Interface type is 100 Gig Fiber
                Configured speed optic-based, actual 100Gbit, configured duplex fdx, actual fdx
                Configured FEC on, actual on
                Configured mdi mode AUTO, actual MDI
                Tagged member of 7 L2 VLANs, untagged in VLAN 1, port state is FORWARDING
                BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled
                Link Error Dampening is Disabled
                STP configured to ON, priority is level0, mac-learning is enabled
                MACsec is Disabled
                Flow Control is config enabled, oper enabled, negotiation disabled
                Mirror disabled, Monitor disabled
                Mac-notification is disabled
                VLAN-Mapping is disabled
                Not member of any active trunks
                Not member of any configured trunks
                No port name
                IPG MII 96 bits-time, IPG GMII 96 bits-time
                MTU 1500 bytes
                MMU Mode is Store-and-forward
                300 second input rate: 302720 bits/sec, 328 packets/sec, 0.00% utilization
                300 second output rate: 6938752 bits/sec, 627 packets/sec, 0.00% utilization
                7445521 packets input, 7154424994 bytes, 0 no buffer
                Received 295 broadcasts, 553 multicasts, 7444673 unicasts
                0 input errors, 0 CRC, 0 frame, 0 ignored
                0 runts, 0 giants
                6851608 packets output, 7397758203 bytes, 0 underruns
                Transmitted 2560 broadcasts, 11508 multicasts, 6837540 unicasts
                0 output errors, 0 collisions
                Relay Agent Information option: Disabled
                Protected: No
                MAC Port Security: Disabled
              
              UC Egress queues:
              Queue counters      Queued packets    Dropped Packets
                       0             6834052                   0
                       1                   0                   0
                       2                   0                   0
                       3                   0                   0
                       4                 953                   0
                       5                 297                   0
                       6                   0                   0
                       7                6274                   0
                       8                   0                   0
              
              
              MC Egress queues:
              Queue counters    Queued packets    Dropped Packets
                       0                6329                   0
                       1                   0                   0
                       2                   0                   0
                       3                   0                   0
                       4                2827                   0
                       5                 878                   0
                       6                   0                   0
                       7                   0                   0
                       8                   0                   0
                       9                   0                   0
              
              Oversubscribed ingress drop counters:
              High priority drop                     0
              Low priority drop                     0
              Total drop                             0
              

              pfSense:

              dev.ice.0.hw.mac.remote_faults: 0
              dev.ice.0.hw.mac.local_faults: 0
              dev.ice.0.hw.mac.illegal_bytes: 0
              dev.ice.0.hw.mac.crc_errors: 0
              dev.ice.0.hw.mac.xoff_recvd: 0
              dev.ice.0.hw.mac.xoff_txd: 956
              dev.ice.0.hw.mac.xon_recvd: 0
              dev.ice.0.hw.mac.xon_txd: 1
              dev.ice.0.hw.mac.tx_dropped: 0
              dev.ice.0.hw.mac.tx_frames_big: 0
              dev.ice.0.hw.mac.tx_frames_1024_1522: 26410755
              dev.ice.0.hw.mac.tx_frames_512_1023: 116028
              dev.ice.0.hw.mac.tx_frames_256_511: 248774
              dev.ice.0.hw.mac.tx_frames_128_255: 223537
              dev.ice.0.hw.mac.tx_frames_65_127: 2966972
              dev.ice.0.hw.mac.tx_frames_64: 127055
              dev.ice.0.hw.mac.rx_discards: 0
              dev.ice.0.hw.mac.rx_length_errors: 80819
              dev.ice.0.hw.mac.rx_jabber: 0
              dev.ice.0.hw.mac.rx_oversized: 0
              dev.ice.0.hw.mac.rx_fragmented: 0
              dev.ice.0.hw.mac.rx_undersize: 0
              dev.ice.0.hw.mac.rx_frames_big: 0
              dev.ice.0.hw.mac.rx_frames_1024_1522: 7604799
              dev.ice.0.hw.mac.rx_frames_512_1023: 222828
              dev.ice.0.hw.mac.rx_frames_256_511: 367921
              dev.ice.0.hw.mac.rx_frames_128_255: 438290
              dev.ice.0.hw.mac.rx_frames_65_127: 4388773
              dev.ice.0.hw.mac.rx_frames_64: 39925
              dev.ice.0.hw.mac.p_xon2xoff.7: 0
              dev.ice.0.hw.mac.p_xon2xoff.6: 0
              dev.ice.0.hw.mac.p_xon2xoff.5: 0
              dev.ice.0.hw.mac.p_xon2xoff.4: 0
              dev.ice.0.hw.mac.p_xon2xoff.3: 0
              dev.ice.0.hw.mac.p_xon2xoff.2: 0
              dev.ice.0.hw.mac.p_xon2xoff.1: 0
              dev.ice.0.hw.mac.p_xon2xoff.0: 0
              dev.ice.0.hw.mac.p_xoff_txd.7: 0
              dev.ice.0.hw.mac.p_xoff_txd.6: 0
              dev.ice.0.hw.mac.p_xoff_txd.5: 0
              dev.ice.0.hw.mac.p_xoff_txd.4: 0
              dev.ice.0.hw.mac.p_xoff_txd.3: 0
              dev.ice.0.hw.mac.p_xoff_txd.2: 0
              dev.ice.0.hw.mac.p_xoff_txd.1: 0
              dev.ice.0.hw.mac.p_xoff_txd.0: 0
              dev.ice.0.hw.mac.p_xon_txd.7: 0
              dev.ice.0.hw.mac.p_xon_txd.6: 0
              dev.ice.0.hw.mac.p_xon_txd.5: 0
              dev.ice.0.hw.mac.p_xon_txd.4: 0
              dev.ice.0.hw.mac.p_xon_txd.3: 0
              dev.ice.0.hw.mac.p_xon_txd.2: 0
              dev.ice.0.hw.mac.p_xon_txd.1: 0
              dev.ice.0.hw.mac.p_xon_txd.0: 0
              dev.ice.0.hw.mac.p_xoff_recvd.7: 0
              dev.ice.0.hw.mac.p_xoff_recvd.6: 0
              dev.ice.0.hw.mac.p_xoff_recvd.5: 0
              dev.ice.0.hw.mac.p_xoff_recvd.4: 0
              dev.ice.0.hw.mac.p_xoff_recvd.3: 0
              dev.ice.0.hw.mac.p_xoff_recvd.2: 0
              dev.ice.0.hw.mac.p_xoff_recvd.1: 0
              dev.ice.0.hw.mac.p_xoff_recvd.0: 0
              dev.ice.0.hw.mac.p_xon_recvd.7: 0
              dev.ice.0.hw.mac.p_xon_recvd.6: 0
              dev.ice.0.hw.mac.p_xon_recvd.5: 0
              dev.ice.0.hw.mac.p_xon_recvd.4: 0
              dev.ice.0.hw.mac.p_xon_recvd.3: 0
              dev.ice.0.hw.mac.p_xon_recvd.2: 0
              dev.ice.0.hw.mac.p_xon_recvd.1: 0
              dev.ice.0.hw.mac.p_xon_recvd.0: 0
              dev.ice.0.hw.mac.bcast_pkts_txd: 3619
              dev.ice.0.hw.mac.mcast_pkts_txd: 2026
              dev.ice.0.hw.mac.ucast_pkts_txd: 30087476
              dev.ice.0.hw.mac.good_octets_txd: 39786553129
              dev.ice.0.hw.mac.bcast_pkts_rcvd: 41573
              dev.ice.0.hw.mac.mcast_pkts_rcvd: 78153
              dev.ice.0.hw.mac.ucast_pkts_rcvd: 12942810
              dev.ice.0.hw.mac.good_octets_rcvd: 11180746288
              dev.ice.0.dscp2tc_map.56-63: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.48-55: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.40-47: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.32-39: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.24-31: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.16-23: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.8-15: 0,0,0,0,0,0,0,0
              dev.ice.0.dscp2tc_map.0-7: 0,0,0,0,0,0,0,0
              dev.ice.0.link_active_on_if_down: 1
              dev.ice.0.allow_no_fec_modules_in_auto: 0
              dev.ice.0.pfc_mode: 0
              dev.ice.0.pfc: 0
              dev.ice.0.up2tc_map: 0,0,0,0,0,0,0,0
              dev.ice.0.ets_min_rate: 100,0,0,0,0,0,0,0
              dev.ice.0.fw_lldp_agent: 0
              dev.ice.0.advertise_speed: 1696
              dev.ice.0.fc: 3<Full>
              dev.ice.0.negotiated_fec: RS-FEC
              dev.ice.0.requested_fec: RS-FEC
              dev.ice.0.current_speed: 100 Gbps
              dev.ice.0.ddp_version: ICE OS Default Package version 1.3.36.0, track id 0xc0000001
              dev.ice.0.temp: 63
              dev.ice.0.pba_number: K91258-000
              dev.ice.0.fw_version: fw 7.5.4 api 1.7 nvm 4.50 etid 8001d8b6 netlist 4.3.2000-3.25.0.a2703c1c oem 1.3597.0
              dev.ice.0.vsi.0.sw.cso.rx_l4_err: 0
              dev.ice.0.vsi.0.sw.cso.rx_sctp_err: 0
              dev.ice.0.vsi.0.sw.cso.rx_udp_err: 0
              dev.ice.0.vsi.0.sw.cso.rx_tcp_err: 0
              dev.ice.0.vsi.0.sw.cso.rx_l3_err: 0
              dev.ice.0.vsi.0.sw.cso.rx_ip6_err: 0
              dev.ice.0.vsi.0.sw.cso.rx_ip4_err: 0
              dev.ice.0.vsi.0.sw.cso.tx_l4_err: 0
              dev.ice.0.vsi.0.sw.cso.tx_l3_err: 0
              dev.ice.0.vsi.0.sw.cso.tx_ip6: 28246
              dev.ice.0.vsi.0.sw.cso.tx_ip4: 21423464
              dev.ice.0.vsi.0.sw.cso.tx_sctp: 0
              dev.ice.0.vsi.0.sw.cso.tx_udp: 50955
              dev.ice.0.vsi.0.sw.cso.tx_tcp: 903
              dev.ice.0.vsi.0.hw.tx_errors: 0
              dev.ice.0.vsi.0.hw.rx_no_desc: 0
              dev.ice.0.vsi.0.hw.rx_errors: 80819
              dev.ice.0.vsi.0.hw.rx_discards: 0
              dev.ice.0.vsi.0.hw.bcast_pkts_txd: 3619
              dev.ice.0.vsi.0.hw.mcast_pkts_txd: 2026
              dev.ice.0.vsi.0.hw.ucast_pkts_txd: 30087476
              dev.ice.0.vsi.0.hw.good_octets_txd: 39666180645
              dev.ice.0.vsi.0.hw.bcast_pkts_rcvd: 41573
              dev.ice.0.vsi.0.hw.mcast_pkts_rcvd: 13587
              dev.ice.0.vsi.0.hw.ucast_pkts_rcvd: 12938852
              dev.ice.0.vsi.0.hw.good_octets_rcvd: 11167514355
              dev.ice.0.vsi.0.rxqs.15.tc: 0
              dev.ice.0.vsi.0.rxqs.15.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.15.rx_bytes: 882905680
              dev.ice.0.vsi.0.rxqs.15.rx_packets: 1055875
              dev.ice.0.vsi.0.rxqs.14.tc: 0
              dev.ice.0.vsi.0.rxqs.14.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.14.rx_bytes: 258123337
              dev.ice.0.vsi.0.rxqs.14.rx_packets: 572700
              dev.ice.0.vsi.0.rxqs.13.tc: 0
              dev.ice.0.vsi.0.rxqs.13.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.13.rx_bytes: 705005746
              dev.ice.0.vsi.0.rxqs.13.rx_packets: 806158
              dev.ice.0.vsi.0.rxqs.12.tc: 0
              dev.ice.0.vsi.0.rxqs.12.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.12.rx_bytes: 1408111633
              dev.ice.0.vsi.0.rxqs.12.rx_packets: 1446943
              dev.ice.0.vsi.0.rxqs.11.tc: 0
              dev.ice.0.vsi.0.rxqs.11.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.11.rx_bytes: 630359670
              dev.ice.0.vsi.0.rxqs.11.rx_packets: 796073
              dev.ice.0.vsi.0.rxqs.10.tc: 0
              dev.ice.0.vsi.0.rxqs.10.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.10.rx_bytes: 133811946
              dev.ice.0.vsi.0.rxqs.10.rx_packets: 394220
              dev.ice.0.vsi.0.rxqs.9.tc: 0
              dev.ice.0.vsi.0.rxqs.9.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.9.rx_bytes: 748382695
              dev.ice.0.vsi.0.rxqs.9.rx_packets: 792313
              dev.ice.0.vsi.0.rxqs.8.tc: 0
              dev.ice.0.vsi.0.rxqs.8.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.8.rx_bytes: 520032859
              dev.ice.0.vsi.0.rxqs.8.rx_packets: 723884
              dev.ice.0.vsi.0.rxqs.7.tc: 0
              dev.ice.0.vsi.0.rxqs.7.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.7.rx_bytes: 1301408957
              dev.ice.0.vsi.0.rxqs.7.rx_packets: 1139247
              dev.ice.0.vsi.0.rxqs.6.tc: 0
              dev.ice.0.vsi.0.rxqs.6.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.6.rx_bytes: 657357668
              dev.ice.0.vsi.0.rxqs.6.rx_packets: 804895
              dev.ice.0.vsi.0.rxqs.5.tc: 0
              dev.ice.0.vsi.0.rxqs.5.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.5.rx_bytes: 1214393647
              dev.ice.0.vsi.0.rxqs.5.rx_packets: 1152397
              dev.ice.0.vsi.0.rxqs.4.tc: 0
              dev.ice.0.vsi.0.rxqs.4.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.4.rx_bytes: 849780262
              dev.ice.0.vsi.0.rxqs.4.rx_packets: 1007090
              dev.ice.0.vsi.0.rxqs.3.tc: 0
              dev.ice.0.vsi.0.rxqs.3.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.3.rx_bytes: 692483385
              dev.ice.0.vsi.0.rxqs.3.rx_packets: 959926
              dev.ice.0.vsi.0.rxqs.2.tc: 0
              dev.ice.0.vsi.0.rxqs.2.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.2.rx_bytes: 733654339
              dev.ice.0.vsi.0.rxqs.2.rx_packets: 637115
              dev.ice.0.vsi.0.rxqs.1.tc: 0
              dev.ice.0.vsi.0.rxqs.1.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.1.rx_bytes: 246293420
              dev.ice.0.vsi.0.rxqs.1.rx_packets: 298219
              dev.ice.0.vsi.0.rxqs.0.tc: 0
              dev.ice.0.vsi.0.rxqs.0.rx_desc_errs: 0
              dev.ice.0.vsi.0.rxqs.0.rx_bytes: 133434642
              dev.ice.0.vsi.0.rxqs.0.rx_packets: 406969
              dev.ice.0.vsi.0.txqs.15.tc: 0
              dev.ice.0.vsi.0.txqs.15.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.15.tx_bytes: 5009863414
              dev.ice.0.vsi.0.txqs.15.tx_packets: 3553266
              dev.ice.0.vsi.0.txqs.14.tc: 0
              dev.ice.0.vsi.0.txqs.14.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.14.tx_bytes: 3269769756
              dev.ice.0.vsi.0.txqs.14.tx_packets: 2472339
              dev.ice.0.vsi.0.txqs.13.tc: 0
              dev.ice.0.vsi.0.txqs.13.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.13.tx_bytes: 1354191371
              dev.ice.0.vsi.0.txqs.13.tx_packets: 1125846
              dev.ice.0.vsi.0.txqs.12.tc: 0
              dev.ice.0.vsi.0.txqs.12.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.12.tx_bytes: 1236800898
              dev.ice.0.vsi.0.txqs.12.tx_packets: 893641
              dev.ice.0.vsi.0.txqs.11.tc: 0
              dev.ice.0.vsi.0.txqs.11.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.11.tx_bytes: 616951915
              dev.ice.0.vsi.0.txqs.11.tx_packets: 656204
              dev.ice.0.vsi.0.txqs.10.tc: 0
              dev.ice.0.vsi.0.txqs.10.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.10.tx_bytes: 6960714692
              dev.ice.0.vsi.0.txqs.10.tx_packets: 5073471
              dev.ice.0.vsi.0.txqs.9.tc: 0
              dev.ice.0.vsi.0.txqs.9.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.9.tx_bytes: 3194825575
              dev.ice.0.vsi.0.txqs.9.tx_packets: 2359203
              dev.ice.0.vsi.0.txqs.8.tc: 0
              dev.ice.0.vsi.0.txqs.8.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.8.tx_bytes: 990671878
              dev.ice.0.vsi.0.txqs.8.tx_packets: 1446170
              dev.ice.0.vsi.0.txqs.7.tc: 0
              dev.ice.0.vsi.0.txqs.7.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.7.tx_bytes: 3754786493
              dev.ice.0.vsi.0.txqs.7.tx_packets: 2801144
              dev.ice.0.vsi.0.txqs.6.tc: 0
              dev.ice.0.vsi.0.txqs.6.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.6.tx_bytes: 3518980176
              dev.ice.0.vsi.0.txqs.6.tx_packets: 2727480
              dev.ice.0.vsi.0.txqs.5.tc: 0
              dev.ice.0.vsi.0.txqs.5.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.5.tx_bytes: 238001259
              dev.ice.0.vsi.0.txqs.5.tx_packets: 198912
              dev.ice.0.vsi.0.txqs.4.tc: 0
              dev.ice.0.vsi.0.txqs.4.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.4.tx_bytes: 2640622212
              dev.ice.0.vsi.0.txqs.4.tx_packets: 1839632
              dev.ice.0.vsi.0.txqs.3.tc: 0
              dev.ice.0.vsi.0.txqs.3.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.3.tx_bytes: 695883943
              dev.ice.0.vsi.0.txqs.3.tx_packets: 693558
              dev.ice.0.vsi.0.txqs.2.tc: 0
              dev.ice.0.vsi.0.txqs.2.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.2.tx_bytes: 3445477515
              dev.ice.0.vsi.0.txqs.2.tx_packets: 2387285
              dev.ice.0.vsi.0.txqs.1.tc: 0
              dev.ice.0.vsi.0.txqs.1.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.1.tx_bytes: 1891045884
              dev.ice.0.vsi.0.txqs.1.tx_packets: 1297858
              dev.ice.0.vsi.0.txqs.0.tc: 0
              dev.ice.0.vsi.0.txqs.0.mss_too_small: 0
              dev.ice.0.vsi.0.txqs.0.tx_bytes: 726804139
              dev.ice.0.vsi.0.txqs.0.tx_packets: 566434
              dev.ice.0.vsi.0.tx_itr: 50
              dev.ice.0.vsi.0.rx_itr: 50
              dev.ice.0.enable_health_events: 1
              dev.ice.0.iflib.rxq15.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq15.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq15.rxq_fl0.cidx: 131
              dev.ice.0.iflib.rxq15.rxq_fl0.pidx: 130
              dev.ice.0.iflib.rxq15.cpu: 15
              dev.ice.0.iflib.rxq14.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq14.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq14.rxq_fl0.cidx: 284
              dev.ice.0.iflib.rxq14.rxq_fl0.pidx: 283
              dev.ice.0.iflib.rxq14.cpu: 14
              dev.ice.0.iflib.rxq13.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq13.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq13.rxq_fl0.cidx: 270
              dev.ice.0.iflib.rxq13.rxq_fl0.pidx: 269
              dev.ice.0.iflib.rxq13.cpu: 13
              dev.ice.0.iflib.rxq12.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq12.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq12.rxq_fl0.cidx: 31
              dev.ice.0.iflib.rxq12.rxq_fl0.pidx: 30
              dev.ice.0.iflib.rxq12.cpu: 12
              dev.ice.0.iflib.rxq11.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq11.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq11.rxq_fl0.cidx: 425
              dev.ice.0.iflib.rxq11.rxq_fl0.pidx: 424
              dev.ice.0.iflib.rxq11.cpu: 11
              dev.ice.0.iflib.rxq10.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq10.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq10.rxq_fl0.cidx: 1004
              dev.ice.0.iflib.rxq10.rxq_fl0.pidx: 1003
              dev.ice.0.iflib.rxq10.cpu: 10
              dev.ice.0.iflib.rxq09.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq09.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq09.rxq_fl0.cidx: 761
              dev.ice.0.iflib.rxq09.rxq_fl0.pidx: 760
              dev.ice.0.iflib.rxq09.cpu: 9
              dev.ice.0.iflib.rxq08.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq08.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq08.rxq_fl0.cidx: 940
              dev.ice.0.iflib.rxq08.rxq_fl0.pidx: 939
              dev.ice.0.iflib.rxq08.cpu: 8
              dev.ice.0.iflib.rxq07.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq07.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq07.rxq_fl0.cidx: 559
              dev.ice.0.iflib.rxq07.rxq_fl0.pidx: 558
              dev.ice.0.iflib.rxq07.cpu: 7
              dev.ice.0.iflib.rxq06.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq06.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq06.rxq_fl0.cidx: 31
              dev.ice.0.iflib.rxq06.rxq_fl0.pidx: 30
              dev.ice.0.iflib.rxq06.cpu: 6
              dev.ice.0.iflib.rxq05.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq05.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq05.rxq_fl0.cidx: 397
              dev.ice.0.iflib.rxq05.rxq_fl0.pidx: 396
              dev.ice.0.iflib.rxq05.cpu: 5
              dev.ice.0.iflib.rxq04.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq04.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq04.rxq_fl0.cidx: 498
              dev.ice.0.iflib.rxq04.rxq_fl0.pidx: 497
              dev.ice.0.iflib.rxq04.cpu: 4
              dev.ice.0.iflib.rxq03.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq03.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq03.rxq_fl0.cidx: 438
              dev.ice.0.iflib.rxq03.rxq_fl0.pidx: 437
              dev.ice.0.iflib.rxq03.cpu: 3
              dev.ice.0.iflib.rxq02.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq02.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq02.rxq_fl0.cidx: 187
              dev.ice.0.iflib.rxq02.rxq_fl0.pidx: 186
              dev.ice.0.iflib.rxq02.cpu: 2
              dev.ice.0.iflib.rxq01.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq01.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq01.rxq_fl0.cidx: 235
              dev.ice.0.iflib.rxq01.rxq_fl0.pidx: 234
              dev.ice.0.iflib.rxq01.cpu: 1
              dev.ice.0.iflib.rxq00.rxq_fl0.buf_size: 2048
              dev.ice.0.iflib.rxq00.rxq_fl0.credits: 1023
              dev.ice.0.iflib.rxq00.rxq_fl0.cidx: 441
              dev.ice.0.iflib.rxq00.rxq_fl0.pidx: 440
              dev.ice.0.iflib.rxq00.cpu: 0
              dev.ice.0.iflib.txq15.r_abdications: 0
              dev.ice.0.iflib.txq15.r_restarts: 0
              dev.ice.0.iflib.txq15.r_stalls: 0
              dev.ice.0.iflib.txq15.r_starts: 3553268
              dev.ice.0.iflib.txq15.r_drops: 0
              dev.ice.0.iflib.txq15.r_enqueues: 3553288
              dev.ice.0.iflib.txq15.ring_state: pidx_head: 0008 pidx_tail: 0008 cidx: 0008 state: IDLE
              dev.ice.0.iflib.txq15.txq_cleaned: 3573769
              dev.ice.0.iflib.txq15.txq_processed: 3573777
              dev.ice.0.iflib.txq15.txq_in_use: 9
              dev.ice.0.iflib.txq15.txq_cidx_processed: 17
              dev.ice.0.iflib.txq15.txq_cidx: 9
              dev.ice.0.iflib.txq15.txq_pidx: 18
              dev.ice.0.iflib.txq15.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq15.txd_encap_efbig: 0
              dev.ice.0.iflib.txq15.tx_map_failed: 0
              dev.ice.0.iflib.txq15.no_desc_avail: 0
              dev.ice.0.iflib.txq15.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq15.m_pullups: 20536
              dev.ice.0.iflib.txq15.mbuf_defrag: 0
              dev.ice.0.iflib.txq15.cpu: 15
              dev.ice.0.iflib.txq14.r_abdications: 0
              dev.ice.0.iflib.txq14.r_restarts: 0
              dev.ice.0.iflib.txq14.r_stalls: 0
              dev.ice.0.iflib.txq14.r_starts: 2472348
              dev.ice.0.iflib.txq14.r_drops: 0
              dev.ice.0.iflib.txq14.r_enqueues: 2473236
              dev.ice.0.iflib.txq14.ring_state: pidx_head: 1300 pidx_tail: 1300 cidx: 1300 state: IDLE
              dev.ice.0.iflib.txq14.txq_cleaned: 3275668
              dev.ice.0.iflib.txq14.txq_processed: 3275676
              dev.ice.0.iflib.txq14.txq_in_use: 9
              dev.ice.0.iflib.txq14.txq_cidx_processed: 924
              dev.ice.0.iflib.txq14.txq_cidx: 916
              dev.ice.0.iflib.txq14.txq_pidx: 925
              dev.ice.0.iflib.txq14.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq14.txd_encap_efbig: 0
              dev.ice.0.iflib.txq14.tx_map_failed: 0
              dev.ice.0.iflib.txq14.no_desc_avail: 0
              dev.ice.0.iflib.txq14.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq14.m_pullups: 803335
              dev.ice.0.iflib.txq14.mbuf_defrag: 0
              dev.ice.0.iflib.txq14.cpu: 14
              dev.ice.0.iflib.txq13.r_abdications: 0
              dev.ice.0.iflib.txq13.r_restarts: 0
              dev.ice.0.iflib.txq13.r_stalls: 0
              dev.ice.0.iflib.txq13.r_starts: 1125853
              dev.ice.0.iflib.txq13.r_drops: 0
              dev.ice.0.iflib.txq13.r_enqueues: 1126304
              dev.ice.0.iflib.txq13.ring_state: pidx_head: 1952 pidx_tail: 1952 cidx: 1952 state: IDLE
              dev.ice.0.iflib.txq13.txq_cleaned: 1593521
              dev.ice.0.iflib.txq13.txq_processed: 1593529
              dev.ice.0.iflib.txq13.txq_in_use: 9
              dev.ice.0.iflib.txq13.txq_cidx_processed: 185
              dev.ice.0.iflib.txq13.txq_cidx: 177
              dev.ice.0.iflib.txq13.txq_pidx: 186
              dev.ice.0.iflib.txq13.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq13.txd_encap_efbig: 0
              dev.ice.0.iflib.txq13.tx_map_failed: 0
              dev.ice.0.iflib.txq13.no_desc_avail: 0
              dev.ice.0.iflib.txq13.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq13.m_pullups: 467669
              dev.ice.0.iflib.txq13.mbuf_defrag: 0
              dev.ice.0.iflib.txq13.cpu: 13
              dev.ice.0.iflib.txq12.r_abdications: 0
              dev.ice.0.iflib.txq12.r_restarts: 0
              dev.ice.0.iflib.txq12.r_stalls: 0
              dev.ice.0.iflib.txq12.r_starts: 893652
              dev.ice.0.iflib.txq12.r_drops: 0
              dev.ice.0.iflib.txq12.r_enqueues: 893969
              dev.ice.0.iflib.txq12.ring_state: pidx_head: 1041 pidx_tail: 1041 cidx: 1041 state: IDLE
              dev.ice.0.iflib.txq12.txq_cleaned: 1373488
              dev.ice.0.iflib.txq12.txq_processed: 1373496
              dev.ice.0.iflib.txq12.txq_in_use: 9
              dev.ice.0.iflib.txq12.txq_cidx_processed: 312
              dev.ice.0.iflib.txq12.txq_cidx: 304
              dev.ice.0.iflib.txq12.txq_pidx: 313
              dev.ice.0.iflib.txq12.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq12.txd_encap_efbig: 0
              dev.ice.0.iflib.txq12.tx_map_failed: 0
              dev.ice.0.iflib.txq12.no_desc_avail: 0
              dev.ice.0.iflib.txq12.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq12.m_pullups: 479933
              dev.ice.0.iflib.txq12.mbuf_defrag: 0
              dev.ice.0.iflib.txq12.cpu: 12
              dev.ice.0.iflib.txq11.r_abdications: 0
              dev.ice.0.iflib.txq11.r_restarts: 0
              dev.ice.0.iflib.txq11.r_stalls: 0
              dev.ice.0.iflib.txq11.r_starts: 656204
              dev.ice.0.iflib.txq11.r_drops: 0
              dev.ice.0.iflib.txq11.r_enqueues: 656207
              dev.ice.0.iflib.txq11.ring_state: pidx_head: 0847 pidx_tail: 0847 cidx: 0847 state: IDLE
              dev.ice.0.iflib.txq11.txq_cleaned: 692893
              dev.ice.0.iflib.txq11.txq_processed: 692901
              dev.ice.0.iflib.txq11.txq_in_use: 9
              dev.ice.0.iflib.txq11.txq_cidx_processed: 677
              dev.ice.0.iflib.txq11.txq_cidx: 669
              dev.ice.0.iflib.txq11.txq_pidx: 678
              dev.ice.0.iflib.txq11.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq11.txd_encap_efbig: 0
              dev.ice.0.iflib.txq11.tx_map_failed: 0
              dev.ice.0.iflib.txq11.no_desc_avail: 0
              dev.ice.0.iflib.txq11.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq11.m_pullups: 36716
              dev.ice.0.iflib.txq11.mbuf_defrag: 0
              dev.ice.0.iflib.txq11.cpu: 11
              dev.ice.0.iflib.txq10.r_abdications: 0
              dev.ice.0.iflib.txq10.r_restarts: 0
              dev.ice.0.iflib.txq10.r_stalls: 0
              dev.ice.0.iflib.txq10.r_starts: 5073465
              dev.ice.0.iflib.txq10.r_drops: 0
              dev.ice.0.iflib.txq10.r_enqueues: 5073482
              dev.ice.0.iflib.txq10.ring_state: pidx_head: 0586 pidx_tail: 0586 cidx: 0586 state: IDLE
              dev.ice.0.iflib.txq10.txq_cleaned: 5138342
              dev.ice.0.iflib.txq10.txq_processed: 5138350
              dev.ice.0.iflib.txq10.txq_in_use: 9
              dev.ice.0.iflib.txq10.txq_cidx_processed: 942
              dev.ice.0.iflib.txq10.txq_cidx: 934
              dev.ice.0.iflib.txq10.txq_pidx: 943
              dev.ice.0.iflib.txq10.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq10.txd_encap_efbig: 0
              dev.ice.0.iflib.txq10.tx_map_failed: 0
              dev.ice.0.iflib.txq10.no_desc_avail: 0
              dev.ice.0.iflib.txq10.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq10.m_pullups: 64868
              dev.ice.0.iflib.txq10.mbuf_defrag: 0
              dev.ice.0.iflib.txq10.cpu: 10
              dev.ice.0.iflib.txq09.r_abdications: 0
              dev.ice.0.iflib.txq09.r_restarts: 0
              dev.ice.0.iflib.txq09.r_stalls: 0
              dev.ice.0.iflib.txq09.r_starts: 2359201
              dev.ice.0.iflib.txq09.r_drops: 0
              dev.ice.0.iflib.txq09.r_enqueues: 2359250
              dev.ice.0.iflib.txq09.ring_state: pidx_head: 2002 pidx_tail: 2002 cidx: 2002 state: IDLE
              dev.ice.0.iflib.txq09.txq_cleaned: 2476265
              dev.ice.0.iflib.txq09.txq_processed: 2476273
              dev.ice.0.iflib.txq09.txq_in_use: 9
              dev.ice.0.iflib.txq09.txq_cidx_processed: 241
              dev.ice.0.iflib.txq09.txq_cidx: 233
              dev.ice.0.iflib.txq09.txq_pidx: 242
              dev.ice.0.iflib.txq09.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq09.txd_encap_efbig: 0
              dev.ice.0.iflib.txq09.tx_map_failed: 0
              dev.ice.0.iflib.txq09.no_desc_avail: 0
              dev.ice.0.iflib.txq09.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq09.m_pullups: 116450
              dev.ice.0.iflib.txq09.mbuf_defrag: 0
              dev.ice.0.iflib.txq09.cpu: 9
              dev.ice.0.iflib.txq08.r_abdications: 0
              dev.ice.0.iflib.txq08.r_restarts: 0
              dev.ice.0.iflib.txq08.r_stalls: 0
              dev.ice.0.iflib.txq08.r_starts: 1446159
              dev.ice.0.iflib.txq08.r_drops: 0
              dev.ice.0.iflib.txq08.r_enqueues: 1446670
              dev.ice.0.iflib.txq08.ring_state: pidx_head: 0782 pidx_tail: 0782 cidx: 0782 state: IDLE
              dev.ice.0.iflib.txq08.txq_cleaned: 2061607
              dev.ice.0.iflib.txq08.txq_processed: 2061615
              dev.ice.0.iflib.txq08.txq_in_use: 9
              dev.ice.0.iflib.txq08.txq_cidx_processed: 303
              dev.ice.0.iflib.txq08.txq_cidx: 295
              dev.ice.0.iflib.txq08.txq_pidx: 304
              dev.ice.0.iflib.txq08.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq08.txd_encap_efbig: 0
              dev.ice.0.iflib.txq08.tx_map_failed: 0
              dev.ice.0.iflib.txq08.no_desc_avail: 0
              dev.ice.0.iflib.txq08.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq08.m_pullups: 615470
              dev.ice.0.iflib.txq08.mbuf_defrag: 0
              dev.ice.0.iflib.txq08.cpu: 8
              dev.ice.0.iflib.txq07.r_abdications: 0
              dev.ice.0.iflib.txq07.r_restarts: 0
              dev.ice.0.iflib.txq07.r_stalls: 0
              dev.ice.0.iflib.txq07.r_starts: 2801146
              dev.ice.0.iflib.txq07.r_drops: 0
              dev.ice.0.iflib.txq07.r_enqueues: 2801205
              dev.ice.0.iflib.txq07.ring_state: pidx_head: 1589 pidx_tail: 1589 cidx: 1589 state: IDLE
              dev.ice.0.iflib.txq07.txq_cleaned: 2876211
              dev.ice.0.iflib.txq07.txq_processed: 2876219
              dev.ice.0.iflib.txq07.txq_in_use: 9
              dev.ice.0.iflib.txq07.txq_cidx_processed: 827
              dev.ice.0.iflib.txq07.txq_cidx: 819
              dev.ice.0.iflib.txq07.txq_pidx: 828
              dev.ice.0.iflib.txq07.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq07.txd_encap_efbig: 0
              dev.ice.0.iflib.txq07.tx_map_failed: 0
              dev.ice.0.iflib.txq07.no_desc_avail: 0
              dev.ice.0.iflib.txq07.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq07.m_pullups: 75084
              dev.ice.0.iflib.txq07.mbuf_defrag: 0
              dev.ice.0.iflib.txq07.cpu: 7
              dev.ice.0.iflib.txq06.r_abdications: 0
              dev.ice.0.iflib.txq06.r_restarts: 0
              dev.ice.0.iflib.txq06.r_stalls: 0
              dev.ice.0.iflib.txq06.r_starts: 2727485
              dev.ice.0.iflib.txq06.r_drops: 0
              dev.ice.0.iflib.txq06.r_enqueues: 2727785
              dev.ice.0.iflib.txq06.ring_state: pidx_head: 1897 pidx_tail: 1897 cidx: 1897 state: IDLE
              dev.ice.0.iflib.txq06.txq_cleaned: 3150601
              dev.ice.0.iflib.txq06.txq_processed: 3150609
              dev.ice.0.iflib.txq06.txq_in_use: 9
              dev.ice.0.iflib.txq06.txq_cidx_processed: 785
              dev.ice.0.iflib.txq06.txq_cidx: 777
              dev.ice.0.iflib.txq06.txq_pidx: 786
              dev.ice.0.iflib.txq06.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq06.txd_encap_efbig: 0
              dev.ice.0.iflib.txq06.tx_map_failed: 0
              dev.ice.0.iflib.txq06.no_desc_avail: 0
              dev.ice.0.iflib.txq06.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq06.m_pullups: 423147
              dev.ice.0.iflib.txq06.mbuf_defrag: 0
              dev.ice.0.iflib.txq06.cpu: 6
              dev.ice.0.iflib.txq05.r_abdications: 0
              dev.ice.0.iflib.txq05.r_restarts: 0
              dev.ice.0.iflib.txq05.r_stalls: 0
              dev.ice.0.iflib.txq05.r_starts: 198912
              dev.ice.0.iflib.txq05.r_drops: 0
              dev.ice.0.iflib.txq05.r_enqueues: 198913
              dev.ice.0.iflib.txq05.ring_state: pidx_head: 0257 pidx_tail: 0257 cidx: 0257 state: IDLE
              dev.ice.0.iflib.txq05.txq_cleaned: 324283
              dev.ice.0.iflib.txq05.txq_processed: 324291
              dev.ice.0.iflib.txq05.txq_in_use: 9
              dev.ice.0.iflib.txq05.txq_cidx_processed: 707
              dev.ice.0.iflib.txq05.txq_cidx: 699
              dev.ice.0.iflib.txq05.txq_pidx: 708
              dev.ice.0.iflib.txq05.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq05.txd_encap_efbig: 0
              dev.ice.0.iflib.txq05.tx_map_failed: 0
              dev.ice.0.iflib.txq05.no_desc_avail: 0
              dev.ice.0.iflib.txq05.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq05.m_pullups: 125387
              dev.ice.0.iflib.txq05.mbuf_defrag: 0
              dev.ice.0.iflib.txq05.cpu: 5
              dev.ice.0.iflib.txq04.r_abdications: 0
              dev.ice.0.iflib.txq04.r_restarts: 0
              dev.ice.0.iflib.txq04.r_stalls: 0
              dev.ice.0.iflib.txq04.r_starts: 1839641
              dev.ice.0.iflib.txq04.r_drops: 0
              dev.ice.0.iflib.txq04.r_enqueues: 1839974
              dev.ice.0.iflib.txq04.ring_state: pidx_head: 0870 pidx_tail: 0870 cidx: 0870 state: IDLE
              dev.ice.0.iflib.txq04.txq_cleaned: 2429187
              dev.ice.0.iflib.txq04.txq_processed: 2429195
              dev.ice.0.iflib.txq04.txq_in_use: 9
              dev.ice.0.iflib.txq04.txq_cidx_processed: 267
              dev.ice.0.iflib.txq04.txq_cidx: 259
              dev.ice.0.iflib.txq04.txq_pidx: 268
              dev.ice.0.iflib.txq04.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq04.txd_encap_efbig: 0
              dev.ice.0.iflib.txq04.tx_map_failed: 0
              dev.ice.0.iflib.txq04.no_desc_avail: 0
              dev.ice.0.iflib.txq04.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq04.m_pullups: 589597
              dev.ice.0.iflib.txq04.mbuf_defrag: 0
              dev.ice.0.iflib.txq04.cpu: 4
              dev.ice.0.iflib.txq03.r_abdications: 0
              dev.ice.0.iflib.txq03.r_restarts: 0
              dev.ice.0.iflib.txq03.r_stalls: 0
              dev.ice.0.iflib.txq03.r_starts: 693558
              dev.ice.0.iflib.txq03.r_drops: 0
              dev.ice.0.iflib.txq03.r_enqueues: 693587
              dev.ice.0.iflib.txq03.ring_state: pidx_head: 1363 pidx_tail: 1363 cidx: 1363 state: IDLE
              dev.ice.0.iflib.txq03.txq_cleaned: 1048273
              dev.ice.0.iflib.txq03.txq_processed: 1048281
              dev.ice.0.iflib.txq03.txq_in_use: 9
              dev.ice.0.iflib.txq03.txq_cidx_processed: 729
              dev.ice.0.iflib.txq03.txq_cidx: 721
              dev.ice.0.iflib.txq03.txq_pidx: 730
              dev.ice.0.iflib.txq03.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq03.txd_encap_efbig: 0
              dev.ice.0.iflib.txq03.tx_map_failed: 0
              dev.ice.0.iflib.txq03.no_desc_avail: 0
              dev.ice.0.iflib.txq03.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq03.m_pullups: 354758
              dev.ice.0.iflib.txq03.mbuf_defrag: 0
              dev.ice.0.iflib.txq03.cpu: 3
              dev.ice.0.iflib.txq02.r_abdications: 0
              dev.ice.0.iflib.txq02.r_restarts: 0
              dev.ice.0.iflib.txq02.r_stalls: 0
              dev.ice.0.iflib.txq02.r_starts: 2387279
              dev.ice.0.iflib.txq02.r_drops: 0
              dev.ice.0.iflib.txq02.r_enqueues: 2387303
              dev.ice.0.iflib.txq02.ring_state: pidx_head: 1383 pidx_tail: 1383 cidx: 1383 state: IDLE
              dev.ice.0.iflib.txq02.txq_cleaned: 3138607
              dev.ice.0.iflib.txq02.txq_processed: 3138615
              dev.ice.0.iflib.txq02.txq_in_use: 9
              dev.ice.0.iflib.txq02.txq_cidx_processed: 55
              dev.ice.0.iflib.txq02.txq_cidx: 47
              dev.ice.0.iflib.txq02.txq_pidx: 56
              dev.ice.0.iflib.txq02.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq02.txd_encap_efbig: 0
              dev.ice.0.iflib.txq02.tx_map_failed: 0
              dev.ice.0.iflib.txq02.no_desc_avail: 0
              dev.ice.0.iflib.txq02.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq02.m_pullups: 751336
              dev.ice.0.iflib.txq02.mbuf_defrag: 0
              dev.ice.0.iflib.txq02.cpu: 2
              dev.ice.0.iflib.txq01.r_abdications: 0
              dev.ice.0.iflib.txq01.r_restarts: 0
              dev.ice.0.iflib.txq01.r_stalls: 0
              dev.ice.0.iflib.txq01.r_starts: 1297857
              dev.ice.0.iflib.txq01.r_drops: 0
              dev.ice.0.iflib.txq01.r_enqueues: 1297859
              dev.ice.0.iflib.txq01.ring_state: pidx_head: 1475 pidx_tail: 1475 cidx: 1475 state: IDLE
              dev.ice.0.iflib.txq01.txq_cleaned: 1767918
              dev.ice.0.iflib.txq01.txq_processed: 1767926
              dev.ice.0.iflib.txq01.txq_in_use: 9
              dev.ice.0.iflib.txq01.txq_cidx_processed: 502
              dev.ice.0.iflib.txq01.txq_cidx: 494
              dev.ice.0.iflib.txq01.txq_pidx: 503
              dev.ice.0.iflib.txq01.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq01.txd_encap_efbig: 0
              dev.ice.0.iflib.txq01.tx_map_failed: 0
              dev.ice.0.iflib.txq01.no_desc_avail: 0
              dev.ice.0.iflib.txq01.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq01.m_pullups: 470079
              dev.ice.0.iflib.txq01.mbuf_defrag: 0
              dev.ice.0.iflib.txq01.cpu: 1
              dev.ice.0.iflib.txq00.r_abdications: 0
              dev.ice.0.iflib.txq00.r_restarts: 0
              dev.ice.0.iflib.txq00.r_stalls: 0
              dev.ice.0.iflib.txq00.r_starts: 566418
              dev.ice.0.iflib.txq00.r_drops: 0
              dev.ice.0.iflib.txq00.r_enqueues: 566437
              dev.ice.0.iflib.txq00.ring_state: pidx_head: 1189 pidx_tail: 1189 cidx: 1189 state: IDLE
              dev.ice.0.iflib.txq00.txq_cleaned: 1018256
              dev.ice.0.iflib.txq00.txq_processed: 1018264
              dev.ice.0.iflib.txq00.txq_in_use: 9
              dev.ice.0.iflib.txq00.txq_cidx_processed: 408
              dev.ice.0.iflib.txq00.txq_cidx: 400
              dev.ice.0.iflib.txq00.txq_pidx: 409
              dev.ice.0.iflib.txq00.no_tx_dma_setup: 0
              dev.ice.0.iflib.txq00.txd_encap_efbig: 0
              dev.ice.0.iflib.txq00.tx_map_failed: 0
              dev.ice.0.iflib.txq00.no_desc_avail: 0
              dev.ice.0.iflib.txq00.mbuf_defrag_failed: 0
              dev.ice.0.iflib.txq00.m_pullups: 451063
              dev.ice.0.iflib.txq00.mbuf_defrag: 0
              dev.ice.0.iflib.txq00.cpu: 0
              dev.ice.0.iflib.override_nrxds: 0
              dev.ice.0.iflib.override_ntxds: 0
              dev.ice.0.iflib.use_logical_cores: 0
              dev.ice.0.iflib.separate_txrx: 0
              dev.ice.0.iflib.core_offset: 0
              dev.ice.0.iflib.tx_abdicate: 0
              dev.ice.0.iflib.rx_budget: 0
              dev.ice.0.iflib.disable_msix: 0
              dev.ice.0.iflib.override_qs_enable: 0
              dev.ice.0.iflib.override_nrxqs: 0
              dev.ice.0.iflib.override_ntxqs: 0
              dev.ice.0.iflib.driver_version: 1.37.11-k
              dev.ice.0.%parent: pci2
              dev.ice.0.%pnpinfo: vendor=0x8086 device=0x1592 subvendor=0x8086 subdevice=0x0002 class=0x020000
              dev.ice.0.%location: slot=0 function=0 dbsf=pci0:2:0:0 handle=\_SB_.PCI0.SE1_.S00_
              dev.ice.0.%driver: ice
              dev.ice.0.%desc: Intel(R) Ethernet Network Adapter E810-C-Q2 - 1.37.11-k
              
              

              I noticed another issue. In my initial post I mentioned that the E810 is running the latest driver compiled from Intel's source, but I may be mistaken. It seems like the if_{driver name}_load="YES" setting to load a driver from module instead of iflib doesn't work the same with ice. ice_ddp_load="YES" works fine to load ice_ddp.ko, but if_ice_load="YES" doesn't seem to replace the iflib ice driver with if_ice.ko from modules. I've done this with ix and ixl drivers without any issues, but ice is somehow different. Following is the interface boot information.

              module ice already present!
              ...
              ice0: <Intel(R) Ethernet Network Adapter E810-C-Q2 - 1.37.11-k> mem 0x380800000000-0x380801ffffff,0x380802000000-0x38080200ffff irq 16 at device 0.0 on pci2
              ice0: Loading the iflib ice driver
              ice0: DDP package already present on device: ICE OS Default Package version 1.3.36.0, track id 0xc0000001.
              ice0: fw 7.5.4 api 1.7 nvm 4.50 etid 8001d8b6 netlist 4.3.2000-3.25.0.a2703c1c oem 1.3597.0
              ice0: Using 16 Tx and Rx queues
              ice0: Reserving 16 MSI-X interrupts for iRDMA
              ice0: Using MSI-X interrupts with 33 vectors
              ice0: Using 1024 TX descriptors and 1024 RX descriptors
              ice0: Ethernet address: XX:XX:XX:XX:XX:XX
              ice0: PCI Express Bus: Speed 16.0GT/s Width x16
              ice0: Firmware LLDP agent disabled
              ice0: link state changed to DOWN
              ice0: netmap queues/slots: TX 16/1024, RX 16/1024
              

              Also notice the "module ice already present!" message by itself at the start of the boot log. This is different than what I see when an iflib driver is replaced with a module, like the following...

              module_register: cannot register pci/ix from kernel; already loaded from if_ix.ko
              Module pci/ix failed to register: 17
              module_register: cannot register pci/ixl from kernel; already loaded from if_ixl.ko
              Module pci/ixl failed to register: 17
              
              1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                Hmm, so it's not that it reports under or oversized frames but that they don't match the expected size. Feels like a hardware offloading issue perhaps.

                What options do you have enabled there?: ifconfig -vm ice0

                L 1 Reply Last reply Reply Quote 0
                • L
                  Louis89 @stephenw10
                  last edited by

                  @stephenw10 Perhaps. All hardware offloading is enabled. I tested this system with a variety of hardware offloading options and found all enabled to provide the best performance while using the least resources. I hadn't noticed any stability issues during testing, but I may have simply missed the rx_length_errors appearing only when some offloading setting was enabled.

                  Following is the output of ifconfig -vm ice0

                  ice0: flags=1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500
                  	description: LAN_ADMIN
                  	options=4e507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
                  	capabilities=4f507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,MEXTPG>
                  	ether xx:xx:xx:xx:xx:xx
                  	inet 192.168.0.1 netmask 0xffffff00 broadcast 192.168.0.255
                  	inet6 fe80::xxxx:xxxx:xxxx:xxxx%ice0 prefixlen 64 scopeid 0x3
                  	inet6 fe80::1:1%ice0 prefixlen 64 scopeid 0x3
                  	inet6 2600:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx:xxxx prefixlen 64
                  	media: Ethernet autoselect (100G-CAUI4 <full-duplex,rxpause,txpause>)
                  	status: active
                  	supported media:
                  		media autoselect
                  		media 100G-CAUI4
                  		media 100GBase-CR4
                  		media 50G-LAUI2
                  		media 50GBase-CR2
                  		media 25G-AUI
                  		media 25GBase-CR1
                  		media 25GBase-CR-S
                  		media 25GBase-CR
                  		media 10Gbase-Twinax
                  	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
                  	drivername: ice0
                  	plugged: QSFP28 Unknown (No separable connector)
                  	vendor: FS PN: Q28-PC015 SN: C2402153131-2 DATE: 2024-02-05
                  	module temperature: 0.00 C voltage: 0.00 Volts
                  	lane 1: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
                  	lane 2: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
                  	lane 3: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
                  	lane 4: RX power: 0.00 mW (-inf dBm) TX bias: 0.00 mA
                  
                  1 Reply Last reply Reply Quote 0
                  • stephenw10S
                    stephenw10 Netgate Administrator
                    last edited by

                    Mmm, I would have though it would have been a much bigger impact if it was really reporting good packets as bad.

                    Unfortunately I have no 100G gear to test with. 😉

                    1 Reply Last reply Reply Quote 0
                    • First post
                      Last post
                    Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.