Intel X710-T2L Strange Error Message

jerseymike

Hi all.

I just replaced my X540 NIC with an X710-T2L. Now I'm seeing the following message pop-up in dmesg and occasionally on the console:

ixl0: Failed to remove 0/1 filters, error I40E_AQ_RC_ENOENT

Anyone ever seen this/know what exactly this means?

DaddyGo

@jerseymike said in Intel X710-T2L Strange Error Message:

Anyone ever seen this/know what exactly this means?

Hi,

Hmmm, if i remember correctly this is an Intel Linux driver AdminQ handler error code, which if all is true is about removing VLAN filters

Is the 710 Intel FW in its last state?
Did you just pull out the 540 and put in the 710? (IXGBE(4) to IXL(4))

jerseymike

@daddygo Yes, that's exactly what I did. Pulled the X540 and put in the X710 and then rebooted. The X710 was immediately recognized and I had to go through the WAN/LAN assignment questions. Other than that, nothing else.

I checked the X710s firmware and according to the Intel site, it's the latest (v8.40):

[2.5.2-RELEASE][admin@pfSense.localdomain]/root: sysctl dev.ixl.0.fw_version
dev.ixl.0.fw_version: fw 8.4.66032 api 1.14 nvm 8.40 etid 8000aba9 oem 1.267.0
[2.5.2-RELEASE][admin@pfSense.localdomain]/root: sysctl dev.ixl.0.iflib.driver_version
dev.ixl.0.iflib.driver_version: 2.3.0-k

Also found a dmesg message complaining that the firmware driver is "newer expected" ??

ixl0: <Intel(R) Ethernet Controller X710 for 10GBASE-T - 2.3.0-k> mem 0xa1000000-0xa1ffffff,0xa2008000-0xa200ffff at device 0.0 on pci1
ixl0: fw 8.4.66032 api 1.14 nvm 8.40 etid 8000aba9 oem 1.267.0
ixl0: The driver for the device detected a newer version of the NVM image than expected.
ixl0: Please install the most recent version of the network driver.

DaddyGo

@jerseymike said in Intel X710-T2L Strange Error Message:

Also found a dmesg message complaining that the firmware driver is "newer expected" ??

Ahhh,

The version in FreeBSD does not always immediately follow the latest Intel version, it depends a lot on who compiles it, how and when.

This can be a problem ....(?!)

BTW:
we also use several 710's, I can't look at the version right now, but will do later - these have worked trouble free for a few years and have not been updated with manufacturer FW

otherwise does the error message cause significant problems?
or is it just annoying to have it there?

stephenw10

Just for reference the card I have here shows:

[21.09-BETA][root@7100.stevew.lan]/root: sysctl dev.ixl.0.fw_version
dev.ixl.0.fw_version: fw 7.0.50775 api 1.8 nvm 7.00 etid 8000521b oem 0.0.0

I've not seen that error before.

Steve

jerseymike

@daddygo So far I don't see any issues, everything is working normally. Was just caught off guard by that message.

Regarding the driver, would it make sense to boot up a FreeBSD VM and compile the latest driver from Intel, or would that possibly "break" pfSense?

DaddyGo

@jerseymike said in Intel X710-T2L Strange Error Message:

Regarding the driver, would it make sense to boot up a FreeBSD VM and compile the latest driver from Intel, or would that possibly "break" pfSense?

On a VM, just out of curiosity, it would be worth, but as long as it is not officially part of FreeBSD stable and does not cause problems I would not patch.

As you can see Steve's version is older, probably our version too, as I haven't seen this error yet on FreeBSD.
(I came across it on a Linux VPS a few months ago that's why I remembered it)

Pls. let me know if you manage to compile it, because we have 5 - 6 of these cards and I'm interested....

jerseymike

@daddygo I was able to compile the latest version of the ixl driver (1.12.24) and load it up.

Everything seems to be working fine, but I'm still getting those filter error messages:

ixl0: <Intel(R) Ethernet Connection 700 Series PF Driver, Version - 1.12.24> mem 0xa1000000-0xa1ffffff,0xa2008000-0xa200ffff at device 0.0 on pci1
ixl0: using 1024 tx descriptors and 1024 rx descriptors
ixl0: fw 8.4.66032 api 1.14 nvm 8.40 etid 8000aba9 oem 1.267.0
ixl0: PF-ID[0]: VFs 64, MSI-X 129, VF MSI-X 5, QPs 768, MDIO shared
ixl0: Using MSI-X interrupts with 7 vectors
ixl0: Allocating 8 queues for PF LAN VSI; 6 queues active
ixl0: Ethernet address: 68:05:ca:df:bb:de
ixl0: PCI Express Bus: Speed 8.0GT/s Width x8
ixl0: SR-IOV ready
ixl0: The device is not iWARP enabled

ixl0: TSO4 requires txcsum, disabling both...
ixl0: TSO6 requires txcsum6, disabling both...

ixl0: Use 'advertise_speed' sysctl to change advertised speeds
ixl0: Link is up, 2.5 Gbps Full Duplex, Requested FEC: None, Negotiated FEC: CL74 FC-FEC/BASE-R, Autoneg: True, Flow Control: None
ixl0: link state changed to UP
ixl0: ixl_del_hw_filters: i40e_aq_remove_macvlan status I40E_ERR_ADMIN_QUEUE_ERROR, error I40E_AQ_RC_ENOENT

DaddyGo

@jerseymike said in Intel X710-T2L Strange Error Message:

but I'm still getting those filter error messages:

OMG I was sure it would be a FW question, we are no closer to a solution....

do you have many VLANs?

as I recall this is a VLAN filter reset issue

if you save one (pfS) and redefine VLAN(s) from zero, I think we will see more

what is your opinion?

jerseymike

@daddygo I don't have any VLANs at all.

mloiterman

@jerseymike

I have the Intel X710 card too and have encountered a few strange issues which I will list below.

First, here's the status of my drivers, firmware, etc...

dev.ixl.0.fw_version: fw 8.4.66032 api 1.14 nvm 8.40 etid 8000aba9 oem 1.267.0
dev.ixl.0.%desc: Intel(R) Ethernet Connection 700 Series PF Driver, Version - 1.12.16

In terms of strange issues:

My ISP modem (Arris S33) has a 2.5GBASE-T which connects to my ixl0 port. It connects fine, but reports in the pfSense GUI:

Unknown <full-duplex>

even though systctl shows:

dev.ixl.0.current_speed: 2.5 Gbps

In order to achieve my maximum 1Gbps WAN speed, I have to enable Flow Control on my ixl1 port which is connected to my LAN. If I disable that, my WAN speed drops in half.
I get a similar error to you in my dmesg:

ixl0: ixl_del_hw_filters: i40e_aq_remove_macvlan status I40E_ERR_ADMIN_QUEUE_ERROR, error I40E_AQ_RC_ENOENT

I'm currently on the latest firmware (8.40) and have compiled my own driver so I can use version 1.12.16. This is one rev back from the latest (1.12.24). If I try to use 1.12.24, the issue with the Unknown connection speed goes away, but then there is an odd issue where pfSense cannot route out the ixl0 interface. So, my LAN connects to ixl1 fine and my WAN interface appears to connect to ixl0 fine. It pulls an IP address and the interface shows as up.

But, pfSense reports that the WAN Gateway is down. It seems like there is some issue with the route on that interface, but I can't figure out why one driver would work and one driver causing routing to fail.

It seems like it is a driver issue, but it might be some kind of misconfiguration on my side that only appears with the new driver. Either way, I continue to use the 1.12.16 driver that I compiled and it seems to work fine, but I do get the error above VLANS when I restart or cause the WAN interface to go up or down, and I still have to enable Flow Control on my LAN.

I don't have any VLANs configured in pfSense, but I do have VLANs configured on my switch.

stephenw10

@mloiterman said in Intel X710-T2L Strange Error Message:

Unknown <full-duplex>

Showing that at 2.5G is expected (or at least common) on that NIC but doesn't usually mean there's an issue.
Were you actually seeing a problem with the older driver/firmware?

Steve

mloiterman

@stephenw10

It seemed like performance was less than what it is with the new driver. I didn't do any formal test, but subjectively, the newer driver seems to provide better performance.