Weird Behavior with x710-da2 in 2.5.x

stephenw10

Nice. That's interesting. I wonder what is on that list that affects pass-through NICs.

The hardware off-load settings rarely make much difference. I would certainly not enable anything that's disabled by default. So that means only checksum off-load which is still enabled by default.

Steve

tman222

@stephenw10 said in Weird Behavior with x710-da2 in 2.5.x:

Nice. That's interesting. I wonder what is on that list that affects pass-through NICs.

Good catch @tman222

The hardware off-load settings rarely make much difference. I would certainly not enable anything that's disabled by default. So that means only checksum off-load which is still enabled by default.

Steve

Hi @stephenw10 - looking Jim's comment here and the bug report (towards the end):

https://forum.netgate.com/topic/157688/remove-vmware-msi-x-from-the-pci-blacklist/2
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203874

If I understand right, this fix never made into FreeBSD 12. Would it be worth raising an issue on Redmine? At the very least, if the fix is missing, maybe add the sysctl tunable?

Thanks in advance!

stephenw10

I had thought this only applied to the vmxnet NICs but if you look at the diff on the patch it actually applied to the VMWare PCI bridge so I guess this could still be in play.
It is odd though, it still comes up with 6 queues in the above example, just using MSI not MSIX.

deridiot

@stephenw10

I am the other individual mentioned. I have a Quad SFP+ PCI-e 3x card on a ESXi 6.7U3 server. It's an OEM? card (Branded- Silicom PE310G4I71LB-XR) which runs an older FW. I have passed through 2 ports to pfSense and it had the same latency issues mentioned but is working perfectly fine in Windows 10, Server 2022 and Sophos UTM (bleh). I will attempt the above fix this weekend when I perform a switchover and report back.

deridiot

@deridiot

Issue still present on below build, resolved with the same change mentioned above.

2.7.0-DEVELOPMENT (amd64)
built on Fri Feb 04 19:41:27 UTC 2022
FreeBSD 12.3-STABLE

A Former User

@deridiot said in Weird Behavior with x710-da2 in 2.5.x:

Issue still present on below build, resolved with the same change mentioned above.
2.7.0-DEVELOPMENT (amd64)
built on Fri Feb 04 19:41:27 UTC 2022
FreeBSD 12.3-STABLE

Installing 2.6 and update to 21.05.2 was solving that problem for a X710-T2 adapter, so perhaps it could work for you too.