10 Gig Trouble

imw

I've spent the last couple of days trying to get a couple of Xeon D 1540 SoC's to play ball. I'd expect initial bring-up to be a snap, as these are the same boards sold by ESF here: https://store.pfsense.org/XG-1540/

Thing is, there appears to be some strangeness with the ixgbe drivers. On boot, the 10gig interfaces come up fine. If, however, they are unplugged and plugged back in, they will proceed to go up and down until the system is rebooted. Has anyone else experienced the same?
In /boot/loader.conf.local I've set:
kern.ipc.nmbclusters="1000000"
kern.ipc.nmbjumbop="524288"
hw.inter_storm_threshold=10000

As well as just about every permutation involving:
hw.ix.fc_setting=0
hw.pci.enable_msix=0
hw.pci.enable_msi=0

dmesg says the system has ixgbe driver 2.8.3. I've tried pfSense 2.2.5, 2.2.6, and 2.2.3.
Let me know if there is any other info that would be helpful.

Guest

I've spent the last couple of days trying to get a couple of Xeon D 1540 SoC's to play ball. I'd expect initial bring-up to be a snap, as these are the same boards sold by ESF here: https://store.pfsense.org/XG-1540/

And what exactly board from which vendor you got then? Is your machine from the pfSense-store?
Or is it from another vendor?

Thing is, there appears to be some strangeness with the ixgbe drivers.On boot, the 10gig interfaces come up fine. If, however, they are unplugged and plugged back in, they will proceed to go up and down until the system is rebooted. Has anyone else experienced the same?

What did you set up in the BIOS LAN settings? Are there anything that you must configure out to get rid of this
problem?

dmesg says the system has ixgbe driver 2.8.3. I've tried pfSense 2.2.5, 2.2.6, and 2.2.3.
Let me know if there is any other info that would be helpful.

What is on the other side of the cable you have plugged in the LAN port?
And why you are unplugging the LAN port and then you replug it in?

The mbuf size settings can also be fine tuned upwards if you low down the numbers to 65.000
or something else it could be also a gain, this must be tried out many times with different kinds
and amounts of workload and not only if you high up them.

as these are the same boards sold by ESF here: https://store.pfsense.org/XG-1540/

There are many different boards out from also different vendors! So it can be also different boards
and/or NIC driver need to install.

Older D-1520 and D-1540 boards
That is not tended to play only in only one section
Newer D-15x8 boards with a Intel Xeon D- SoCs
That are network accelerated SKUs
Newer D-1537 and D-15x1 boards with a Pentium D SoCs on it
That are storage accelerated SKUs

Newer D-1557 and D-1587 boards with Intel Xeon D-SoCs
Big Data & cloud accelerated SKUs

So you will see that this is all the Intel D-15xx SoC even on the boards but for an absolutely
other case of usage, so it would be really nice to know what kind exactly you are owning.

cmb

That's a driver issue that we just imported a fix for into 2.3 today. Needs more testing still, but seems to be fixed now.