Intel 10G NICs don't come up: Could not setup receive structures.

[ehuk]

Hi Guys,

We recently upgraded to the 24/11/2014 snapshot, and suddenly someone of our Intel 10G NICs can't start and report:

ix2: Could not setup receive structures
ix3: Cloud not setup receive structures.

I upgraded this to the 01/12/2014 snapshot but the results are the same.

The primary node in this cluster is built on the 18/11/2014 snapshot and is working fine. Any ideas what could be causing this, and does anyone know where I can download the 18/11/2014 snapshot so I can rule out a hardware issue?

Cheers,
EHUK.

[cmb]

Not enough mbufs.
https://doc.pfsense.org/index.php/Tuning_and_Troubleshooting_Network_Cards

[ehuk]

My MBUF usage for the broken box is 6% (7600/131072).

I added the following to /etc/sysctl.conf

kern.ipc.nmbclusters=262144
kern.ipc.nmbjumbop=262144
kern.ipc.nmbjumbo16=32000
kern.ipc.nmbjumbo9=64000

This seems to have bought up everything but ix1, when I try and bring it up:

[zone: mbuf_jumbo_9k] kern.ipc.nmbjumbo9 limit reached
fw02 kernel: ix1: Could not setup receive structures

ix0, ix2 and ix3 are now up.

I will continue to tweak and let you know my results.

[ehuk]

After much tweaking, I still can't get the two WAN NICs up and running. What is strange is that the primary node is running fine on the older build.

cmb, any chance I can grab the 18/11/2014 snapshot?

[eri--]

You should probably limit the queues of ix1 to less or tune the nmblusters more up as required.