Intel 10G NICs don't come up: Could not setup receive structures.


  • Hi Guys,

    We recently upgraded to the 24/11/2014 snapshot, and suddenly someone of our Intel 10G NICs can't start and report:

    ix2: Could not setup receive structures
    ix3: Cloud not setup receive structures.

    I upgraded this to the 01/12/2014 snapshot but the results are the same.

    The primary node in this cluster is built on the 18/11/2014 snapshot and is working fine. Any ideas what could be causing this, and does anyone know where I can download the 18/11/2014 snapshot so I can rule out a hardware issue?

    Cheers,
    EHUK.



  • My MBUF usage for the broken box is 6% (7600/131072).

    I added the following to /etc/sysctl.conf

    kern.ipc.nmbclusters=262144
    kern.ipc.nmbjumbop=262144
    kern.ipc.nmbjumbo16=32000
    kern.ipc.nmbjumbo9=64000

    This seems to have bought up everything but ix1, when I try and bring it up:

    [zone: mbuf_jumbo_9k] kern.ipc.nmbjumbo9 limit reached
    fw02 kernel: ix1: Could not setup receive structures

    ix0, ix2 and ix3 are now up.

    I will continue to tweak and let you know my results.


  • After much tweaking, I still can't get the two WAN NICs up and running. What is strange is that the primary node is running fine on the older build.

    cmb, any chance I can grab the 18/11/2014 snapshot?


  • You should probably limit the queues of ix1 to less or tune the nmblusters more up as required.