Chelsio N320E-SR 10G NIC wird nicht erkannt

[bosco]

Hallo Zusammen,
ich bekomme die Chelsio N320E-SR 10G NIC einfach nicht zu laufen. Eine Prüfung mit dmesg brachte keinen erfolg, auch der Eintrag if_cxgb_load="YES" in /boot/loader.conf hat nicht geholfen.

kern.cam.boot_delay=10000
kern.ipc.nmbclusters="1000000"
kern.ipc.nmbjumbop="524288"
kern.ipc.nmbjumbo9="524288"
kern.geom.label.disk_ident.enable="0"
kern.geom.label.gptid.enable="0"
opensolaris_load="YES"
zfs_load="YES"
if_cxgb_load="YES"
autoboot_delay="3"
hw.hn.vf_transparent="0"
hw.hn.use_if_start="1"
net.link.ifqmaxlen="128"

Ich habe die N320E-SR gegen eine andere getauscht auch ohne Ergebnis.

Was könnte das Problem sein? Ich hoffe Ihr könnt mir helfen, danke!

Die technischen Daten zu System:

2.6.0-RELEASE
Supermicro A1SAI-2750F
Intel AtomC2750 2.40GHz
Chelsio N320E-SR mit 2x SFP+

[2.6.0-RELEASE][root@pfSense.rbsnet]/root: dmesg
---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.3-STABLE RELENG_2_6_0-n226742-1285d6d205f pfSense amd64
FreeBSD clang version 10.0.1 (git@github.com:llvm/llvm-project.git llvmorg-10.0.1-0-gef32c611aa2)
VT(vga): resolution 640x480
module cxgbc already present!
CPU: Intel(R) Atom(TM) CPU  C2750  @ 2.40GHz (2400.07-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x406d8  Family=0x6  Model=0x4d  Stepping=8
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x43d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,AESNI,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x101<LAHF,Prefetch>
  Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 8589934592 (8192 MB)
avail memory = 8191410176 (7811 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INTEL  TIANO   >
WARNING: L1 data cache covers fewer APIC IDs than a core (0 < 1)
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
random: unblocking device.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
Launching APs: 5 4 1 3 2 7 6
Timecounter "TSC-low" frequency 1200035040 Hz quality 1000
random: entropy device external interface
ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff80739000, 0) error 1
ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff807390b0, 0) error 1
ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80739160, 0) error 1
iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff807609f0, 0) error 1
iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff80760aa0, 0) error 1
iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff80760b50, 0) error 1
wlan: mac acl policy registered
WARNING: Device "g_ctl" is Giant locked and may be deleted before FreeBSD 14.0.
WARNING: Device "pci" is Giant locked and may be deleted before FreeBSD 14.0.
module_register_init: MOD_LOAD (vesa, 0xffffffff8140a210, 0) error 19
WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 14.0.
kbd1 at kbdmux0
[ath_hal] loaded
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 14.0.
000.000060 [4344] netmap_init               netmap: loaded module
mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020)
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> mem 0xdf2c0000-0xdf2dffff irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
vgapci0: <VGA-compatible display> port 0xd000-0xd07f mem 0xde000000-0xdeffffff,0xdf000000-0xdf01ffff irq 16 at device 0.0 on pci2
vgapci0: Boot video device
pcib3: <ACPI PCI-PCI bridge> mem 0xdf2a0000-0xdf2bffff irq 16 at device 2.0 on pci0
pci3: <ACPI PCI bus> on pcib3
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xdf100000-0xdf101fff irq 17 at device 0.0 on pci3
xhci0: 64 bytes context size, 32-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib4: <ACPI PCI-PCI bridge> mem 0xdf280000-0xdf29ffff irq 20 at device 3.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pci0: <base peripheral, IOMMU> at device 15.0 (no driver attached)
igb0: <Intel(R) I354 (SGMII)> port 0xe0c0-0xe0df mem 0xdf260000-0xdf27ffff,0xdf2ec000-0xdf2effff irq 20 at device 20.0 on pci0
igb0: EEPROM V1.0-5
igb0: Using 1024 TX descriptors and 1024 RX descriptors
igb0: Using 8 RX queues 8 TX queues
igb0: Using MSI-X interrupts with 9 vectors
igb0: Ethernet address: 0c:c4:7a:6b:8a:d4
igb0: netmap queues/slots: TX 8/1024, RX 8/1024
igb1: <Intel(R) I354 (SGMII)> port 0xe0a0-0xe0bf mem 0xdf240000-0xdf25ffff,0xdf2e8000-0xdf2ebfff irq 21 at device 20.1 on pci0
igb1: EEPROM V1.0-5
igb1: Using 1024 TX descriptors and 1024 RX descriptors
igb1: Using 8 RX queues 8 TX queues
igb1: Using MSI-X interrupts with 9 vectors
igb1: Ethernet address: 0c:c4:7a:6b:8a:d5
igb1: netmap queues/slots: TX 8/1024, RX 8/1024
igb2: <Intel(R) I354 (SGMII)> port 0xe080-0xe09f mem 0xdf220000-0xdf23ffff,0xdf2e4000-0xdf2e7fff irq 22 at device 20.2 on pci0
igb2: EEPROM V1.0-5
igb2: Using 1024 TX descriptors and 1024 RX descriptors
igb2: Using 8 RX queues 8 TX queues
igb2: Using MSI-X interrupts with 9 vectors
igb2: Ethernet address: 0c:c4:7a:6b:8a:d6
igb2: netmap queues/slots: TX 8/1024, RX 8/1024
igb3: <Intel(R) I354 (SGMII)> port 0xe060-0xe07f mem 0xdf200000-0xdf21ffff,0xdf2e0000-0xdf2e3fff irq 23 at device 20.3 on pci0
igb3: EEPROM V1.0-5
igb3: Using 1024 TX descriptors and 1024 RX descriptors
igb3: Using 8 RX queues 8 TX queues
igb3: Using MSI-X interrupts with 9 vectors
igb3: Ethernet address: 0c:c4:7a:6b:8a:d7
igb3: netmap queues/slots: TX 8/1024, RX 8/1024
ehci0: <Intel Avoton USB 2.0 controller> mem 0xdf2f3000-0xdf2f33ff irq 23 at device 22.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
ahci0: <Intel Avoton AHCI SATA controller> port 0xe150-0xe157,0xe140-0xe143,0xe130-0xe137,0xe120-0xe123,0xe040-0xe05f mem 0xdf2f2000-0xdf2f27ff irq 19 at device 23.0 on pci0
ahci0: AHCI v1.30 with 4 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahci1: <Intel Avoton AHCI SATA controller> port 0xe110-0xe117,0xe100-0xe103,0xe0f0-0xe0f7,0xe0e0-0xe0e3,0xe020-0xe03f mem 0xdf2f1000-0xdf2f17ff irq 19 at device 24.0 on pci0
ahci1: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
apei0: <ACPI Platform Error Interface> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff pnpid ORM0000 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
est0: <Enhanced SpeedStep Frequency Control> on cpu0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
Trying to mount root from zfs:pfSense/ROOT/default []...
ugen1.1: <Intel EHCI root HUB> at usbus1
Root mount waiting for: usbus0 usbus1 CAM
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen0.1: <0x1912 XHCI root HUB> at usbus0
uhub1: <0x1912 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub1: 8 ports with 8 removable, self powered
Root mount waiting for: usbus1 CAM
Root mount waiting for: usbus1 CAM
uhub0: 8 ports with 8 removable, self powered
Root mount waiting for: usbus1 CAM
ugen1.2: <vendor 0x8087 product 0x07db> at usbus1
uhub2 on uhub0
uhub2: <vendor 0x8087 product 0x07db, class 9/0, rev 2.00/0.02, addr 2> on usbus1
Root mount waiting for: usbus1 CAM
uhub2: 4 ports with 4 removable, self powered
ugen1.3: <vendor 0x0557 product 0x7000> at usbus1
uhub3 on uhub2
uhub3: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3> on usbus1
uhub3: 4 ports with 3 removable, self powered
Root mount waiting for: usbus1 CAM
ugen1.4: <vendor 0x0557 product 0x2419> at usbus1
ukbd0 on uhub3
ukbd0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus1
kbd2 at ukbd0
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
ada0 at ahcich4 bus 0 scbus4 target 0 lun 0
ada0: <KINGSTON SA400S37120G 03070009> ACS-3 ATA SATA 3.x device
ada0: Serial Number 50026B778318AC21
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 114473MB (234441648 512 byte sectors)
CPU: Intel(R) Atom(TM) CPU  C2750  @ 2.40GHz (2400.07-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x406d8  Family=0x6  Model=0x4d  Stepping=8
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x43d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,AESNI,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x101<LAHF,Prefetch>
  Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG>
  Structured Extended Features3=0xc000400<MD_CLEAR,IBPB,STIBP>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
ums0 on uhub3
ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus1
ums0: 3 buttons and [XYZ] coordinates ID=0
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS> on motherboard
WARNING: Device "crypto" is Giant locked and may be deleted before FreeBSD 14.0.
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
lo0: link state changed to UP
vlan0: changing name to 'igb0.7'
ng0: changing name to 'pppoe0'
igb0: link state changed to UP
igb0.7: link state changed to UP
igb3: link state changed to UP
igb2: link state changed to UP
tun1: changing name to 'ovpns1'
ovpns1: link state changed to UP
tun2: changing name to 'ovpns2'
ovpns2: link state changed to UP
tun3: changing name to 'ovpns3'
igb1: link state changed to UP
ovpns3: link state changed to UP
pflog0: promiscuous mode enabled
ovpns1: link state changed to DOWN
ovpns1: link state changed to UP
ovpns2: link state changed to DOWN
ovpns2: link state changed to UP
ovpns3: link state changed to DOWN
ovpns3: link state changed to UP
igb1: promiscuous mode enabled
igb3: promiscuous mode enabled
igb2: promiscuous mode enabled
pppoe0: promiscuous mode enabled
pppoe0: promiscuous mode disabled
ovpns1: link state changed to DOWN
ovpns1: link state changed to UP
ovpns2: link state changed to DOWN
ovpns2: link state changed to UP
igb3: promiscuous mode disabled
igb2: promiscuous mode disabled
igb1: promiscuous mode disabled
ovpns3: link state changed to DOWN
ovpns3: link state changed to UP
igb1: promiscuous mode enabled
igb3: promiscuous mode enabled
igb2: promiscuous mode enabled
pppoe0: promiscuous mode enabled
pppoe0: promiscuous mode disabled
igb2: promiscuous mode disabled
igb3: promiscuous mode disabled
igb1: promiscuous mode disabled
igb1: promiscuous mode enabled
igb3: promiscuous mode enabled
igb2: promiscuous mode enabled
pppoe0: promiscuous mode enabled
pppoe0: promiscuous mode disabled
igb2: promiscuous mode disabled
igb3: promiscuous mode disabled
igb1: promiscuous mode disabled
igb1: promiscuous mode enabled
igb3: promiscuous mode enabled
igb2: promiscuous mode enabled
pppoe0: promiscuous mode enabled
pppoe0: promiscuous mode disabled
igb2: promiscuous mode disabled
igb1: promiscuous mode disabled
igb3: promiscuous mode disabled
igb1: promiscuous mode enabled
igb3: promiscuous mode enabled
igb2: promiscuous mode enabled
pppoe0: promiscuous mode enabled
pppoe0: promiscuous mode disabled

[JeGr]

@bosco said in Chelsio N320E-SR 10G NIC wird nicht erkannt:

Chelsio N320E-SR 10G

Ich würde ggf. mal ein Live Linux vom Stick booten und schauen, ob die Karte überhaupt von irgendwas erkannt wird. Da ich das Modell aus TrueNAS Foren kenne, gab es dort schon mehrfach hie und da Problemberichte was PCI Slots, Stromverbrauch, Treiber oder Firmware Downgrades etc. angeht, daher würde ich erstmal versuchen die HW auszuschließen und ein anderes System booten mit anderen Treibern um zu sehen, ob die Karte überhaupt sauber im Mainboard läuft oder ob vllt. der PCIe Slot gar nicht genug Power bringt.

Cheers

[bosco]

@jegr

Danke für deine Tips, ich bin auch etwas Schalauer geworden. Das Supermicro A1SAI-2750F erkennt die Karte nicht. Ein mal ist es mir gelungen das ich die Karte in der pfsense sehen konnte, jedoch nur bis zum nächsten neustart. In einem anderen Forum habe ich folgendes gefunden:

... Under PCIe/PCI/PNP settings, there is this option: "PCIe Slot 1 Bifurcation" ... the default is "[Auto]" or one may choose "[X4X4]" ...

Ich denke das Problem hier ist das Supermicro A1SAI-2750F Bord. Die N320E Karten werden auch extrem heiß! Hast du eine Empfehlung für eine Alternative? Vielleicht von Intel mit 2x SPF+ Ports?

Grüße

[JeGr]

@bosco Für beste Kompatibilität würde ich versuchen eine X710 zu bekommen. 2-Port SFP+. Ist allerdings leider auch durch die aktuelle Logistiklage nicht gerade billig und ziemlich im Preis geklettert. Zudem ist das eine PCIe x8 Karte (PCIe gen3).

Netgate selbst verbaut in den höheren Geräten inzwischen statt Chelsio wieder Intel X710(BM) nachdem es mit den kleinen Chelsios aber auch den mittleren Intels (5xxer) zwischendurch mal Trouble mit Treibern gab. Somit dürfte man mit den X710(BM) den sichersten Griff machen, der garantiert unterstützt und ordentlich supportet wird.

Cheers