2 broadcom nics causes kernel panic

[jeffreysmith]

I have purchased 2 dell r310's which both have 2 broadcom BCM5716 Quad port network cards.

When i plug both network cards in i get a kernel panic

panic: pmap_mapdev: coundn't alloc kernel virtual memory

The server then reboots. If i only have one of these cards plugged into a pci-e slot then it boots normally.

Does anyone have any suggestions as how to fix this?

[wallabybob]

Short (and unhelpful) answer: Increase the kernel virtual memory.

To help me get an idea how much the kernel virtual memory might need to be increased please post the output of the shell command dmesg.

What version of pfSense are you using?

[jeffreysmith]

Its gonna be tricky getting a dmesg output as the server panics after 1 second of being up and reboots itself within 15 seconds.

If i remove one of the cards it works fine and i will be able to get a dmesg output but i doubt it will be as helpful.

Any idea how to get the dmesg output with both cards in.

[wallabybob]

My theory is

• you are hitting exhaustion of kernel address space

• your cards have identical resource requirements

Therefore I expect that the dmesg output with one card present in the system will be sufficient to tell me how much you will need for two cards.

If you want to be thorough you could boot with one card present and collect the dmesg output, put the other card in the system and remove the first card then boot and collect the dmesg output and post both dmesg outputs.

[jeffreysmith]

This is the dmesg output with just one of the cards in.

Copyright 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.2-RELEASE-p5 #0: Sun Dec  6 23:20:31 EST 2009
    sullrich@FreeBSD_7.2_pfSense_1.2.3_snaps.pfsense.org:/usr/obj.pfSense/usr/pfSensesrc/src/sys/pfSense_SMP.7
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU          X3430  @ 2.40GHz (2394.00-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x106e5  Stepping = 5
  Features=0xbfebfbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>Features2=0x98e3fd <sse3,dtes64,mon,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,sse4.2,popcnt>AMD Features=0x28100000 <nx,rdtscp,lm>AMD Features2=0x1 <lahf>Cores per package: 8
  Logical CPUs per core: 2
real memory  = 3211366400 (3062 MB)
avail memory = 3136745472 (2991 MB)
ACPI APIC Table: <dell  pe_sc3 ="">FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  2
cpu2 (AP): APIC ID:  4
cpu3 (AP): APIC ID:  6
ioapic0 <version 2.0="">irqs 0-23 on motherboard
wlan: mac acl policy registered
kbd1 at kbdmux0
cryptosoft0: <software crypto="">on motherboard
padlock0: No ACE support.
acpi0: <dell pe_sc3="">on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_hpet0: <high precision="" event="" timer="">iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
pcib0: <acpi host-pci="" bridge="">port 0xcf8-0xcff on acpi0
pci0: <acpi pci="" bus="">on pcib0
pcib1: <acpi pci-pci="" bridge="">at device 3.0 on pci0
pci4: <acpi pci="" bus="">on pcib1
pcib2: <pci-pci bridge="">at device 0.0 on pci4
pci5: <pci bus="">on pcib2
pcib3: <pci-pci bridge="">at device 2.0 on pci5
pci6: <pci bus="">on pcib3
bce0: <broadcom netxtreme="" ii="" bcm5709="" 1000base-t="" (c0)="">mem 0xd6000000-0xd7ffffff irq 18 at device 0.0 on pci6
miibus0: <mii bus="">on bce0
ukphy0: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce0: Ethernet address: 00:10:18:79:09:a0
bce0: [ITHREAD]
bce0: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (0x05000B05); Flags( MSI )
bce1: <broadcom netxtreme="" ii="" bcm5709="" 1000base-t="" (c0)="">mem 0xd8000000-0xd9ffffff irq 19 at device 0.1 on pci6
miibus1: <mii bus="">on bce1
ukphy1: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus1
ukphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce1: Ethernet address: 00:10:18:79:09:a2
bce1: [ITHREAD]
bce1: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (0x05000B05); Flags( MSI )
pcib4: <pci-pci bridge="">at device 4.0 on pci5
pci7: <pci bus="">on pcib4
bce2: <broadcom netxtreme="" ii="" bcm5709="" 1000base-t="" (c0)="">mem 0xd2000000-0xd3ffffff irq 16 at device 0.0 on pci7
miibus2: <mii bus="">on bce2
ukphy2: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus2
ukphy2:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce2: Ethernet address: 00:10:18:79:09:a4
bce2: [ITHREAD]
bce2: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (0x05000B05); Flags( MSI )
bce3: <broadcom netxtreme="" ii="" bcm5709="" 1000base-t="" (c0)="">mem 0xd4000000-0xd5ffffff irq 17 at device 0.1 on pci7
miibus3: <mii bus="">on bce3
ukphy3: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus3
ukphy3:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce3: Ethernet address: 00:10:18:79:09:a6
bce3: [ITHREAD]
bce3: ASIC (0x57092003); Rev (C0); Bus (PCIe x4, 5Gbps); B/C (0x05000B05); Flags( MSI )
pcib5: <acpi pci-pci="" bridge="">at device 5.0 on pci0
pci8: <acpi pci="" bus="">on pcib5
pci0: <base peripheral=""> at device 8.0 (no driver attached)
pci0: <base peripheral=""> at device 8.1 (no driver attached)
pci0: <base peripheral=""> at device 8.2 (no driver attached)
pci0: <base peripheral=""> at device 8.3 (no driver attached)
pci0: <base peripheral=""> at device 16.0 (no driver attached)
pci0: <base peripheral=""> at device 16.1 (no driver attached)
ehci0: <ehci (generic)="" usb="" 2.0="" controller="">mem 0xdf0fc000-0xdf0fc3ff irq 22 at device 26.0 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb0: waiting for BIOS to give up control
usb0: EHCI version 1.0
usb0: <ehci (generic)="" usb="" 2.0="" controller="">on ehci0
usb0: USB revision 2.0
uhub0: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usb0
uhub0: 2 ports with 2 removable, self powered
uhub1: <vendor 2="" 9="" 0x8087="" product="" 0x0020,="" class="" 0,="" rev="" 2.00="" 0.00,="" addr="">on uhub0
uhub1: single transaction translator
uhub1: 6 ports with 6 removable, self powered
uhub2: <vendor 3="" 9="" 0x0424="" product="" 0x2514,="" class="" 0,="" rev="" 2.00="" 0.00,="" addr="">on uhub1
uhub2: multiple transaction translators
uhub2: 4 ports with 4 removable, self powered
ukbd0: <logitech 0="" 4="" logitech="" usb="" keyboard,="" class="" 0,="" rev="" 1.10="" 28.00,="" addr="">on uhub2
kbd2 at ukbd0
uhid0: <logitech 0="" 4="" logitech="" usb="" keyboard,="" class="" 0,="" rev="" 1.10="" 28.00,="" addr="">on uhub2
pcib6: <acpi pci-pci="" bridge="">at device 28.0 on pci0
pci3: <acpi pci="" bus="">on pcib6
mpt0: <lsilogic sas="" sata="" adapter="">port 0xfc00-0xfcff mem 0xdf2ec000-0xdf2effff,0xdf2f0000-0xdf2fffff irq 16 at device 0.0 on pci3
mpt0: [ITHREAD]
mpt0: MPI Version=1.5.18.0
mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 )
mpt0: 1 Active Volume (2 Max)
mpt0: 2 Hidden Drive Members (14 Max)
pcib7: <acpi pci-pci="" bridge="">at device 28.4 on pci0
pci2: <acpi pci="" bus="">on pcib7
bce4: <broadcom netxtreme="" ii="" bcm5716="" 1000base-t="" (c0)="">mem 0xda000000-0xdbffffff irq 16 at device 0.0 on pci2
miibus4: <mii bus="">on bce4
ukphy4: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus4
ukphy4:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce4: Ethernet address: 84:2b:2b:58:bb:2c
bce4: [ITHREAD]
bce4: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (0x05020205); Flags( MFW MSI )
bce5: <broadcom netxtreme="" ii="" bcm5716="" 1000base-t="" (c0)="">mem 0xdc000000-0xddffffff irq 17 at device 0.1 on pci2
miibus5: <mii bus="">on bce5
ukphy5: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus5
ukphy5:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce5: Ethernet address: 84:2b:2b:58:bb:2d
bce5: [ITHREAD]
bce5: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (0x05020205); Flags( MFW MSI )
ehci1: <ehci (generic)="" usb="" 2.0="" controller="">mem 0xdf0fe000-0xdf0fe3ff irq 22 at device 29.0 on pci0
ehci1: [GIANT-LOCKED]
ehci1: [ITHREAD]
usb1: EHCI version 1.0
usb1: <ehci (generic)="" usb="" 2.0="" controller="">on ehci1
usb1: USB revision 2.0
uhub3: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usb1
uhub3: 2 ports with 2 removable, self powered
uhub4: <vendor 2="" 9="" 0x8087="" product="" 0x0020,="" class="" 0,="" rev="" 2.00="" 0.00,="" addr="">on uhub3
uhub4: single transaction translator
uhub4: 6 ports with 6 removable, self powered
pcib8: <acpi pci-pci="" bridge="">at device 30.0 on pci0
pci1: <acpi pci="" bus="">on pcib8
vgapci0: <vga-compatible display="">mem 0xd1800000-0xd1ffffff,0xde7fc000-0xde7fffff,0xde800000-0xdeffffff irq 19 at device 3.0 on pci1
isab0: <pci-isa bridge="">at device 31.0 on pci0
isa0: <isa bus="">on isab0
atapci0: <intel ata="" controller="">port 0xeca0-0xeca7,0xec90-0xec93,0xeca8-0xecaf,0xec94-0xec97,0xecc0-0xeccf,0xecd0-0xecdf irq 20 at device 31.2 on pci0
atapci0: [ITHREAD]
ata2: <ata 0="" channel="">on atapci0
ata2: [ITHREAD]
ata3: <ata 1="" channel="">on atapci0
ata3: [ITHREAD]
atapci1: <intel ata="" controller="">port 0xecb0-0xecb7,0xec98-0xec9b,0xecb8-0xecbf,0xec9c-0xec9f,0xece0-0xecef,0xecf0-0xecff irq 21 at device 31.5 on pci0
atapci1: [ITHREAD]
ata4: <ata 0="" channel="">on atapci1
ata4: [ITHREAD]
ata5: <ata 1="" channel="">on atapci1
ata5: [ITHREAD]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
sio1: [FILTER]
cpu0: <acpi cpu="">on acpi0
est0: <enhanced speedstep="" frequency="" control="">on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est0 attach returned 6
p4tcc0: <cpu frequency="" thermal="" control="">on cpu0
cpu1: <acpi cpu="">on acpi0
est1: <enhanced speedstep="" frequency="" control="">on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est1 attach returned 6
p4tcc1: <cpu frequency="" thermal="" control="">on cpu1
cpu2: <acpi cpu="">on acpi0
est2: <enhanced speedstep="" frequency="" control="">on cpu2
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 9
device_attach: est2 attach returned 6
p4tcc2: <cpu frequency="" thermal="" control="">on cpu2
cpu3: <acpi cpu="">on acpi0
est3: <enhanced speedstep="" frequency="" control="">on cpu3
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est3 attach returned 6
p4tcc3: <cpu frequency="" thermal="" control="">on cpu3
pmtimer0 on isa0
orm0: <isa option="" roms="">at iomem 0xc0000-0xc7fff,0xce000-0xcefff,0xec000-0xeffff pnpid ORM0000 on isa0
ata0 at port 0x1f0-0x1f7,0x3f6 irq 14 on isa0
ata0: [ITHREAD]
ata1 at port 0x170-0x177,0x376 irq 15 on isa0
ata1: [ITHREAD]
sc0: <system console="">at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <generic isa="" vga="">at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
IPsec: Initialized Security Association Processing.
mpt0:vol0(mpt0:0:0): Settings ( Member-WCE Hot-Plug-Spares High-Priority-ReSync )
mpt0:vol0(mpt0:0:0): Using Spare Pool: 0
mpt0:vol0(mpt0:0:0): 2 Members:
      (mpt0:1:9:0): Primary Online
      (mpt0:1:1:0): Secondary Online
mpt0:vol0(mpt0:0:0): RAID-1 - Optimal
mpt0:vol0(mpt0:0:0): Status ( Enabled )
(mpt0:vol0:1): Physical (mpt0:0:1:0), Pass-thru (mpt0:1:0:0)
(mpt0:vol0:1): Online
(mpt0:vol0:0): Physical (mpt0:0:9:0), Pass-thru (mpt0:1:1:0)
(mpt0:vol0:0): Online
acd0: DVDR <plds dvd+="" -rw="" ds-8a4s="" jd51="">at ata4-master UDMA33
da0 at mpt0 bus 0 target 0 lun 0
da0: <dell 1028="" virtual="" disk="">Fixed Direct Access SCSI-5 device
da0: 300.000MB/s transfers
da0: Command Queueing Enabled
da0: 152064MB (311427072 512 byte sectors: 255H 63S/T 19385C)
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #1 Launched!
ses0 at mpt0 bus 0 target 8 lun 0
ses0: <dp backplane="" 1.07="">Fixed Enclosure Services SCSI-5 device
ses0: 300.000MB/s transfers
ses0: SCSI-3 SES Device
Trying to mount root from ufs:/dev/da0s1a
pflog0: promiscuous mode enabled</dp></dell></plds></generic></system></isa></cpu></enhanced></acpi></cpu></enhanced></acpi></cpu></enhanced></acpi></cpu></enhanced></acpi></ata></ata></intel></ata></ata></intel></isa></pci-isa></vga-compatible></acpi></acpi></vendor></intel></ehci></ehci></generic></mii></broadcom></generic></mii></broadcom></acpi></acpi></lsilogic></acpi></acpi></logitech></logitech></vendor></vendor></intel></ehci></ehci></acpi></acpi></generic></mii></broadcom></generic></mii></broadcom></pci></pci-pci></generic></mii></broadcom></generic></mii></broadcom></pci></pci-pci></pci></pci-pci></acpi></acpi></acpi></acpi></high></dell></software></version></dell ></lahf></nx,rdtscp,lm></sse3,dtes64,mon,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,sse4.2,popcnt></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>

I have just noticed that none of the network ports work when i have this card plugged in. to get this off the box i had to unplug the card and then the nics on the motherboard started working.

[wallabybob]

Each of the bce NICs requires 32MB of PCI memory address space. This is considerably higher than some other NICs.

32bit CPUs have 4GB memory address space. 3GB of that is occupied by RAM. CPU requires a certain amount of memory space for special functions (depends on CPU). A largish block is also required for MSI (Message Signalled Interrupts).

How many NICs do you need?

Does the BIOS allow you to disable one or more of the motherboard NICs? If so, you might be able to 4 or 5 bce NICs working.

Does the BIOS have a setting for 64bit operating systems? If so, it might be able to put the base address of the bce memory space above 4GB into a region where there is much less competition for limited space. If you need all those NICs you might have a higher likelihood of getting them working with the BIOS set for 64bit OS and booting a 64bit OS such as a 64bit snapshot of pfSense 2.0 BETA.

[jeffreysmith]

There is no 64 bit os option in the bios unfortunetly and this will be a production box so im not thrilled by the prospect of using the 2.0 Beta.

would taking 2 Gig of ram out of the machine also be an option in the short term?

These are pretty new nics so i might just return them and get some slighty older.

Are there any recommended quad port pci-e ones that i will be able to use 2 of ?

[Cry Havok]

Intel Server grade cards - you'll find a few dozens of threads recommending them.

[wallabybob]

@jeffreysmith:

would taking 2 Gig of ram out of the machine also be an option in the short term?

It is possible the BIOS moves the base of PCI memory space to just above the top of RAM (or has an option to do so). I can't recall ever seeing a BIOS that does this.

With regard to this particular problem: Your dmesg output shows

bce0: <broadcom netxtreme="" ii="" bcm5709="" 1000base-t="" (c0)="">mem 0xd6000000-0xd7ffffff irq 18 at device 0.0 on pci6</broadcom>

so a bce device requires 0xd7ffffff - 0xd6000000 or 0x2000000 or 32MB of PCI memory.

Another dmesg output displayed in the forums includes

em0: <intel(r) 1000="" pro="" network="" connection="" 7.0.8="">port 0x2000-0x201f mem 0x91a80000-0x91a9ffff,0x91a00000-0x91a7ffff,0x91aa0000-0x91aa3fff irq 17 at device 0.0 on pci11
em1: <intel(r) 1000="" pro="" network="" connection="" 7.0.8="">port 0x1000-0x101f mem 0x91980000-0x9199ffff,0x91900000-0x9197ffff,0x919a0000-0x919a3fff irq 19 at device 0.0 on pci21</intel(r)></intel(r)>

So an em Intel GigE interface requires 3 blocks of PCI memory space, one of 0x20000 (128kB), one of 0x80000 (512kB) and one of 0x4000 (16kB) for a total well below a bce device.

Multi port NICs tend to be pretty expensive. Depending on your bandwidth requirements it might be worthwhile looking into using a single NIC (even a 10Gbps NIC) with a VLAN capable switch acting as a "port multiplier".

[jeffreysmith]

I have managed to get my hands on 2 Intel ET Quad port cards. These do not appear to be supported so i followed the instruction http://forum.pfsense.org/index.php/topic,26592.msg140323.html#msg140323 and they still dont appear to be working.

this is the dmesg

Copyright 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.2-RELEASE-p5 #0: Sun Dec  6 23:20:31 EST 2009
    sullrich@FreeBSD_7.2_pfSense_1.2.3_snaps.pfsense.org:/usr/obj.pfSense/usr/pfSensesrc/src/sys/pfSense_SMP.7
module_register: module pci/igb already exists!
Module pci/igb failed to register: 17
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU          X3430  @ 2.40GHz (2394.00-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x106e5  Stepping = 5
  Features=0xbfebfbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>Features2=0x98e3fd <sse3,dtes64,mon,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,sse4.2,popcnt>AMD Features=0x28100000 <nx,rdtscp,lm>AMD Features2=0x1 <lahf>Cores per package: 8
  Logical CPUs per core: 2
real memory  = 3211366400 (3062 MB)
avail memory = 3136741376 (2991 MB)
ACPI APIC Table: <dell  pe_sc3 ="">FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  2
cpu2 (AP): APIC ID:  4
cpu3 (AP): APIC ID:  6
ioapic0 <version 2.0="">irqs 0-23 on motherboard
wlan: mac acl policy registered
kbd1 at kbdmux0
cryptosoft0: <software crypto="">on motherboard
padlock0: No ACE support.
acpi0: <dell pe_sc3="">on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_hpet0: <high precision="" event="" timer="">iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
pcib0: <acpi host-pci="" bridge="">port 0xcf8-0xcff on acpi0
pci0: <acpi pci="" bus="">on pcib0
pcib1: <acpi pci-pci="" bridge="">at device 3.0 on pci0
pci4: <acpi pci="" bus="">on pcib1
pcib2: <pci-pci bridge="">at device 0.0 on pci4
pci5: <pci bus="">on pcib2
pcib3: <pci-pci bridge="">at device 2.0 on pci5
pci6: <pci bus="">on pcib3
igb0: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xecc0-0xecdf mem 0xdbfc0000-0xdbfdffff,0xdc000000-0xdc3fffff,0xdbfb8000-0xdbfbbfff irq 18 at device 0.0 on pci6
igb0: Using MSIX interrupts with 9 vectors
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: [ITHREAD]
igb0: Ethernet address: 00:1b:21:77:8b:40
igb1: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xece0-0xecff mem 0xdbfe0000-0xdbffffff,0xdc400000-0xdc7fffff,0xdbfbc000-0xdbfbffff irq 19 at device 0.1 on pci6
igb1: Using MSIX interrupts with 9 vectors
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: [ITHREAD]
igb1: Ethernet address: 00:1b:21:77:8b:41
pcib4: <pci-pci bridge="">at device 4.0 on pci5
pci7: <pci bus="">on pcib4
igb2: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xdcc0-0xdcdf mem 0xdb3c0000-0xdb3dffff,0xdb400000-0xdb7fffff,0xdb3b8000-0xdb3bbfff irq 16 at device 0.0 on pci7
igb2: Using MSIX interrupts with 9 vectors
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: [ITHREAD]
igb2: Ethernet address: 00:1b:21:77:8b:44
igb3: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xdce0-0xdcff mem 0xdb3e0000-0xdb3fffff,0xdb800000-0xdbbfffff,0xdb3bc000-0xdb3bffff irq 17 at device 0.1 on pci7
igb3: Using MSIX interrupts with 9 vectors
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: [ITHREAD]
igb3: Ethernet address: 00:1b:21:77:8b:45
pcib5: <acpi pci-pci="" bridge="">at device 5.0 on pci0
pci8: <acpi pci="" bus="">on pcib5
pcib6: <pci-pci bridge="">at device 0.0 on pci8
pci9: <pci bus="">on pcib6
pcib7: <pci-pci bridge="">at device 2.0 on pci9
pci10: <pci bus="">on pcib7
igb4: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xccc0-0xccdf mem 0xdd7c0000-0xdd7dffff,0xdd800000-0xddbfffff,0xdd7b8000-0xdd7bbfff irq 18 at device 0.0 on pci10
igb4: Using MSIX interrupts with 9 vectors
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: [ITHREAD]
igb4: Ethernet address: 00:1b:21:77:8c:a8
igb5: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xcce0-0xccff mem 0xdd7e0000-0xdd7fffff,0xddc00000-0xddffffff,0xdd7bc000-0xdd7bffff irq 19 at device 0.1 on pci10
igb5: Using MSIX interrupts with 9 vectors
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: [ITHREAD]
igb5: Ethernet address: 00:1b:21:77:8c:a9
pcib8: <pci-pci bridge="">at device 4.0 on pci9
pci11: <pci bus="">on pcib8
igb6: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xbcc0-0xbcdf mem 0xdcbc0000-0xdcbdffff,0xdcc00000-0xdcffffff,0xdcbb8000-0xdcbbbfff irq 16 at device 0.0 on pci11
igb6: Using MSIX interrupts with 9 vectors
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: [ITHREAD]
igb6: Ethernet address: 00:1b:21:77:8c:ac
igb7: <intel(r) 1000="" pro="" network="" connection="" version="" -="" 1.8.4="">port 0xbce0-0xbcff mem 0xdcbe0000-0xdcbfffff,0xdd000000-0xdd3fffff,0xdcbbc000-0xdcbbffff irq 17 at device 0.1 on pci11
igb7: Using MSIX interrupts with 9 vectors
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: [ITHREAD]
igb7: Ethernet address: 00:1b:21:77:8c:ad
pci0: <base peripheral=""> at device 8.0 (no driver attached)
pci0: <base peripheral=""> at device 8.1 (no driver attached)
pci0: <base peripheral=""> at device 8.2 (no driver attached)
pci0: <base peripheral=""> at device 8.3 (no driver attached)
pci0: <base peripheral=""> at device 16.0 (no driver attached)
pci0: <base peripheral=""> at device 16.1 (no driver attached)
ehci0: <ehci (generic)="" usb="" 2.0="" controller="">mem 0xde0fc000-0xde0fc3ff irq 22 at device 26.0 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb0: waiting for BIOS to give up control
usb0: EHCI version 1.0
usb0: <ehci (generic)="" usb="" 2.0="" controller="">on ehci0
usb0: USB revision 2.0
uhub0: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usb0
uhub0: 2 ports with 2 removable, self powered
uhub1: <vendor 2="" 9="" 0x8087="" product="" 0x0020,="" class="" 0,="" rev="" 2.00="" 0.00,="" addr="">on uhub0
uhub1: single transaction translator
uhub1: 6 ports with 6 removable, self powered
uhub2: <vendor 3="" 9="" 0x0424="" product="" 0x2514,="" class="" 0,="" rev="" 2.00="" 0.00,="" addr="">on uhub1
uhub2: multiple transaction translators
uhub2: 4 ports with 4 removable, self powered
ukbd0: <logitech 0="" 4="" logitech="" usb="" keyboard,="" class="" 0,="" rev="" 1.10="" 28.00,="" addr="">on uhub2
kbd2 at ukbd0
uhid0: <logitech 0="" 4="" logitech="" usb="" keyboard,="" class="" 0,="" rev="" 1.10="" 28.00,="" addr="">on uhub2
pcib9: <acpi pci-pci="" bridge="">at device 28.0 on pci0
pci3: <acpi pci="" bus="">on pcib9
mpt0: <lsilogic sas="" sata="" adapter="">port 0xfc00-0xfcff mem 0xde2ec000-0xde2effff,0xde2f0000-0xde2fffff irq 16 at device 0.0 on pci3
mpt0: [ITHREAD]
mpt0: MPI Version=1.5.18.0
mpt0: Capabilities: ( RAID-0 RAID-1E RAID-1 )
mpt0: 1 Active Volume (2 Max)
mpt0: 2 Hidden Drive Members (14 Max)
pcib10: <acpi pci-pci="" bridge="">at device 28.4 on pci0
pci2: <acpi pci="" bus="">on pcib10
bce0: <broadcom netxtreme="" ii="" bcm5716="" 1000base-t="" (c0)="">mem 0xd6000000-0xd7ffffff irq 16 at device 0.0 on pci2
miibus0: <mii bus="">on bce0
ukphy0: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce0: Ethernet address: 84:2b:2b:58:bb:2c
bce0: [ITHREAD]
bce0: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (0x05020205); Flags( MFW MSI )
bce1: <broadcom netxtreme="" ii="" bcm5716="" 1000base-t="" (c0)="">mem 0xd8000000-0xd9ffffff irq 17 at device 0.1 on pci2
miibus1: <mii bus="">on bce1
ukphy1: <generic ieee="" 802.3u="" media="" interface="">PHY 1 on miibus1
ukphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
bce1: Ethernet address: 84:2b:2b:58:bb:2d
bce1: [ITHREAD]
bce1: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (0x05020205); Flags( MFW MSI )
ehci1: <ehci (generic)="" usb="" 2.0="" controller="">mem 0xde0fe000-0xde0fe3ff irq 22 at device 29.0 on pci0
ehci1: [GIANT-LOCKED]
ehci1: [ITHREAD]
usb1: EHCI version 1.0
usb1: <ehci (generic)="" usb="" 2.0="" controller="">on ehci1
usb1: USB revision 2.0
uhub3: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usb1
uhub3: 2 ports with 2 removable, self powered
uhub4: <vendor 2="" 9="" 0x8087="" product="" 0x0020,="" class="" 0,="" rev="" 2.00="" 0.00,="" addr="">on uhub3
uhub4: single transaction translator
uhub4: 8 ports with 8 removable, self powered
pcib11: <acpi pci-pci="" bridge="">at device 30.0 on pci0
pci1: <acpi pci="" bus="">on pcib11
vgapci0: <vga-compatible display="">mem 0xd5800000-0xd5ffffff,0xda7fc000-0xda7fffff,0xda800000-0xdaffffff irq 19 at device 3.0 on pci1
isab0: <pci-isa bridge="">at device 31.0 on pci0
isa0: <isa bus="">on isab0
atapci0: <intel ata="" controller="">port 0xaca0-0xaca7,0xac90-0xac93,0xaca8-0xacaf,0xac94-0xac97,0xacc0-0xaccf,0xacd0-0xacdf irq 20 at device 31.2 on pci0
atapci0: [ITHREAD]
ata2: <ata 0="" channel="">on atapci0
ata2: [ITHREAD]
ata3: <ata 1="" channel="">on atapci0
ata3: [ITHREAD]
atapci1: <intel ata="" controller="">port 0xacb0-0xacb7,0xac98-0xac9b,0xacb8-0xacbf,0xac9c-0xac9f,0xace0-0xacef,0xacf0-0xacff irq 21 at device 31.5 on pci0
atapci1: [ITHREAD]
ata4: <ata 0="" channel="">on atapci1
ata4: [ITHREAD]
ata5: <ata 1="" channel="">on atapci1
ata5: [ITHREAD]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
sio1: [FILTER]
cpu0: <acpi cpu="">on acpi0
est0: <enhanced speedstep="" frequency="" control="">on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est0 attach returned 6
p4tcc0: <cpu frequency="" thermal="" control="">on cpu0
cpu1: <acpi cpu="">on acpi0
est1: <enhanced speedstep="" frequency="" control="">on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est1 attach returned 6
p4tcc1: <cpu frequency="" thermal="" control="">on cpu1
cpu2: <acpi cpu="">on acpi0
est2: <enhanced speedstep="" frequency="" control="">on cpu2
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est2 attach returned 6
p4tcc2: <cpu frequency="" thermal="" control="">on cpu2
cpu3: <acpi cpu="">on acpi0
est3: <enhanced speedstep="" frequency="" control="">on cpu3
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 12
device_attach: est3 attach returned 6
p4tcc3: <cpu frequency="" thermal="" control="">on cpu3
pmtimer0 on isa0
orm0: <isa option="" roms="">at iomem 0xc0000-0xc7fff,0xce000-0xcefff,0xec000-0xeffff pnpid ORM0000 on isa0
ata0 at port 0x1f0-0x1f7,0x3f6 irq 14 on isa0
ata0: [ITHREAD]
ata1 at port 0x170-0x177,0x376 irq 15 on isa0
ata1: [ITHREAD]
sc0: <system console="">at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <generic isa="" vga="">at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounters tick every 1.000 msec
IPsec: Initialized Security Association Processing.
mpt0:vol0(mpt0:0:0): Settings ( Member-WCE Hot-Plug-Spares High-Priority-ReSync )
mpt0:vol0(mpt0:0:0): Using Spare Pool: 0
mpt0:vol0(mpt0:0:0): 2 Members:
      (mpt0:1:9:0): Primary Online
      (mpt0:1:1:0): Secondary Online
mpt0:vol0(mpt0:0:0): RAID-1 - Optimal
mpt0:vol0(mpt0:0:0): Status ( Enabled )
(mpt0:vol0:1): Physical (mpt0:0:1:0), Pass-thru (mpt0:1:0:0)
(mpt0:vol0:1): Online
(mpt0:vol0:0): Physical (mpt0:0:9:0), Pass-thru (mpt0:1:1:0)
(mpt0:vol0:0): Online
acd0: DVDR <plds dvd+="" -rw="" ds-8a4s="" jd51="">at ata4-master UDMA33
ses0 at mpt0 bus 0 target 8 lun 0
ses0: <dp backplane="" 1.07="">Fixed Enclosure Services SCSI-5 device
ses0: 300.000MB/s transfers
ses0: SCSI-3 SES Device
da0 at mpt0 bus 0 target 0 lun 0
da0: <dell 1028="" virtual="" disk="">Fixed Direct Access SCSI-5 device
da0: 300.000MB/s transfers
da0: Command Queueing Enabled
da0: 152064MB (311427072 512 byte sectors: 255H 63S/T 19385C)
SMP: AP CPU #2 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
Trying to mount root from ufs:/dev/da0s1a</dell></dp></plds></generic></system></isa></cpu></enhanced></acpi></cpu></enhanced></acpi></cpu></enhanced></acpi></cpu></enhanced></acpi></ata></ata></intel></ata></ata></intel></isa></pci-isa></vga-compatible></acpi></acpi></vendor></intel></ehci></ehci></generic></mii></broadcom></generic></mii></broadcom></acpi></acpi></lsilogic></acpi></acpi></logitech></logitech></vendor></vendor></intel></ehci></ehci></intel(r)></intel(r)></pci></pci-pci></intel(r)></intel(r)></pci></pci-pci></pci></pci-pci></acpi></acpi></intel(r)></intel(r)></pci></pci-pci></intel(r)></intel(r)></pci></pci-pci></pci></pci-pci></acpi></acpi></acpi></acpi></high></dell></software></version></dell ></lahf></nx,rdtscp,lm></sse3,dtes64,mon,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,sse4.2,popcnt></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>

Any ideas where i have gone wrong ?

[wallabybob]

You have 8 igb interfaces (a variant of Intel GigE). Why do you say "These do not appear to be supported"?

[jeffreysmith]

because im a wally and they are infact there and working. :)

I guess I will be returning the broadcom ones for these intel nics instead.

Many thanks for the help wallabybob

[wallabybob]

Maybe you just expected to see em0 .. em7