Pdsbm-ln2 1U server Lan Ports fail in RC canidate. Using Intel 82573 nic

[charliem]

I don't think MSI will fix it; the resources can't even be allocated.

Seems to have started in freebsd 9.2: https://groups.google.com/forum/#!topic/mailing.freebsd.current/AePu1kitjLY  Not sure if that patch ever made it into 9.3 or 10.1, or if that was even the proper fix.

[stephenw10]

Could be two different issues here. One NIC type fails to attach, the other crashes the boot.
Could we see a complete boot log, /var/log/dmedg.boot, from 2.2 with only the 2 on-board NICs?

Steve

[Topper727]

ok here is the log file you requested.. I am using a usb to lan 100 adapter right now to get me access to use 2.2 beta 64

Copyright 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.1-RELEASE #0 29f4af5(releng/10.1)-dirty: Thu Dec  4 08:55:34 CST 2014
    root@pfsense-22-amd64-builder:/usr/obj.amd64/usr/pfSensesrc/src/sys/pfSense_SMP.10 amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Pentium(R) Dual  CPU  E2200  @ 2.20GHz (2194.55-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x6fd  Family = 0x6  Model = 0xf  Stepping = 13
  Features=0xbfebfbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>Features2=0xe39d <sse3,dtes64,mon,ds_cpl,est,tm2,ssse3,cx16,xtpr,pdcm>AMD Features=0x20100800 <syscall,nx,lm>AMD Features2=0x1 <lahf>TSC: P-state invariant, performance statistics
real memory  = 4294967296 (4096 MB)
avail memory = 4088520704 (3899 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <intelb r_waterp="">FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
ioapic0 <version 2.0="">irqs 0-23 on motherboard
wlan: mac acl policy registered
ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff80606640, 0) error 1
ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff806066f0, 0) error 1
ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw/.
ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff806067a0, 0) error 1
iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi/.
iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff8062de10, 0) error 1
iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi/.
iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff8062dec0, 0) error 1
iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi/.
iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff8062df70, 0) error 1
random: <software, yarrow="">initialized
kbd1 at kbdmux0
cryptosoft0: <software crypto="">on motherboard
padlock0: No ACE support.
acpi0: <ptltd  rsdt="">on motherboard
acpi0: Power Button (fixed)
cpu0: <acpi cpu="">on acpi0
cpu1: <acpi cpu="">on acpi0
atrtc0: <at realtime="" clock="">port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <at timer="">port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0: <acpi host-pci="" bridge="">port 0xcf8-0xcff on acpi0
pci0: <acpi pci="" bus="">on pcib0
vgapci0: <vga-compatible display="">port 0x30c0-0x30c7 mem 0xd0000000-0xd00fffff,0xc0000000-0xcfffffff irq 16 at device 2.0 on pci0
agp0: <intel 946gz="" svga="" controller="">on vgapci0
agp0: aperture size is 256M, detected 7676k stolen memory
vgapci0: Boot video device
pcib1: <acpi pci-pci="" bridge="">irq 16 at device 28.0 on pci0
pcib1: failed to allocate initial I/O port window: 0-0xfff
pcib1: failed to allocate initial memory window: 0-0xfffff
pcib1: failed to allocate initial prefetch window: 0-0xfffff
pci2: <acpi pci="" bus="">on pcib1
pcib2: <acpi pci-pci="" bridge="">irq 16 at device 28.4 on pci0
pcib2: failed to allocate initial memory window: 0xd0100000-0xd01fffff
pci6: <acpi pci="" bus="">on pcib2
em0: <intel(r) 1000="" pro="" network="" connection="" 7.4.2="">port 0x4000-0x401f irq 16 at device 0.0 on pci6
em0: Using an MSI interrupt
em0: Setup of Shared code failed
device_attach: em0 attach returned 6
pcib3: <acpi pci-pci="" bridge="">irq 17 at device 28.5 on pci0
pcib3: failed to allocate initial memory window: 0xd0200000-0xd02fffff
pci7: <acpi pci="" bus="">on pcib3
em0: <intel(r) 1000="" pro="" network="" connection="" 7.4.2="">port 0x5000-0x501f irq 17 at device 0.0 on pci7
em0: Using an MSI interrupt
uhci0: <intel 82801g="" (ich7)="" usb="" controller="" usb-a="">port 0x3000-0x301f irq 16 at device 29.0 on pci0
usbus0 on uhci0
uhci1: <intel 82801g="" (ich7)="" usb="" controller="" usb-b="">port 0x3020-0x303f irq 17 at device 29.1 on pci0
usbus1 on uhci1
uhci2: <intel 82801g="" (ich7)="" usb="" controller="" usb-c="">port 0x3040-0x305f irq 18 at device 29.2 on pci0
usbus2 on uhci2
uhci3: <intel 82801g="" (ich7)="" usb="" controller="" usb-d="">port 0x3060-0x307f irq 19 at device 29.3 on pci0
usbus3 on uhci3
ehci0: <intel 82801gb="" r="" (ich7)="" usb="" 2.0="" controller="">mem 0xd0500000-0xd05003ff irq 16 at device 29.7 on pci0
usbus4: EHCI version 1.0
usbus4 on ehci0
pcib4: <acpi pci-pci="" bridge="">at device 30.0 on pci0
pci8: <acpi pci="" bus="">on pcib4
isab0: <pci-isa bridge="">at device 31.0 on pci0
isa0: <isa bus="">on isab0
atapci0: <intel ich7="" udma100="" controller="">port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x30a0-0x30af at device 31.1 on pci0
ata0: <ata channel="">at channel 0 on atapci0
atapci1: <intel ich7="" sata300="" controller="">port 0x30f0-0x30f7,0x30e4-0x30e7,0x30e8-0x30ef,0x30e0-0x30e3,0x30b0-0x30bf mem 0xd0500400-0xd05007ff irq 17 at device 31.2 on pci0
ata2: <ata channel="">at channel 0 on atapci1
ata3: <ata channel="">at channel 1 on atapci1
acpi_button0: <power button="">on acpi0
fdc0: <floppy drive="" controller="">port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
orm0: <isa option="" roms="">at iomem 0xc0000-0xcafff,0xcb000-0xcbfff on isa0
sc0: <system console="">at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <generic isa="" vga="">at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <keyboard controller="" (i8042)="">at port 0x60,0x64 on isa0
atkbd0: <at keyboard="">irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
est0: <enhanced speedstep="" frequency="" control="">on cpu0
p4tcc0: <cpu frequency="" thermal="" control="">on cpu0
est1: <enhanced speedstep="" frequency="" control="">on cpu1
p4tcc1: <cpu frequency="" thermal="" control="">on cpu1
Timecounters tick every 1.000 msec
IPsec: Initialized Security Association Processing.
random: unblocking device.
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 480Mbps High Speed USB v2.0
ugen0.1: <intel>at usbus0
uhub0: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usbus0
ugen2.1: <intel>at usbus2
uhub1: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usbus2
ugen1.1: <intel>at usbus1
uhub2: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usbus1
ugen4.1: <intel>at usbus4
uhub3: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usbus4
ugen3.1: <intel>at usbus3
uhub4: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usbus3
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
ada0 at ata2 bus 0 scbus1 target 0 lun 0
ada0: <st3250310as 3.aaf="">ATA-7 SATA 1.x device
cd0 at ata2 bus 0 scbus1 target 1 lun 0
cd0: <tsstcorp cddvdw="" ts-h653n="" 0208="">Removable CD-ROM SCSI-0 device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
ada0: Serial Number 6RYAJH0Y
ada0: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes)
ada0: 238475MB (488397168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
SMP: AP CPU #1 Launched!
Timecounter "TSC-low" frequency 1097273320 Hz quality 1000
Root mount waiting for: usbus4
Root mount waiting for: usbus4
Root mount waiting for: usbus4
uhub3: 8 ports with 8 removable, self powered
Root mount waiting for: usbus4
ugen4.2: <vendor 0x0409="">at usbus4
uhub5: <vendor 2="" 9="" 0x0409="" product="" 0x005a,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usbus4
Root mount waiting for: usbus4
uhub5: 4 ports with 4 removable, self powered
ugen4.3: <vendor 0x0b95="">at usbus4
axe0: <vendor 3="" 0x0b95="" product="" 0x7720,="" rev="" 2.00="" 0.01,="" addr="">on usbus4
Root mount waiting for: usbus4
ugen4.4: <microsoft>at usbus4
ukbd0: <microsoft 0="" 4="" natural="" ergonomic="" keyboard="" 4000,="" class="" 0,="" rev="" 2.00="" 1.73,="" addr="">on usbus4
miibus0: <mii bus="">on axe0
ukphy0: <generic ieee="" 802.3u="" media="" interface="">PHY 16 on miibus0
ukphy0:  none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
kbd2 at ukbd0
ue0: <usb ethernet="">on axe0
uhid0: <microsoft 0="" 4="" natural="" ergonomic="" keyboard="" 4000,="" class="" 0,="" rev="" 2.00="" 1.73,="" addr="">on usbus4
Root mount waiting for: usbus4
Trying to mount root from ufs:/dev/ada0s1a [rw]…
ugen3.2: <crystalfontz america="">at usbus3
umodem0: <crystalfontz 2="" america="" cfa-735="" display,="" class="" 0,="" rev="" 2.00="" 2.00,="" addr="">on usbus3
umodem0: data interface 1, has no CM over data, has no break</crystalfontz></crystalfontz></microsoft></usb></generic></mii></microsoft></microsoft></vendor></vendor></vendor></vendor></tsstcorp></st3250310as></intel></intel></intel></intel></intel></intel></intel></intel></intel></intel></cpu></enhanced></cpu></enhanced></at></keyboard></generic></system></isa></floppy></power></ata></ata></intel></ata></intel></isa></pci-isa></acpi></acpi></intel></intel></intel></intel></intel></intel(r)></acpi></acpi></intel(r)></acpi></acpi></acpi></acpi></intel></vga-compatible></acpi></acpi></at></at></acpi></acpi></ptltd ></software></software,></version></intelb></lahf></syscall,nx,lm></sse3,dtes64,mon,ds_cpl,est,tm2,ssse3,cx16,xtpr,pdcm></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>

[Topper727]

Posted by: stephenw10
« on: Today at 07:46:29 am » Insert Quote
Try disabling msi/msi-x:
https://doc.pfsense.org/index.php/Tuning_and_Troubleshooting_Network_Cards#MSI.2FMSIX

Tried this and nothing changed at all.. still only 1 built on lan port works.  This is not too much of problem right at moment cause I am using not fast internet so my USB - LAN 100 works ok for the slow speed.  But I plan to get much faster and I need the 1gig built on to work

[stephenw10]

Did you have that enabled during the above boot? I still see:

em0: Using an MSI interrupt

Steve

[Topper727]

yes, I had that still the default on and after sending that log then I changed it in crossed fingers it might work.  but did not

[stephenw10]

@charliem:

Not sure if that patch ever made it into 9.3 or 10.1

Looks like it's in 10.1:
https://svnweb.freebsd.org/base/release/10.1.0/sys/dev/acpica/acpi_pcib_acpi.c?revision=274417&view=markup#l210

Steve

[Topper727]

So wonder how to get this dual nic to show 2 nics not just 1 in pfsense 2.2?

[stephenw10]

Hard to believe you're the first person to run into this. More Googling required.
Since this appears to be a resource allocation problem it could be a bios bug. You could try disabling acpi or/and disabling any devices you're not using, sound card, parallel port etc.

Steve

[Topper727]

Still not giving up, if one works and the driver is in Freebsd then there is some way to get the second port of the Intel 82546 dual nic built on the motherboard.  Below is the command pciconf.  I believe I see the device listed there that is missing

[2.2-BETA][admin@pfSense.localdomain]/root: pciconf -lv
hostb0@pci0:0:0:0:      class=0x060000 card=0xb58015d9 chip=0x29708086 rev=0x02 hdr=0x00
    class      = bridge
    subclass  = HOST-PCI
vgapci0@pci0:0:2:0:    class=0x030000 card=0xb58015d9 chip=0x29728086 rev=0x02 hdr=0x00
    class      = display
    subclass  = VGA
pcib1@pci0:0:28:0:      class=0x060400 card=0xb58015d9 chip=0x27d08086 rev=0x01 hdr=0x01
    class      = bridge
    subclass  = PCI-PCI
pcib2@pci0:0:28:4:      class=0x060400 card=0xb58015d9 chip=0x27e08086 rev=0x01 hdr=0x01
    class      = bridge
    subclass  = PCI-PCI
pcib3@pci0:0:28:5:      class=0x060400 card=0xb58015d9 chip=0x27e28086 rev=0x01 hdr=0x01
    class      = bridge
    subclass  = PCI-PCI
uhci0@pci0:0:29:0:      class=0x0c0300 card=0xb58015d9 chip=0x27c88086 rev=0x01 hdr=0x00
    class      = serial bus
    subclass  = USB
uhci1@pci0:0:29:1:      class=0x0c0300 card=0xb58015d9 chip=0x27c98086 rev=0x01 hdr=0x00
    class      = serial bus
    subclass  = USB
uhci2@pci0:0:29:2:      class=0x0c0300 card=0xb58015d9 chip=0x27ca8086 rev=0x01 hdr=0x00
    class      = serial bus
    subclass  = USB
uhci3@pci0:0:29:3:      class=0x0c0300 card=0xb58015d9 chip=0x27cb8086 rev=0x01 hdr=0x00
    class      = serial bus
    subclass  = USB
ehci0@pci0:0:29:7:      class=0x0c0320 card=0xb58015d9 chip=0x27cc8086 rev=0x01 hdr=0x00
    class      = serial bus
    subclass  = USB
pcib4@pci0:0:30:0:      class=0x060401 card=0xb58015d9 chip=0x244e8086 rev=0xe1 hdr=0x01
    class      = bridge
    subclass  = PCI-PCI
isab0@pci0:0:31:0:      class=0x060100 card=0xb58015d9 chip=0x27b88086 rev=0x01 hdr=0x00
    class      = bridge
    subclass  = PCI-ISA
atapci0@pci0:0:31:1:    class=0x01018a card=0xb58015d9 chip=0x27df8086 rev=0x01 hdr=0x00
    class      = mass storage
    subclass  = ATA
atapci1@pci0:0:31:2:    class=0x01018f card=0xb58015d9 chip=0x27c08086 rev=0x01 hdr=0x00
    class      = mass storage
    subclass  = ATA
none0@pci0:0:31:3:      class=0x0c0500 card=0xb58015d9 chip=0x27da8086 rev=0x01 hdr=0x00
    class      = serial bus
    subclass  = SMBus
none1@pci0:6:0:0:      class=0x020000 card=0x109a15d9 chip=0x109a8086 rev=0x00 hdr=0x00
    class      = network
    subclass  = ethernet
em0@pci0:7:0:0: class=0x020000 card=0x109a15d9 chip=0x109a8086 rev=0x00 hdr=0x00
    class      = network
    subclass  = ethernet

[Topper727]

I have updated the bios from 2007 version to a 2009 latest one they had.  I even played with jumpers to disable the working one and then the other worked.. So both will work but only 1 at a time.

[stephenw10]

Yep that's it but it doesn't help much. Actually reading back through the boot log most of the errors are not directly about the NICs but the buses/bridges the are attached to.
The thing with the most errors is pcib1 ,PCI bridge 1. That appears to be connecting PCI bus 0 to PCI bus 2. These are not necessarily PCI buses as you might think of them, they could be PCIe or AGP or some thing else.
PCI bridge 2 connects PCI bus 0 to PCI bus 6. The first NIC that fails to attach to a driver is on PCI bus 6.
PCI bridge 3 connects PCI bus 0 to PCI bus 7. The NIC that works is on bus 7.
Both these PCI bridges are showing the same allocation errors yet one is functioning just fine.

Those errors, though not good, may be not relevent. Do you see anything like that under 2.1.5?

You could try booting in verbose mode to see if any further errors are given.
I was sure there was on option to do this in 2.2  but I can't find it now  ??? so just add boot_verbose="1" to loader.conf.local.

Steve

[stephenw10]

This looks to have appeared in 9.1:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=176073

Steve

[stephenw10]

Long shot but try this:

If additionally DMA-Support for VT-d is disabled, it also works with FreeBSD (9.1).

I assume in the BIOS.

Steve

[Topper727]

In looking around maybe this has something to do with it.

https://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y&DwnldID=17509

They say the last driver dated 4 months ago only supports the 9.x kernals of Freebsd.  Maybe this is why it breaks in 10.1?

[Topper727]

I did not find any DMA stuff in bios.. As far as ACPI I turned that off and pfsense would not boot then.. I turned off shadowing and all kinds of stuff nothing makes a difference.


[Topper727]

Updated to the 2.2 Dec 10th RC version.  Still same, I tried to put in a wifi PCI card in the system and it did same as the dual nic card bv intel I tried also

Seems what ever is messing up em1 from working anything else in the system will not run except USB -Network

The wifi Card I tried  was the wmp54gs pci… It failed and locked like the intel dual nic PCI card did showing this message (see picture)


[stephenw10]

That card should be supported by the bwn or bwi drivers, depending which version you have, but you need the firmware for it and I've seen it give others trouble before. Still shouldn't be hanging there though.  :-
Do you have the ports on the Intel NIC connected and up when booting? I've read some posts saying that makes a difference.

Steve

[Topper727]

Ok did some testing.  The 2 built on the pdsbm motherboard the Intel 82573 will only work with 1 of the 2.. either one but only 1..  And when you do this then nothing WIFI wmp54gs  or dual nic pci card I put in will boot, all lock up.  When I disabled the 2 built on intel 82573 and then booted with  the wifi card it worked..

I then tried the dual 82546 Intel PCI card with the onboard ports off and it worked fine also.

So I guess the newer Intel dual nic chip 82573 has some bug in the driver that the Intel 82546 does not.  I can't put the pci 82546 and wifi in as I don't have enough PCI slots

And pulling all cables from the net ports did not change a thing. Still same results.  If either 1 or both are enabled on the motherboard the PCI cards will only lock up .. wifi and dual pci nic.  .


[Topper727]

I can setup ssh for someone to look around if needed.. I hope to get this working please..