Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Trouble with double ethernet PCI :(

    Scheduled Pinned Locked Moved Hardware
    12 Posts 3 Posters 5.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • I
      Imbroglio
      last edited by

      Greetings.

      I am having a bit of trouble trying to get a StarTech ST1000SPEXDP working on a pfSense 1.2.3 running on a Shuttle. The StarTech card is a PCI card using 8111 chips.

      This router also has the on-board ethernet port, and a second card.

      The on-board port is coming up as re1 and the second card sk0, but only one port of the StarTech card is showing up, and is re0.

      Much troubleshooting so far, but no success.

      If anyone has any ideas, it would be appreciated.

      1 Reply Last reply Reply Quote 0
      • W
        wallabybob
        last edited by

        Please post the output of the following two shell commands:

        dmesg; pciconf

        (Best way to capture the output is probably from the web GUI: Diagnostics -> Command )

        1 Reply Last reply Reply Quote 0
        • I
          Imbroglio
          last edited by

          Here it is:

          $ dmesg
          Copyright (c) 1992-2009 The FreeBSD Project.
          Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
          	The Regents of the University of California. All rights reserved.
          FreeBSD is a registered trademark of The FreeBSD Foundation.
          FreeBSD 7.2-RELEASE-p5 #0: Sun Dec  6 23:20:31 EST 2009
              sullrich@FreeBSD_7.2_pfSense_1.2.3_snaps.pfsense.org:/usr/obj.pfSense/usr/pfSensesrc/src/sys/pfSense_SMP.7
          Timecounter "i8254" frequency 1193182 Hz quality 0
          CPU: Intel(R) Core(TM)2 Duo CPU     E7500  @ 2.93GHz (2926.01-MHz 686-class CPU)
            Origin = "GenuineIntel"  Id = 0x1067a  Stepping = 10
            Features=0xbfebfbff <fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe>Features2=0x408e3bd <sse3,dtes64,mon,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,xsave>AMD Features=0x20100000 <nx,lm>AMD Features2=0x1 <lahf>Logical CPUs per core: 2
          real memory  = 1037697024 (989 MB)
          avail memory = 1001541632 (955 MB)
          ACPI APIC Table: <020410 APIC1108>
          FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
           cpu0 (BSP): APIC ID:  0
           cpu1 (AP/HT): APIC ID:  1
          ioapic0 <version 2.0="">irqs 0-23 on motherboard
          wlan: mac acl policy registered
          kbd1 at kbdmux0
          cryptosoft0: <software crypto="">on motherboard
          padlock0: No ACE support.
          acpi0: <shuttl shuttle="">on motherboard
          acpi0: [ITHREAD]
          acpi0: Power Button (fixed)
          acpi0: reservation of 0, a0000 (3) failed
          acpi0: reservation of 100000, 3dd00000 (3) failed
          Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
          acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
          acpi_hpet0: <high precision="" event="" timer="">iomem 0xfed00000-0xfed003ff on acpi0
          Timecounter "HPET" frequency 14318180 Hz quality 900
          pcib0: <acpi host-pci="" bridge="">port 0xcf8-0xcff on acpi0
          pci0: <acpi pci="" bus="">on pcib0
          pcib1: <acpi pci-pci="" bridge="">irq 16 at device 1.0 on pci0
          pci1: <acpi pci="" bus="">on pcib1
          pcib2: <pci-pci bridge="">at device 0.0 on pci1
          pci2: <pci bus="">on pcib2
          pcib3: <pci-pci bridge="">irq 16 at device 0.0 on pci2
          pci3: <pci bus="">on pcib3
          re0: <realtek 8168="" 8168b="" 8168c="" 8168cp="" 8168d="" 8111b="" 8111c="" 8111cp="" pcie="" gigabit="" ethernet="">port 0xb800-0xb8ff mem 0xfe8ff000-0xfe8fffff,0xfdef0000-0xfdefffff irq 16 at device 0.0 on pci3
          re0: Using 1 MSI messages
          re0: Chip rev. 0x3c000000
          re0: MAC rev. 0x00400000
          miibus0: <mii bus="">on re0
          rgephy0: <rtl8169s 8110s="" 8211b="" media="" interface="">PHY 1 on miibus0
          rgephy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
          re0: Ethernet address: 00:e0:4c:68:60:ba
          re0: [FILTER]
          pcib4: <pci-pci bridge="">irq 17 at device 1.0 on pci2
          pci4: <pci bus="">on pcib4
          re1: <realtek 8168="" 8168b="" 8168c="" 8168cp="" 8168d="" 8111b="" 8111c="" 8111cp="" pcie="" gigabit="" ethernet="">port 0xc800-0xc8ff mem 0xfe9ff000-0xfe9fffff,0xfdff0000-0xfdffffff irq 17 at device 0.0 on pci4
          re1: Using 1 MSI messages
          re1: Chip rev. 0x3c000000
          re1: MAC rev. 0x00400000
          miibus1: <mii bus="">on re1
          rgephy1: <rtl8169s 8110s="" 8211b="" media="" interface="">PHY 1 on miibus1
          rgephy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
          re1: Ethernet address: 00:e0:4c:68:61:56
          re1: [FILTER]
          pcib5: <pci-pci bridge="">irq 18 at device 2.0 on pci2
          pci5: <pci bus="">on pcib5
          vgapci0: <vga-compatible display="">port 0xac00-0xac07 mem 0xfe400000-0xfe7fffff,0xd0000000-0xdfffffff irq 16 at device 2.0 on pci0
          pci0: <multimedia, hda="">at device 27.0 (no driver attached)
          pcib6: <acpi pci-pci="" bridge="">irq 16 at device 28.0 on pci0
          pci6: <acpi pci="" bus="">on pcib6
          pcib7: <acpi pci-pci="" bridge="">irq 17 at device 28.1 on pci0
          pci7: <acpi pci="" bus="">on pcib7
          pci7: <network, ethernet="">at device 0.0 (no driver attached)
          uhci0: <uhci (generic)="" usb="" controller="">port 0xa880-0xa89f irq 23 at device 29.0 on pci0
          uhci0: [GIANT-LOCKED]
          uhci0: [ITHREAD]
          usb0: <uhci (generic)="" usb="" controller="">on uhci0
          usb0: USB revision 1.0
          uhub0: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usb0
          uhub0: 2 ports with 2 removable, self powered
          uhci1: <uhci (generic)="" usb="" controller="">port 0xa800-0xa81f irq 19 at device 29.1 on pci0
          uhci1: [GIANT-LOCKED]
          uhci1: [ITHREAD]
          usb1: <uhci (generic)="" usb="" controller="">on uhci1
          usb1: USB revision 1.0
          uhub1: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usb1
          uhub1: 2 ports with 2 removable, self powered
          uhci2: <uhci (generic)="" usb="" controller="">port 0xa480-0xa49f irq 18 at device 29.2 on pci0
          uhci2: [GIANT-LOCKED]
          uhci2: [ITHREAD]
          usb2: <uhci (generic)="" usb="" controller="">on uhci2
          usb2: USB revision 1.0
          uhub2: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usb2
          uhub2: 2 ports with 2 removable, self powered
          uhci3: <uhci (generic)="" usb="" controller="">port 0xa400-0xa41f irq 16 at device 29.3 on pci0
          uhci3: [GIANT-LOCKED]
          uhci3: [ITHREAD]
          usb3: <uhci (generic)="" usb="" controller="">on uhci3
          usb3: USB revision 1.0
          uhub3: <intel 1="" 9="" uhci="" root="" hub,="" class="" 0,="" rev="" 1.00="" 1.00,="" addr="">on usb3
          uhub3: 2 ports with 2 removable, self powered
          ehci0: <intel 82801gb="" r="" (ich7)="" usb="" 2.0="" controller="">mem 0xfe3f7c00-0xfe3f7fff irq 23 at device 29.7 on pci0
          ehci0: [GIANT-LOCKED]
          ehci0: [ITHREAD]
          usb4: EHCI version 1.0
          usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
          usb4: <intel 82801gb="" r="" (ich7)="" usb="" 2.0="" controller="">on ehci0
          usb4: USB revision 2.0
          uhub4: <intel 1="" 9="" ehci="" root="" hub,="" class="" 0,="" rev="" 2.00="" 1.00,="" addr="">on usb4
          uhub4: 8 ports with 8 removable, self powered
          pcib8: <acpi pci-pci="" bridge="">at device 30.0 on pci0
          pci8: <acpi pci="" bus="">on pcib8
          skc0: <d-link dge-530t="" gigabit="" ethernet="">port 0xe800-0xe8ff mem 0xfebfc000-0xfebfffff irq 17 at device 9.0 on pci8
          skc0: DGE-530T Gigabit Ethernet Adapter rev. (0x9)
          sk0: <marvell semiconductor,="" inc.="" yukon="">on skc0
          sk0: Ethernet address: 1c:af:f7:6c:0a:51
          miibus2: <mii bus="">on sk0
          e1000phy0: <marvell 88e1011="" gigabit="" phy="">PHY 0 on miibus2
          e1000phy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX, auto
          skc0: [ITHREAD]
          isab0: <pci-isa bridge="">at device 31.0 on pci0
          isa0: <isa bus="">on isab0
          atapci0: <intel ich7="" udma100="" controller="">port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 31.1 on pci0
          ata0: <ata 0="" channel="">on atapci0
          ata0: [ITHREAD]
          atapci1: <intel ich7="" sata300="" controller="">port 0xa080-0xa087,0xa000-0xa003,0x9c00-0x9c07,0x9880-0x9883,0x9800-0x980f irq 19 at device 31.2 on pci0
          atapci1: [ITHREAD]
          ata2: <ata 0="" channel="">on atapci1
          ata2: [ITHREAD]
          ata3: <ata 1="" channel="">on atapci1
          ata3: [ITHREAD]
          pci0: <serial bus,="" smbus="">at device 31.3 (no driver attached)
          acpi_button0: <power button="">on acpi0
          speaker0: <pc speaker="">port 0x61 on acpi0
          cpu0: <acpi cpu="">on acpi0
          est0: <enhanced speedstep="" frequency="" control="">on cpu0
          p4tcc0: <cpu frequency="" thermal="" control="">on cpu0
          cpu1: <acpi cpu="">on acpi0
          est1: <enhanced speedstep="" frequency="" control="">on cpu1
          est: CPU supports Enhanced Speedstep, but is not recognized.
          est: cpu_vendor GenuineIntel, msr 6160b2506000b25
          device_attach: est1 attach returned 6
          p4tcc1: <cpu frequency="" thermal="" control="">on cpu1
          pmtimer0 on isa0
          orm0: <isa option="" rom="">at iomem 0xc0000-0xcc7ff pnpid ORM0000 on isa0
          atkbdc0: <keyboard controller="" (i8042)="">at port 0x60,0x64 on isa0
          atkbd0: <at keyboard="">irq 1 on atkbdc0
          kbd0 at atkbd0
          atkbd0: [GIANT-LOCKED]
          atkbd0: [ITHREAD]
          sc0: <system console="">at flags 0x100 on isa0
          sc0: VGA <16 virtual consoles, flags=0x300>
          sio0: configured irq 4 not in bitmap of probed irqs 0
          sio0: port may not be enabled
          sio0: configured irq 4 not in bitmap of probed irqs 0
          sio0: port may not be enabled
          sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
          sio0: type 8250 or not responding
          sio0: [FILTER]
          sio1: configured irq 3 not in bitmap of probed irqs 0
          sio1: port may not be enabled
          vga0: <generic isa="" vga="">at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
          ukbd0: <dell 0="" 2="" dell="" usb="" keyboard,="" class="" 0,="" rev="" 1.10="" 2.00,="" addr="">on uhub0
          kbd2 at ukbd0
          Timecounters tick every 1.000 msec
          IPsec: Initialized Security Association Processing.
          ad4: FAILURE - SET_MULTI status=51 <ready,dsc,error>error=4 <aborted>ad4: 7687MB <ssd 8gb="" 02.09092="">at ata2-master SATA150
          SMP: AP CPU #1 Launched!
          Trying to mount root from ufs:/dev/ad4s1a
          pflog0: promiscuous mode enabled
          carp0: INIT -> BACKUP
          re1: link state changed to UP
          carp0: 2 link states coalesced
          carp0: link state changed to DOWN
          sk0: link state changed to UP
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          carp0: link state changed to UP
          carp0: link state changed to DOWN
          carp0: INIT -> MASTER (preempting)
          carp0: link state changed to UP
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          arp: 192.168.1.9 is on sk0 but got reply from 00:26:b9:85:39:3b on re1
          arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
          
          $ pciconf -l -v
          hostb0@pci0:0:0:0:	class=0x060000 card=0x40011297 chip=0x2e308086 rev=0x03 hdr=0x00
              class      = bridge
              subclass   = HOST-PCI
          pcib1@pci0:0:1:0:	class=0x060400 card=0x40011297 chip=0x2e318086 rev=0x03 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          vgapci0@pci0:0:2:0:	class=0x030000 card=0x40011297 chip=0x2e328086 rev=0x03 hdr=0x00
              class      = display
              subclass   = VGA
          none0@pci0:0:27:0:	class=0x040300 card=0x40011297 chip=0x27d88086 rev=0x01 hdr=0x00
              class      = multimedia
              subclass   = HDA
          pcib6@pci0:0:28:0:	class=0x060400 card=0x40011297 chip=0x27d08086 rev=0x01 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          pcib7@pci0:0:28:1:	class=0x060400 card=0x40011297 chip=0x27d28086 rev=0x01 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          uhci0@pci0:0:29:0:	class=0x0c0300 card=0x40011297 chip=0x27c88086 rev=0x01 hdr=0x00
              class      = serial bus
              subclass   = USB
          uhci1@pci0:0:29:1:	class=0x0c0300 card=0x40011297 chip=0x27c98086 rev=0x01 hdr=0x00
              class      = serial bus
              subclass   = USB
          uhci2@pci0:0:29:2:	class=0x0c0300 card=0x40011297 chip=0x27ca8086 rev=0x01 hdr=0x00
              class      = serial bus
              subclass   = USB
          uhci3@pci0:0:29:3:	class=0x0c0300 card=0x40011297 chip=0x27cb8086 rev=0x01 hdr=0x00
              class      = serial bus
              subclass   = USB
          ehci0@pci0:0:29:7:	class=0x0c0320 card=0x40011297 chip=0x27cc8086 rev=0x01 hdr=0x00
              class      = serial bus
              subclass   = USB
          pcib8@pci0:0:30:0:	class=0x060401 card=0x40011297 chip=0x244e8086 rev=0xe1 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          isab0@pci0:0:31:0:	class=0x060100 card=0x40011297 chip=0x27b88086 rev=0x01 hdr=0x00
              class      = bridge
              subclass   = PCI-ISA
          atapci0@pci0:0:31:1:	class=0x01018a card=0x40011297 chip=0x27df8086 rev=0x01 hdr=0x00
              class      = mass storage
              subclass   = ATA
          atapci1@pci0:0:31:2:	class=0x01018f card=0x40011297 chip=0x27c08086 rev=0x01 hdr=0x00
              class      = mass storage
              subclass   = ATA
          none1@pci0:0:31:3:	class=0x0c0500 card=0x40011297 chip=0x27da8086 rev=0x01 hdr=0x00
              class      = serial bus
              subclass   = SMBus
          pcib2@pci0:1:0:0:	class=0x060400 card=0x00000000 chip=0x8232104c rev=0x02 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          pcib3@pci0:2:0:0:	class=0x060400 card=0x00000000 chip=0x8233104c rev=0x02 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          pcib4@pci0:2:1:0:	class=0x060400 card=0x00000000 chip=0x8233104c rev=0x02 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          pcib5@pci0:2:2:0:	class=0x060400 card=0x00000000 chip=0x8233104c rev=0x02 hdr=0x01
              class      = bridge
              subclass   = PCI-PCI
          re0@pci0:3:0:0:	class=0x020000 card=0x816810ec chip=0x816810ec rev=0x02 hdr=0x00
              class      = network
              subclass   = ethernet
          re1@pci0:4:0:0:	class=0x020000 card=0x816810ec chip=0x816810ec rev=0x02 hdr=0x00
              class      = network
              subclass   = ethernet
          none2@pci0:7:0:0:	class=0x020000 card=0x40011297 chip=0x438011ab rev=0x10 hdr=0x00
              class      = network
              subclass   = ethernet
          skc0@pci0:8:9:0:	class=0x020000 card=0x4b011186 chip=0x4b011186 rev=0x11 hdr=0x00
              class      = network
              subclass   = ethernet</ssd></aborted></ready,dsc,error></dell></generic></system></at></keyboard></isa></cpu></enhanced></acpi></cpu></enhanced></acpi></pc></power></serial></ata></ata></intel></ata></intel></isa></pci-isa></marvell></mii></marvell></d-link></acpi></acpi></intel></intel></intel></intel></uhci></uhci></intel></uhci></uhci></intel></uhci></uhci></intel></uhci></uhci></network,></acpi></acpi></acpi></acpi></multimedia,></vga-compatible></pci></pci-pci></rtl8169s></mii></realtek></pci></pci-pci></rtl8169s></mii></realtek></pci></pci-pci></pci></pci-pci></acpi></acpi></acpi></acpi></high></shuttl></software></version></lahf></nx,lm></sse3,dtes64,mon,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,sse4.1,xsave></fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,htt,tm,pbe> 
          
          1 Reply Last reply Reply Quote 0
          • W
            wallabybob
            last edited by

            You have three network interfaces on the system: re0, re1 and sk0.

            You apparently have a D-Link DGE-530T card (the Startech card is a rebadged DLink?)

            re1 and sk0 were reported UP (the interfaces saw carrier from a switch or other system). Is anything connected to re0?

            The kind of message:

            arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
            arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
            arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1
            arp: 192.168.1.250 is on sk0 but got reply from 00:22:19:ba:63:27 on re1

            suggests there is some kind of confusion about sk0 and re1, for example the IP address of sk0 is 192.168.1.x/24 but a system with IP address 192.168.1.250 is on the network connected to re1 when it should be on the network connected to sk0. Maybe you should swap the cables on sk0 and re1.

            From your description I suspect you have one port (called sk0) on the motherboard and two ports (called re0 and re1) on a plug-in card .

            1 Reply Last reply Reply Quote 0
            • D
              dreamslacker
              last edited by

              The Startech card is a dual Realtek 8111 card using a PLX bridge to provide the interface for both NICs from a single PCI-e x1.
              He apparently also has a D-Link DGE-530T PCI card.

              The Shuttle PC, it seems, uses a Marvell Phy. connected to the Intel chipset similar to how CSA works.  Hence, it shows up as:
              e1000phy0

              1 Reply Last reply Reply Quote 0
              • W
                wallabybob
                last edited by

                Dreamslacker, your reply caused me to look a bit more closely at the pciconf output. That shows there are four ethernet devices visible in the PCI device tree, one of which is unrecognised by the operating system. (pciconf shows this as device none2). Analysis of the pciconf data shows its a device made by Marvell (chip=0xyyyy11ab) part of a Shuttle Computer assembly (card=0xyyyy1297), so this is probably the on-board NIC.

                The e1000phy is on  miibus2 which is on sk0 which is on skc0, the D-Link DGE-530T.

                Some of the PCI bridges are TI parts (chip=0xyyyy104c) but that's not relevant to the current issue.

                In summary, there are 4 devices in this system which identify themselves as Ethernet devices, there are drivers for three of them and the remaining one is probably the motherboard NIC.

                1 Reply Last reply Reply Quote 0
                • I
                  Imbroglio
                  last edited by

                  Indeed this Shuttle has 4 ethernet ports, 2 of them in one card.  :)

                  But only one port in the 2-port card has any function. It's coming up as re0. The other single port card is sk0.

                  So there is only re0, re1, and sk0. Only one port in the 2-port card is usable, but I cannot get the other to working.

                  In attempting to assign interfaces, this is the result initially from looking at option 1:

                  re0    00:e0:4c:68:60:ba
                  re1    00:e0:4c:68:61:56  (up)
                  sk0    1c:af:f7:6c:0a:51  (up)
                  tun0    0  (up)
                  tun1    0  (up)

                  In any case I can only get 3 MAC addresses out of this directly from the console but a MAC scan with all ports on a switch show only one.

                  This Shuttle is intended to replace an existing older shuttle and is using thta shuttle's settings, except for LAN, but since I have changed things around for troubleshooting and so I can connect the ports to the network for testing.

                  I was thinking of removing the other card (the single port), and seeing if the behavior changes at all - the idea is to get that second port on the 2-port card to work, and it has not shown any response thus far.  Perhaps there is a way to  scan for this hardware, or am I missing a jumper somewhere? This is most confusing but enjoyable in seeing if this would work. My other shuttle is using one board-based port, and a single port card, and then 2 USB ethernet adaptors. The use of the 2-port card is new for me, having not worked with these before.

                  1 Reply Last reply Reply Quote 0
                  • D
                    dreamslacker
                    last edited by

                    @wallabybob:

                    The e1000phy is on  miibus2 which is on sk0 which is on skc0, the D-Link DGE-530T.

                    Which is the odd thing, I have the exact same card and am pretty sure the e1000phy doesn't show up on that interface.  Whereas Shuttle is fairly fond of using Marvell Phys and NICs.

                    If he's using any of the 'newer' G3X/ G41 XPCs, this would be a 88E8056 nic supported by the MSK(4) driver.

                    I'm wondering if the issue actually lies with the use of the PCIe card.  The PCIe x16 slot technically only supports a single PCIe x1 device without disabling the integrated graphics.
                    No one that I know of has actually placed a PCIe x1 device with a PCIe bridge onboard on such a setup so that bridge chip might be causing issues with the assignment of IRQs.

                    1 Reply Last reply Reply Quote 0
                    • I
                      Imbroglio
                      last edited by

                      @dreamslacker:

                      @wallabybob:

                      The e1000phy is on  miibus2 which is on sk0 which is on skc0, the D-Link DGE-530T.

                      Which is the odd thing, I have the exact same card and am pretty sure the e1000phy doesn't show up on that interface.  Whereas Shuttle is fairly fond of using Marvell Phys and NICs.

                      If he's using any of the 'newer' G3X/ G41 XPCs, this would be a 88E8056 nic supported by the MSK(4) driver.

                      I'm wondering if the issue actually lies with the use of the PCIe card.  The PCIe x16 slot technically only supports a single PCIe x1 device without disabling the integrated graphics.
                      No one that I know of has actually placed a PCIe x1 device with a PCIe bridge onboard on such a setup so that bridge chip might be causing issues with the assignment of IRQs.

                      By chance would the disabling of the on-board graphics change the behavior?

                      1 Reply Last reply Reply Quote 0
                      • D
                        dreamslacker
                        last edited by

                        @Imbroglio:

                        By chance would the disabling of the on-board graphics change the behavior?

                        It might just work but the system might choose not to boot in such an instance due to the lack of graphics.  You can always try to do so but a CMOS reset is required if it doesn't work out.

                        Also, this means that you need either the embedded variant or enable the console output on the harddisk install.
                        1)  Remove the Realtek NIC
                        2)  Install pfsense
                        3)  Set the output redirect to serial console via WebGUI
                        4)  Replace the realtek nic and disable onboard graphics
                        5)  Boot and hook up another computer via serial 9600/8/N/1
                        6)  Reconfigure the interfaces off the serial console

                        The way I look at it, you have 3 devices sharing 1 IRQ off the PCIe slot (Int. gfx & 1 each for each of the realtek interfaces) - something that the platform wasn't designed to do (it was meant to only share 2 devices - 1 PCIe x1 and the Int. gfx).  A real dual-NIC chipset such as the Intel 82571 would probably have worked.

                        1 Reply Last reply Reply Quote 0
                        • W
                          wallabybob
                          last edited by

                          @Imbroglio:

                          By chance would the disabling of the on-board graphics change the behavior?

                          It might be easier to try a snapshot build of pfSense 2.0 BETA (go to http://snapshots.pfsense.org/ and follow appropriate links) than mess with disabling video. pfSense 2.0 uses a more up to date version of FreeBSD with updated device drivers which might recognise your onboard NIC.

                          @dreamslacker:

                          The way I look at it, you have 3 devices sharing 1 IRQ off the PCIe slot (Int. gfx & 1 each for each of the realtek interfaces) - something that the platform wasn't designed to do (it was meant to only share 2 devices - 1 PCIe x1 and the Int. gfx).

                          I don't understand the basis for this remark. The re devices report using different IRQs (16 and 17) and then report they are using MSI (Message Signalled Interrupts) which should give them distinct interrupts.

                          1 Reply Last reply Reply Quote 0
                          • D
                            dreamslacker
                            last edited by

                            @wallabybob:

                            I don't understand the basis for this remark. The re devices report using different IRQs (16 and 17) and then report they are using MSI (Message Signalled Interrupts) which should give them distinct interrupts.

                            My mistake.
                            I just assumed that the switched devices share the IRQ there because that is what I've encountered when using similar setups albeit with a Intel PT Dual port (with the extra PCIe lanes taped up to force x1 mode) on the 945GC chipset.

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.