Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Installing OpenBSD on XG-7100

    Scheduled Pinned Locked Moved Official Netgate® Hardware
    30 Posts 4 Posters 2.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S
      stephenw10 Netgate Administrator
      last edited by

      For security purposes all the ports on the switch are disabled at boot. Otherwise the default WAN and LAN would be connected together before the config was loaded!
      If you boot any other OS on the XG-7100 the Eth ports will not pass traffic without a switch driver.

      I don't have either and m.2 SSD or the extra RAM but neither should affect the console options.

      Steve

      1 Reply Last reply Reply Quote 0
      • M
        madapter
        last edited by madapter

        I see so the ethernet ports are completely disabled.

        Removing the m.2 is straight forward. However, when I remove the RAM the system doesn't seem to power up. Is there something special that needs to be done?

        1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator
          last edited by

          Hmm, like doesn't even run Coreboot?

          When you add additional RAM it has to run a retraining process for it that can take some time. I'm not aware of needing to do that if you remove it again but personally I've never tried that.

          You might try resetting the NVRAM so it retrains again. Set jumpers J10 and J11 to position 2-3 then power on the box. It will power up for a few seconds then power off. Remove the jumpers (or replace to 1-2) and power on again.

          Steve

          1 Reply Last reply Reply Quote 0
          • M
            madapter
            last edited by

            Our XG-7100 did not ship with jumpers but found 2, placed them on the J10 and J11 2-3 block. Did nothing it didn't get into coreboot (fan never turns off from high spin).

            Are there any other headers of interest?

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              Not for clearing the NVRAM.
              With jumpers there on 2-3 I expect it to power on with fans at full for a few seconds then power off to indicate it has done the reset.
              I assume you did that with the additional RAM removed? And adding the jumpers made no difference, that's the same behaviour you experienced just by removing the RAM?

              Steve

              1 Reply Last reply Reply Quote 0
              • M
                madapter
                last edited by

                Resetting it before removing the RAM got into core boot but it looks like I'm still halting in the same location.

                root on rd0a swap on rd0b dump on rd0b
                erase ^?, werase

                What version of OpenBSD did you try this with and did you boot from a DVD or USB?

                BTW Thanks for the help so far!

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  I didn't, I have never tried it with OpenBSD. The point where it's stopping looks like the wrong console set as primary. That going entirely from FreeBSD experience but the fact it still shows device attach messages also indicates that.
                  In FreeBSD/pfSense we don't set anything beyond comconsole and the com speed. It may be necessary to set something else in OpenBSD.

                  Looks like you might have to edit /etc/ttys to actually get a login prompt there:
                  http://www.openbsd.org/faq/faq7.html#SerCon

                  Steve

                  1 Reply Last reply Reply Quote 0
                  • M
                    madapter
                    last edited by

                    Thanks, been through that at the start.

                    Is there another serial header on the board that we can use? If so can you provide the header block and the pinout info?

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by stephenw10

                      SoC UART1 is in pins 3 and 4 of J2. But that's not the issue here the serial console is working for the boot output just not the interactive console. I'd double check /etc/ttys.

                      Steve

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Our development guys tell me that retraining for the RAM can take up to 10mins so that's likely the problem there. Just wait longer if you need to remove the RAM. Or to reinstall it if it has retrained without it.

                        Steve

                        1 Reply Last reply Reply Quote 0
                        • M
                          madapter
                          last edited by

                          Confirmed it varies but up to 10 minutes is what I'm seeing. I guess 5 minutes wait isn't enough sometimes. Still no luck in getting OpenBSD installed.

                          1 Reply Last reply Reply Quote 0
                          • RicoR
                            Rico LAYER 8 Rebel Alliance
                            last edited by

                            Wouldn't be FreeBSD the better choice to run on the XG-7100 anyway?

                            -Rico

                            1 Reply Last reply Reply Quote 0
                            • M
                              madapter
                              last edited by

                              It really comes down to what you're doing with the XG-7100. In general FreeBSD would be sufficient, but at the same time we're trying a few other OS to see what the limitations of the XG-7100 so that we can for production use under different scenarios.

                              1 Reply Last reply Reply Quote 0
                              • F
                                float
                                last edited by

                                Sorry to bump this topic. I'm also trying to install OpenBSD.

                                @madapter Does your system only have the eMMc 32GB or a m.2?

                                I noticed that OpenBSD does not detect the eMMc.

                                FreeBSD does:
                                mmcsd0: 31GB <MMCHC BJTD4R 0.3 SN D071F424 MFG 01/2018 by 21 0x0000> at mmc0 200.0MHz/8bit/8192-block
                                mmcsd0boot0: 4MB partition 1 at mmcsd0
                                mmcsd0boot1: 4MB partition 2 at mmcsd0
                                mmcsd0rpmb: 4MB partition 3 at mmcsd0

                                Could it be that because of the lack of detection of the eMMC, the system thinks it doens't have a HDD to install and thus does not show the install option?

                                1 Reply Last reply Reply Quote 0
                                • stephenw10S
                                  stephenw10 Netgate Administrator
                                  last edited by

                                  You are seeing exactly the same output?

                                  It still looks like it's trying to use the VGA console to me.

                                  Steve

                                  1 Reply Last reply Reply Quote 0
                                  • F
                                    float
                                    last edited by float

                                    Yes, but eMMc is not mentioned:

                                    OpenBSD 6.7 (RAMDISK_CD) #177: Thu May  7 11:19:02 MDT 2020
                                        deraadt@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/RAMDISK_CD
                                    real mem = 8562393088 (8165MB)
                                    avail mem = 8298868736 (7914MB)
                                    mainbus0 at root
                                    bios0 at mainbus0: SMBIOS rev. 2.7 @ 0x7f6d7020 (7 entries)
                                    bios0: vendor coreboot version "ADI_PLCC-01.00.00.11" date 01/08/2019
                                    bios0: Silicom, Ltd. 80300-0134-g01
                                    acpi0 at bios0: ACPI 3.0
                                    acpi0: tables DSDT FACP SSDT MCFG TCPA APIC DMAR
                                    acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
                                    cpu0 at mainbus0: apid 4 (boot processor)
                                    cpu0: Intel(R) Atom(TM) CPU C3558 @ 2.20GHz, 2195.39 MHz, 06-5f-01
                                    cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SMEP,ERMS,MPX,RDSEED,SMAP,CLFLUSHOPT,PT,SHA,IBRS,IBPB,STIBP,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
                                    cpu0: 2MB 64b/line 16-way L2 cache
                                    cpu0: cannot disable silicon debug
                                    cpu0: apic clock running at 25MHz
                                    cpu0: mwait min=64, max=64, C-substates=0.2.0.2, IBE
                                    cpu at mainbus0: not configured
                                    cpu at mainbus0: not configured
                                    cpu at mainbus0: not configured
                                    ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins, remapped
                                    acpiprt0 at acpi0: bus 0 (PCI0)
                                    acpiprt1 at acpi0: bus -1 (RP01)
                                    acpiprt2 at acpi0: bus -1 (RP02)
                                    acpiprt3 at acpi0: bus -1 (RP03)
                                    acpiprt4 at acpi0: bus -1 (RP04)
                                    acpiprt5 at acpi0: bus 2 (RP05)
                                    acpiprt6 at acpi0: bus -1 (RP06)
                                    acpiprt7 at acpi0: bus 3 (RP07)
                                    acpiprt8 at acpi0: bus 4 (RP08)
                                    acpicpu at acpi0 not configured
                                    "PNP0C0C" at acpi0 not configured
                                    "PNP0A08" at acpi0 not configured
                                    "PNP0003" at acpi0 not configured
                                    acpicmos0 at acpi0
                                    "INTC3000" at acpi0 not configured
                                    "BOOT0000" at acpi0 not configured
                                    pci0 at mainbus0 bus 0
                                    pchb0 at pci0 dev 0 function 0 "Intel C3000 Host" rev 0x11
                                    pchb1 at pci0 dev 4 function 0 "Intel C3000 GLREG" rev 0x11
                                    "Intel C3000 RCEC" rev 0x11 at pci0 dev 5 function 0 not configured
                                    ppb0 at pci0 dev 6 function 0 "Intel C3000 PCIE" rev 0x11
                                    pci1 at ppb0 bus 1
                                    "Intel C3000 QAT" rev 0x11 at pci1 dev 0 function 0 not configured
                                    ppb1 at pci0 dev 14 function 0 "Intel C3000 PCIE" rev 0x11
                                    pci2 at ppb1 bus 2
                                    ppb2 at pci0 dev 16 function 0 "Intel C3000 PCIE" rev 0x11
                                    pci3 at ppb2 bus 3
                                    ppb3 at pci0 dev 17 function 0 "Intel C3000 PCIE" rev 0x11
                                    pci4 at ppb3 bus 4
                                    "Intel C3000 SMBus" rev 0x11 at pci0 dev 18 function 0 not configured
                                    ahci0 at pci0 dev 20 function 0 "Intel C3000 AHCI" rev 0x11: msi, AHCI 1.3.1
                                    scsibus0 at ahci0: 32 targets
                                    xhci0 at pci0 dev 21 function 0 "Intel C3000 xHCI" rev 0x11: msi, xHCI 1.0
                                    usb0 at xhci0: USB revision 3.0
                                    uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00 addr 1
                                    ppb4 at pci0 dev 22 function 0 "Intel C3000 PCIE" rev 0x11
                                    pci5 at ppb4 bus 5
                                    ix0 at pci5 dev 0 function 0 "Intel X553 SFP+" rev 0x11: msi, address XX
                                    ix1 at pci5 dev 0 function 1 "Intel X553 SFP+" rev 0x11: msi, address XX
                                    ppb5 at pci0 dev 23 function 0 "Intel C3000 PCIE" rev 0x11
                                    pci6 at ppb5 bus 6
                                    ix2 at pci6 dev 0 function 0 "Intel X553 Backplane" rev 0x11: msi, address XX
                                    ix3 at pci6 dev 0 function 1 "Intel X553 Backplane" rev 0x11: msi, address XX
                                    "Intel C3000 ME HECI" rev 0x11 at pci0 dev 24 function 0 not configured
                                    sdhc0 at pci0 dev 28 function 0 "Intel C3000 eMMC" rev 0x11: apic 2 int 16
                                    sdhc0: SDHC 3.0, 200 MHz base clock
                                    sdmmc0 at sdhc0: 8-bit, sd high-speed, mmc high-speed, dma
                                    "Intel C3000 LPC" rev 0x11 at pci0 dev 31 function 0 not configured
                                    "Intel C3000 PMC" rev 0x11 at pci0 dev 31 function 2 not configured
                                    "Intel C3000 SMBus" rev 0x11 at pci0 dev 31 function 4 not configured
                                    "Intel C3000 SPI" rev 0x11 at pci0 dev 31 function 5 not configured
                                    isa0 at mainbus0
                                    com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
                                    com0: console
                                    com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
                                    sdmmc0: can't enable card
                                    softraid0 at root
                                    scsibus1 at softraid0: 256 targets
                                    PXE boot MAC address 0XXXX, interface ix2
                                    root on rd0a swap on rd0b dump on rd0b
                                    WARNING: CHECK AND RESET THE DATE!
                                    erase ^?, werase
                                    
                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      Nope seems to hang just at that point when it's writing out the install menu. Booting verbose is also no help. Google is failing me. Seems surprising no one else has hit this on other devices...

                                      1 Reply Last reply Reply Quote 0
                                      • F
                                        float
                                        last edited by

                                        I tried to install with 6.7-current but still the same issue. Could it be that some hardware is not supported by OpenBSD?

                                        >> OpenBSD/amd64 PXEBOOT 3.52
                                        boot> stty com0 115200
                                        boot> set tty com0
                                        switching console to com0
                                                                 >> OpenBSD/amd64 PXEBOOT 3.52
                                        boot> bsd.rd
                                        cannot open tftp:/etc/random.seed: No such file or directory
                                        booting tftp:bsd.rd: 3826381+1573888+3882216+0+757760 [324033+128+468408+313269]=0xaa33b8
                                        entry point at 0xffffffff81001000
                                                                         Copyright (c) 1982, 1986, 1989, 1991, 1993
                                                The Regents of the University of California.  All rights reserved.
                                        Copyright (c) 1995-2020 OpenBSD. All rights reserved.  https://www.OpenBSD.org
                                        
                                        OpenBSD 6.7-current (RAMDISK_CD) #27: Sat Aug 15 10:19:27 MDT 2020
                                            deraadt@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/RAMDISK_CD
                                        real mem = 8562393088 (8165MB)
                                        avail mem = 8298868736 (7914MB)
                                        random: good seed from bootblocks
                                        mainbus0 at root
                                        bios0 at mainbus0: SMBIOS rev. 2.7 @ 0x7f6d7020 (7 entries)
                                        bios0: vendor coreboot version "ADI_PLCC-01.00.00.11" date 01/08/2019
                                        bios0: Silicom, Ltd. 80300-0134-g01
                                        acpi0 at bios0: ACPI 3.0
                                        acpi0: tables DSDT FACP SSDT MCFG TCPA APIC DMAR
                                        acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
                                        cpu0 at mainbus0: apid 4 (boot processor)
                                        cpu0: Intel(R) Atom(TM) CPU C3558 @ 2.20GHz, 2195.40 MHz, 06-5f-01
                                        cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SMEP,ERMS,MPX,RDSEED,SMAP,CLFLUSHOPT,PT,SHA,IBRS,IBPB,STIBP,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES
                                        cpu0: 2MB 64b/line 16-way L2 cache
                                        cpu0: cannot disable silicon debug
                                        cpu0: apic clock running at 25MHz
                                        cpu0: mwait min=64, max=64, C-substates=0.2.0.2, IBE
                                        cpu at mainbus0: not configured
                                        cpu at mainbus0: not configured
                                        cpu at mainbus0: not configured
                                        ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins, remapped
                                        acpiprt0 at acpi0: bus 0 (PCI0)
                                        acpiprt1 at acpi0: bus -1 (RP01)
                                        acpiprt2 at acpi0: bus -1 (RP02)
                                        acpiprt3 at acpi0: bus -1 (RP03)
                                        acpiprt4 at acpi0: bus -1 (RP04)
                                        acpiprt5 at acpi0: bus 2 (RP05)
                                        acpiprt6 at acpi0: bus -1 (RP06)
                                        acpiprt7 at acpi0: bus 3 (RP07)
                                        acpiprt8 at acpi0: bus 4 (RP08)
                                        acpicpu at acpi0 not configured
                                        "PNP0C0C" at acpi0 not configured
                                        acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
                                        "PNP0003" at acpi0 not configured
                                        acpicmos0 at acpi0
                                        "INTC3000" at acpi0 not configured
                                        "BOOT0000" at acpi0 not configured
                                        pci0 at mainbus0 bus 0
                                        pchb0 at pci0 dev 0 function 0 "Intel C3000 Host" rev 0x11
                                        pchb1 at pci0 dev 4 function 0 "Intel C3000 GLREG" rev 0x11
                                        "Intel C3000 RCEC" rev 0x11 at pci0 dev 5 function 0 not configured
                                        ppb0 at pci0 dev 6 function 0 "Intel C3000 PCIE" rev 0x11
                                        pci1 at ppb0 bus 1
                                        "Intel C3000 QAT" rev 0x11 at pci1 dev 0 function 0 not configured
                                        ppb1 at pci0 dev 14 function 0 "Intel C3000 PCIE" rev 0x11
                                        pci2 at ppb1 bus 2
                                        ppb2 at pci0 dev 16 function 0 "Intel C3000 PCIE" rev 0x11
                                        pci3 at ppb2 bus 3
                                        ppb3 at pci0 dev 17 function 0 "Intel C3000 PCIE" rev 0x11
                                        pci4 at ppb3 bus 4
                                        "Intel C3000 SMBus" rev 0x11 at pci0 dev 18 function 0 not configured
                                        ahci0 at pci0 dev 20 function 0 "Intel C3000 AHCI" rev 0x11: msi, AHCI 1.3.1
                                        scsibus0 at ahci0: 32 targets
                                        xhci0 at pci0 dev 21 function 0 "Intel C3000 xHCI" rev 0x11: msi, xHCI 1.0
                                        usb0 at xhci0: USB revision 3.0
                                        uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 3.00/1.00 addr 1
                                        ppb4 at pci0 dev 22 function 0 "Intel C3000 PCIE" rev 0x11
                                        pci5 at ppb4 bus 5
                                        ix0 at pci5 dev 0 function 0 "Intel X553 SFP+" rev 0x11, msix, 1 queue, address xx
                                        ix1 at pci5 dev 0 function 1 "Intel X553 SFP+" rev 0x11, msix, 1 queue, address xx
                                        ppb5 at pci0 dev 23 function 0 "Intel C3000 PCIE" rev 0x11
                                        pci6 at ppb5 bus 6
                                        ix2 at pci6 dev 0 function 0 "Intel X553 Backplane" rev 0x11, msix, 1 queue, address xx
                                        ix3 at pci6 dev 0 function 1 "Intel X553 Backplane" rev 0x11, msix, 1 queue, address xx
                                        "Intel C3000 ME HECI" rev 0x11 at pci0 dev 24 function 0 not configured
                                        sdhc0 at pci0 dev 28 function 0 "Intel C3000 eMMC" rev 0x11: apic 2 int 16
                                        sdhc0: SDHC 3.0, 200 MHz base clock
                                        sdmmc0 at sdhc0: 8-bit, sd high-speed, mmc high-speed, ddr52, dma
                                        "Intel C3000 LPC" rev 0x11 at pci0 dev 31 function 0 not configured
                                        "Intel C3000 PMC" rev 0x11 at pci0 dev 31 function 2 not configured
                                        "Intel C3000 SMBus" rev 0x11 at pci0 dev 31 function 4 not configured
                                        "Intel C3000 SPI" rev 0x11 at pci0 dev 31 function 5 not configured
                                        isa0 at mainbus0
                                        com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
                                        com0: console
                                        com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
                                        umass0 at uhub0 port 2 configuration 1 interface 0 "Sony Storage Media" rev 2.00/1.00 addr 2
                                        umass0: using SCSI over Bulk-Only
                                        scsibus1 at umass0: 2 targets, initiator 0
                                        sd0 at scsibus1 targ 1 lun 0: <Sony, Storage Media, 0100> removable serial.054c0439008123001204
                                        sd0: 7740MB, 512 bytes/sector, 15851520 sectors
                                        sdmmc0: can't enable card
                                        softraid0 at root
                                        scsibus2 at softraid0: 256 targets
                                        PXE boot MAC address xx, interface ix2
                                        root on rd0a swap on rd0b dump on rd0b
                                        erase ^?, werase
                                        
                                        1 Reply Last reply Reply Quote 0
                                        • stephenw10S
                                          stephenw10 Netgate Administrator
                                          last edited by

                                          For some reason the installer is hanging at that point. I have no idea why. It seems to be uncommon, I can find no other similar reports.

                                          Using OpenBSD on the XG-7100 is going to be pretty restricted anyway even you do get it installed. You would only be able to use the SFP ports or anything in the expansion slot.

                                          Steve

                                          1 Reply Last reply Reply Quote 0
                                          • F
                                            float
                                            last edited by

                                            I also tried to install Freebsd 12.1 via the serial console. That worked like a charm after doing "set kern.vty=sc" :-)

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.