Netgate 1100 bricked - any possibility to restore to factory?
-
What have you tried? How did it fail?
You should always be able to reinstall clean. Unless perhaps the storage has failed. Or the hardware itself has failed.
Is that actually your thread in serverfault?
Steve
-
@stephenw10 - yes, this is my Stack Overflow post.
It is as stated on the post - as I could not connect to it, then I unplugged the power. Since then it will not do a proper boot, and I suspect the filesystem has got corrupted.
I have imaged a bootable USB, but it will not boot that. Then I have tried a lot of various stuff, and some of it is documented in the SO post, but if anyone can suggest something I can try, then I will post the result here.
With a boot then I end up with this:
OK TIM-1.0 WTMI-devel-18.12.1-1a13f2f WTMI: system early-init SVC REV: 5, CPU VDD voltage: 1.237V NOTICE: Booting Trusted Firmware NOTICE: BL1: v1.5(release):1f8ca7e-dirty (Marvell-devel-18.12.2) NOTICE: BL1: Built : 18:22:47, Oct 7 2021 NOTICE: BL1: Booting BL2 NOTICE: BL2: v1.5(release):1f8ca7e-dirty (Marvell-devel-18.12.2) NOTICE: BL2: Built : 18:22:52, Oct 7 2021 NOTICE: BL1: Booting BL31 NOTICE: BL31: v1.5(release):1f8ca7e-dirty (Marvell-devel-18.12.2) NOTICE: BL31: Built : 18 U-Boot 2018.03-devel-18.12.3-gc9aa92c-dirty (Oct 07 2021 - 18:20:55 -0300) Model: Netgate 1100 CPU 1200 [MHz] L2 800 [MHz] TClock 200 [MHz] DDR 750 [MHz] DRAM: 1 GiB Comphy chip #0: Comphy-0: USB3 5 Gbps Comphy-1: PEX0 2.5 Gbps Comphy-2: SATA0 6 Gbps SATA link 0 timeout. AHCI 0001.0300 32 slots 1 ports 6 Gbps 0x1 impl SATA mode flags: ncq led only pmp fbss pio slum part sxs PCIE-0: Link down MMC: sdhci@d0000: 0, sdhci@d8000: 1 Loading Environment from SPI Flash... SF: Detected mx25u3235f with page size 256 Bytes, erase size 64 KiB, total 4 MiB OK Model: Netgate 1100 Net: eth0: neta@30000 [PRIME] Hit any key to stop autoboot: 0 Hit any key to stop autoboot: 0 Card did not respond to voltage select! 18022 armada-3720-netgate-1100.dtb 18022 armada-3720-sg1100.dtb 12944 armada-3720-netgate-2100.dtb 12944 armada-3720-sg2100.dtb 4 file(s), 0 dir(s) 845140 bytes read in 37 ms (21.8 MiB/s) 18022 bytes read in 13 ms (1.3 MiB/s) ## Starting EFI application at 07000000 ... Card did not respond to voltage select! Scanning disk sdhci@d0000.blk... Disk sdhci@d0000.blk not ready Scanning disk sdhci@d8000.blk... Found 4 disks Consoles: EFI console Reading loader env vars from /efi/freebsd/loader.env Setting currdev to disk0p2: FreeBSD/arm64 EFI loader, Revision 1.1 (Fri Apr 19 00:28:52 UTC 2024 root@freebsd) WTMI-devel-18.12.1-1a13f2f Command line arguments: loader.efi Image base: 0x7000000age: 1.237V EFI version: 2.70sted Firmware EFI Firmware: Das U-Boot (rev 0.00)rty (Marvell-devel-18.12.2) Console: efi,comconsole (0), Oct 7 2021 Load Path: /\armada-3720-sg1100.dtb Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/eMMC(1)/eMMC(0)/HD(2,GPT,0bf72bee-1c45-11ef-a845-9b51e061f96f,0x84000,0x20000) Trying ESP: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/eMMC(1)/eMMC(0)/HD(2,GPT,0bf72bee-1c45-11ef-a845-9b51e061f96f,0x84000,0x20000) Setting currdev to disk0p2: Trying: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/eMMC(1)/eMMC(0)/HD(1,GPT,0bf72bee-1c45-11ef-a845-9b51e061f96f,0x28,0x82000) Setting currdev to disk0p1: Trying: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/eMMC(1)/eMMC(0)/HD(3,GPT,0bf72bee-1c45-11ef-a845-9b51e061f96f,0xa4000,0xdea000) Setting currdev to zfs:pfSense/ROOT/default:(Oct 07 2021 - 18:20:55 -0300) efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 500 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 50 [MHz] ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 5 Gbps ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5ut. efipart_readwrite: rw=1, blk=2813232 size=32 status=7mode zio_read error: 5ly pmp fbss pio slum part sxs ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5nt from SPI Flash... SF: Detected mx25u3235f with page size 256 Bytes, erase size 64 KiB, total 4 MiB efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 500 ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5ond to voltage select! efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5a-3720-sg1100.dtb ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5pplication at 07000000 ... efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5ci@d0000.blk... ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 ZFS: i/o error - all block copies unavailable efipart_readwrite: rw=1, blk=11874600 size=32 status=7 zio_read error: 5 efipart_readwrite: rw=1, blk=2813232 size=32 status=7 zio_read error: 5 ZFS: i/o error - all block copies unavailable ERROR: cannot open /boot/lua/loader.lua: no such file or directory. Type '?' for a list of commands, 'help' for more detailed help. OKIdeally I would of course like to boot the USB, with the SG-1100 image downloaded from Netgate store, netgate-installer-v1.0-RC-aarch64-20240919-1435.img, and flashed with balenaEtcher - but it does not at all boot from the USB.
-
Hmm, so what happens if you try to boot USB in the normally way by entering
run usbrecoveryat the uboot prompt? -
@stephenw10 - good point, and this is what happens:
Marvell>> usb reset resetting USB... USB0: Register 2000104 NbrPorts 2 Starting the controller USB XHCI 1.00 USB1: USB EHCI 1.00 scanning bus 0 for devices... 2 USB Device(s) found scanning bus 1 for devices... 1 USB Device(s) found scanning usb for storage devices... 1 Storage Device(s) foundThen I run usbboot and I end up with this:
... [CUT] ... Mounting late filesystems:. nextboot: unlink /boot/nextboot.conf: Read-only file system Performing sanity check on nginx configuration: nginx: the configuration file /usr/local/etc/nginx/nginx.conf syntax is ok nginx: configuration file /usr/local/etc/nginx/nginx.conf test is successful Starting nginx. Generating RSA host key. 3072 SHA256:9BFkg65rpw247vXxBrxlIlDQZFXQf5mWB8Rhrt8CxFo root@pfSense-install (RSA) Generating ECDSA host key. 256 SHA256:NB2tF5FBvFzljGTWmQnwLBkhKDg6quEml+ATzBqcMDc root@pfSense-install (ECDSA) Generating ED25519 host key. 256 SHA256:KM3k+DSXyNWZ400A/FV/p7faGOwItrBxlzntI+ug3cQ root@pfSense-install (ED25519) Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Sep 19 15:49:29 UTC 2024 FreeBSD/arm64 (pfSense-install) (ttyu0) ZFS filesystem version: 5 ZFS storage pool version: features support (5000) mmcsd0: Error indicated: 1 Timeout sdhci_xenon1-slot0: Got AutoCMD12 error 0x0001, but there is no active command. sdhci_xenon1-slot0: ============== REGISTER DUMP ============== sdhci_xenon1-slot0: Sys addr: 0x08080800 | Version: 0x00000002 sdhci_xenon1-slot0: Blk size: 0x00007200 | Blk cnt: 0x00000004 sdhci_xenon1-slot0: Argument: 0x007b1548 | Trn mode: 0x00000037 sdhci_xenon1-slot0: Present: 0x01f20000 | Host ctl: 0x00000025 sdhci_xenon1-slot0: Power: 0x0000000f | Blk gap: 0x00000000 sdhci_xenon1-slot0: Wake-up: 0x00000000 | Clock: 0x00000407 sdhci_xenon1-slot0: Timeout: 0x0000000c | Int stat: 0x00000000 sdhci_xenon1-slot0: Int enab: 0x01ff003b | Sig enab: 0x01ff003b sdhci_xenon1-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000 sdhci_xenon1-slot0: Caps: 0x25ec0099 | Caps2: 0x0000af77 sdhci_xenon1-slot0: Max curr: 0x00000000 | ADMA err: 0x00000000 sdhci_xenon1-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000 sdhci_xenon1-slot0: =========================================== mmcsd0: Error indicated: 1 Timeout mmcsd0: Error indicated: 1 Timeout mmcsd0: Error indicated: 1 Timeout Solaris: WARNING: Pool '$import-ffff00009c45b640-pfSense' has encountered an uncorrectable I/O failure and has been suspended.If I instead run the run usbrecovery then it does this:
MMC erase: dev # 1, block # 0, count 4194304 ... 4194304 blocks erased: OK resetting USB... USB0: Register 2000104 NbrPorts 2 Starting the controller USB XHCI 1.00 USB1: USB EHCI 1.00 scanning bus 0 for devices... 2 USB Device(s) found scanning bus 1 for devices... >> FreeBSD EFI boot block Loader path: /boot/loader.efi Initializing modules: ZFS UFS Load Path: /\armada-3720-sg1100.dtb Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/USBClass(0,0,9,0,3)/USBClass(58f,6387,0,0,0)/HD(2,MBR,0x3426634a,0x64001,0x20000) Probing 5 block devices...not supported not supported not supported not supported better done ZFS found no pools UFS found 1 partition ... [some more but screen clears too fast for me to catch it] ...... and then it ends up the exact same place as the other command.
Is it the eMMC that has completely broken?
-
Yes, unfortunately that looks like a failed eMMC.
It is possible to install to and boot from a second USB drive from the Net Installer. You may want to try that.
-
@stephenw10 - I have now inserted a USB stick into the blue USB slot and the bootable USB in the other USB slot, but I don't get any option to select another target device. Also the documentation states:
During the installation process the installer will prompt to select a target drive. The installer will then write pfSense Plus to the chosen drive. The Netgate-1100 device only supports its internal storage for this purpose, which is mmcsd0.
Any hints on how that would be archieved?
-
You are using the aarch64 net installer image? That should offer you a drive choice even if eMMC is the only officially supported one.
-
@stephenw10 - I am using the image netgate-installer-aarch64.img.gz downloaded from the Netgate store not that long ago. This will give the IMG file of netgate-installer-v1.0-RC-aarch64-20240919-1435.img, which is what I have imaged to the USB.
-
Hmm, maybe try a different USB drive in the other slot then because I have tested installing to USB from that. Whilst it's a bit quirky it can work. I expect to see da1 offered as an install target.
-
@stephenw10 - I do not have much luck with this either it seems. This is from the two commands:
Marvell>> usb reset resetting USB... USB0: Register 2000104 NbrPorts 2 Starting the controller USB XHCI 1.00 USB1: USB EHCI 1.00 scanning bus 0 for devices... 2 USB Device(s) found scanning bus 1 for devices... EHCI timed out on TD - token=0x80008d80 USB device not accepting new address (error=22) 1 USB Device(s) found scanning usb for storage devices... 1 Storage Device(s) found Marvell>> run usbrecovery switch to partitions #0, OK mmc1(part 0) is current device MMC erase: dev # 1, block # 0, count 4194304 ... 4194304 blocks erased: OK resetting USB... USB0: Register 2000104 NbrPorts 2 Starting the controller USB XHCI 1.00 USB1: USB EHCI 1.00 scanning bus 0 for devices... 2 USB Device(s) found scanning bus 1 for devices... 2 USB Device(s) found scanning usb for storage devices... 2 Storage Device(s) found 17302 armada-3720-gti-doorkeeper.dtb 18022 armada-3720-netgate-1100.dtb 18022 armada-3720-sg1100.dtb 13733 armada-3720-netgate-2100.dtb 13733 armada-3720-sg2100.dtb 5 file(s), 0 dir(s) 2097152 bytes read in 139 ms (14.4 MiB/s) 18022 bytes read in 16 ms (1.1 MiB/s) ## Starting EFI application at 07000000 ... Card did not respond to voltage select! Scanning disk sdhci@d0000.blk... Disk sdhci@d0000.blk not ready Scanning disk sdhci@d8000.blk... Scanning disk usb_mass_storage.lun0... Scanning disk usb_mass_storage.lun0... Found 7 disks \onsoles: EFI console Reading loader env vars from /efi/freebsd/loader.env Setting currdev to disk1p3: FreeBSD/arm64 EFI loader, Revision 1.1 (Thu Sep 19 15:08:05 UTC 2024 root@freebsd) Command line arguments: loader.efi -S115200 -D Image base: 0x3b5f00d0 EFI version: 2.70 EFI Firmware: Das U-Boot (rev 0.00) Console: efi,comconsole (0x20000000) Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/USBClass(0,0,9,0,3)/USBClass(58f,6387,0,0,0)/HD(3,MBR,0x3426634a,0x84001,0x1fb110) Trying ESP: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/USBClass(0,0,9,0,3)/USBClass(58f,6387,0,0,0)/HD(3,MBR,0x3426634a,0x84001,0x1fb110) Setting currdev to disk1p3: / Loading /boot/defaults/loader.conf Loading /boot/defaults/loader.conf Loading /boot/device.hints Loading /boot/loader.conf Loading /boot/loader.conf.lua Loading /boot/loader.conf.local | >> FreeBSD EFI boot block Loader path: /boot/loader.efi Initializing modules: ZFS UFS Load Path: /\armada-3720-sg1100.dtb Load Device: /VenHw(e61d73b9-a384-4acc-aeab-82e828f3628b)/USBClass(0,0,9,0,3)/USBClass(58f,6387,0,0,0)/HD(2,MBR,0x3426634a,0x64001,0x20000) Probing 7 block devices...not supported not supported not supported not supported better not supported not supported done ZFS found no pools UFS found 1 partition command args: -S115200 -D _ __ / _|___ ___ _ __ ___ ___ _ | '_ \| |_/ __|/ _ \ '_ \/ __|/ _ \ _| |_ | |_) | _\__ \ __/ | | \__ \ __/ |_ _| | .__/|_| |___/\___|_| |_|___/\___| |_| |_| +---- Welcome to Netgate pfSense Plus ----+ __________________________ | | / ___\ | 1. Boot Multi user [Enter] | | /` | 2. Boot Single user | | / :-| | 3. Escape to loader prompt | | _________ ___/ /_ | | 4. Reboot | | /` ____ / /__ ___/ | | 5. Cons: Dual (Video primary) | | / / / / / / | | | | / /___/ / / / | | Options: | | / ______/ / / _ | | 6. Kernel: default/kernel (1 of 1) | |/ / / / _| |_ | | 7. Boot Options | / /___/ |_ _| | | | / |_| | | | /_________________________/ +-----------------------------------------+ / Autoboot in 0 seconds. [Space] to pause Loading kernel... /boot/kernel/kernel text=0x318 text=0xcbd8a8 text=0x14685c8 data=0x19cff0 data=0x0+0x2ca000 0x8+0x19d058+0x8+0x1b8d23/ Loading configured modules... can't find '/etc/hostid' can't find '/boot/entropy' Using DTB provided by EFI at 0x8000000. GDB: current port: uart KDB: debugger backends: ddb gdb KDB: current backend: ddb Copyright (c) 1992-2024 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 15.0-CURRENT #0 installer-RELENG_v1_0-n256387-33bc50df25b: Thu Sep 19 15:09:39 UTC 2024 root@freebsd:/var/jenkins/workspace/pfSense-installer-snapshots-v1_0-main/obj/aarch64/HST5KqyO/var/jenkins/workspace/pfSense-installer-snapshots-v1_0-main/sources/FreeBSD-src-installer-RELENG_v1_0/arm64.aarch64/sys/pfSense-Installer arm64 FreeBSD clang version 18.1.6 (https://github.com/llvm/llvm-project.git llvmorg-18.1.6-0-g1118c2e05e67) VT: init without driver. module scmi already present! real memory = 1073668096 (1023 MB) avail memory = 982249472 (936 MB) Starting CPU 1 (1) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs arc4random: WARNING: initial seeding bypassed the cryptographic random device because it was not yet seeded and the knob 'bypass_before_seeding' was enabled. ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (ipw_bss_fw, 0xffff000000265c9c, 0) error 1 ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffff000000265d54, 0) error 1 ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE. ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffff000000265e0c, 0) error 1 iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (iwi_bss_fw, 0xffff000000265ec4, 0) error 1 iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffff000000265f7c, 0) error 1 iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE. iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf. module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffff000000266034, 0) error 1 random: entropy device external interface wlan: mac acl policy registered kbd0 at kbdmux0 ofwbus0: <Open Firmware Device Tree> simplebus0: <Flattened device tree simple bus> on ofwbus0 simplebus1: <Flattened device tree simple bus> on simplebus0 ofw_firmware0: <OFW Firmware Group> on ofwbus0 simple_mfd0: <Simple MFD (Multi-Functions Device)> mem 0x13800-0x138ff,0x13c00-0x13c1f on simplebus1 simple_mfd1: <Simple MFD (Multi-Functions Device)> mem 0x18800-0x188ff,0x18c00-0x18c1f on simplebus1 psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0 netgate0: <Netgate 1100> gic0: <ARM Generic Interrupt Controller v3.0> mem 0x1d00000-0x1d0ffff,0x1d40000-0x1d7ffff,0x1d80000-0x1d81fff,0x1d90000-0x1d91fff,0x1da0000-0x1dbffff irq 28 on simplebus1 gpio0: <Armada 37x0 North Bridge GPIO Controller> mem 0x13800-0x138ff,0x13c00-0x13c1f irq 29,30,31,32,33,34,35,36,37,38,39,40 on simple_mfd0 gpiobus0: <OFW GPIO bus> on gpio0 gpio1: <Armada 37x0 South Bridge GPIO Controller> mem 0x18800-0x188ff,0x18c00-0x18c1f irq 41,42,43,44,45 on simple_mfd1 gpiobus1: <OFW GPIO bus> on gpio1 gpioregulator0: <GPIO controlled regulator> on ofwbus0 a37x0-xtal0: <Marvell Armada 3700 Oscillator> mem 0x13800-0x138ff,0x13c00-0x13c1f on simple_mfd0 generic_timer0: <ARMv8 Generic Timer> irq 0,1,2,3 on ofwbus0 Timecounter "ARM MPCore Timecounter" frequency 12500000 Hz quality 1000 Event timer "ARM MPCore Eventtimer" frequency 12500000 Hz quality 1000 a37x0_tbg0: <Marvell Armada 3700 time base generators> mem 0x13200-0x132ff on simplebus1 a37x0_nb_periph_driver0: <marvell,armada-3700-nb-periph-clock> mem 0x13000-0x130ff on simplebus1 a37x0_sb_periph_driver0: <marvell,armada-3700-sb-periph-clock> mem 0x18000-0x180ff on simplebus1 cpulist0: <Open Firmware CPU Group> on ofwbus0 cpu0: <Open Firmware CPU> on cpulist0 pmu0: <Performance Monitoring Unit> irq 4 on ofwbus0 spi0: <Armada 37x0 SPI controller> mem 0x10600-0x10fff irq 6 on simplebus1 iichb0: <Marvell Armada 37x0 IIC controller> mem 0x11000-0x11023 irq 7 on simplebus1 iicbus0: <OFW I2C bus> on iichb0 iic0: <I2C generic I/O> on iicbus0 uart0: <Marvell Armada 3700 UART> mem 0x12000-0x12017 irq 9,10,11 on simplebus1 uart0: console (115200,n,8,1) gpioc0: <GPIO controller> on gpio0 gpioc1: <GPIO controller> on gpio1 mvneta0: <NETA controller> mem 0x30000-0x33fff irq 14 on simplebus1 mvneta0: version is 10 mdio0: <MDIO> on mvneta0 mdioproxy0: <MII/MDIO proxy, MDIO side> on mdio0 e6000sw0: <Marvell 88E6341> on mdio0 e6000sw0: multi-chip addressing mode (0x1) e6000sw0: CPU port at 0 e6000sw0: fixed port at 0 e6000sw0: PHY at port 1 miibus0: <MII bus> on e6000sw0 e1000phy0: <Marvell 88E1000 Gigabit PHY> PHY 17 on miibus0 e1000phy0: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto e6000sw0: PHY at port 2 miibus1: <MII bus> on e6000sw0 e1000phy1: <Marvell 88E1000 Gigabit PHY> PHY 18 on miibus1 e1000phy1: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto e6000sw0: PHY at port 3 miibus2: <MII bus> on e6000sw0 e1000phy2: <Marvell 88E1000 Gigabit PHY> PHY 19 on miibus2 e1000phy2: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto e6000sw0: switch is ready. etherswitch0: <Switch controller> on e6000sw0 mvneta0: Ethernet address: f0:ad:4e:08:6e:f1 xhci0: <Generic USB 3.0 controller> mem 0x58000-0x5bfff irq 16 on simplebus1 xhci0: 32 bytes context size, 32-bit DMA usbus0 on xhci0 ehci0: <Marvell Integrated USB 2.0 controller> mem 0x5e000-0x5efff irq 17 on simplebus1 usbus1: EHCI version 1.0 usbus1 on ehci0 sdhci_xenon0: <Armada Xenon SDHCI controller> mem 0xd0000-0xd02ff,0x1e808-0x1e80b irq 25 on simplebus1 sdhci_xenon1: <Armada Xenon SDHCI controller> mem 0xd8000-0xd82ff,0x17808-0x1780b irq 26 on simplebus1 mmc0: <MMC/SD bus> on sdhci_xenon1 ahci0: <AHCI SATA controller> mem 0xe0000-0xe0177 irq 27 on simplebus1 ahci0: AHCI v1.30 with 1 6Gbps ports, Port Multiplier supported with FBS ahcich0: <AHCI channel> at channel 0 on ahci0 device_attach: ahcich0 attach returned 6 pcib0: <Marvell Armada 3700 PCIe Bus Controller> mem 0xd0070000-0xd008ffff irq 5 on simplebus0 pcib0: link never came up pci0: <OFW PCI bus> on pcib0 gpioled0: <GPIO LEDs> on ofwbus0 armv8crypto0: <AES-CBC,AES-XTS,AES-GCM> Timecounters tick every 1.000 msec mvneta0: link state changed to UP spibus0: <OFW SPI bus> on spi0 mx25l0: <M25Pxx Flash Family> at cs 0 mode 0 on spibus0 mx25l0: device type mx25u3235f, size 4096K in 64 sectors of 64K, erase size 4K usbus0: 5.0Gbps Super Speed USB v3.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: <Generic XHCI root HUB> at usbus0 uhub0 on usbus0 uhub0: <Generic XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen1.1: <Marvell EHCI root HUB> at usbus1 uhub1 on usbus1 uhub1: <Marvell EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1 mmc0: Failed to set VCCQ for card at relative address 2 mmcsd0: 8GB <MMCHC SEM08G 3.10 SN B1C929AD MFG 04/2017 by 69 0x0000> at mmc0 50.0MHz/8bit/65535-block mmcsd0boot0: 2MB partition 1 at mmcsd0 mmcsd0boot1: 2MB partition 2 at mmcsd0 mmcsd0rpmb: 2MB partition 3 at mmcsd0 Trying to mount root from ufs:/dev/ufs/pfSense_Install [ro,noatime]... CPU 0: ARM Cortex-A53 r0p4 affinity: 0 Cache Type = <64 byte D-cacheline,64 byte I-cacheline,VIPT ICache,64 byte ERG,64 byte CWG> Instruction Set Attributes 0 = <CRC32,SHA2,SHA1,AES+PMULL> Instruction Set Attributes 1 = <> Instruction Set Attributes 2 = <> Processor Features 0 = <GIC,AdvSIMD,FP,EL3 32,EL2 32,EL1 32,EL0 32> Processor Features 1 = <> Processor Features 2 = <> Memory Model Features 0 = <TGran4,TGran64,SNSMem,BigEnd,16bit ASID,1TB PA> Memory Model Features 1 = <8bit VMID> Memory Model Features 2 = <32bit CCIDX,48bit VA> Memory Model Features 3 = <> Memory Model Features 4 = <> Debug Features 0 = <DoubleLock,2 CTX BKPTs,4 Watchpoints,6 Breakpoints,PMUv3,Debugv8> Debug Features 1 = <> Auxiliary Features 0 = <> Auxiliary Features 1 = <> AArch32 Instruction Set Attributes 5 = <CRC32,SHA2,SHA1,AES+VMULL,SEVL> AArch32 Media and VFP Features 0 = <FPRound,FPSqrt,FPDivide,DP VFPv3+v4,SP VFPv3+v4,AdvSIMD> AArch32 Media and VFP Features 1 = <SIMDFMAC,FPHP DP Conv,SIMDHP SP Conv,SIMDSP,SIMDInt,SIMDLS,FPDNaN,FPFtZ> CPU 1: ARM Cortex-A53 r0p4 affinity: 1 gic0: using for IPIs Release APs...done TCP_ratelimit: Is now initialized GEOM: mmcsd0: the primary GPT table is corrupt or invalid. GEOM: mmcsd0: using the secondary instead -- recovery strongly advised. uhub0: 2 ports with 2 removable, self powered uhub1: 1 port with 1 removable, self powered ugen0.2: <Generic Mass Storage> at usbus0 umass0 on uhub0 umass0: <Generic Mass Storage, class 0/0, rev 2.00/1.03, addr 1> on usbus0 da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 da0: <USB Flash Disk 8.07> Removable Direct Access SPC-2 SCSI device da0: Serial Number 9376A8A2 da0: 40.000MB/s transfers da0: 1920MB (3932160 512 byte sectors) da0: quirks=0x2<NO_6_BYTE> e6000sw0port1: link state changed to DOWN e6000sw0port2: link state changed to DOWN e6000sw0port3: link state changed to DOWN Root mount waiting for: usbus1 Root mount waiting for: usbus1 Root mount waiting for: usbus1 Root mount waiting for: usbus1 Root mount waiting for: usbus1 Root mount waiting for: usbus1 ugen1.2: <Verbatim STORE N GO> at usbus1 Warning: no time-of-day clock registered, system time will not be set accurately Dual Console: Video Primary, Serial Secondary No suitable dump device was found. Starting file system checks: /dev/ufs/pfSense_Install: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ufs/pfSense_Install: clean, 27475 free (35 frags, 3430 blocks, 0.0% fragmentation) Mounting local filesystems:. hw.bus.devctl_nomatch_enabled: 1 -> 1 random: unblocking device. Setting up harvesting: [CALLOUT],[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . Setting hostname: pfSense-install. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat/pkg 32-bit compatibility ldconfig path: lo0: link state changed to UP Starting Network: lo0 mvneta0 enc0. lo0: flags=1008049<UP,LOOPBACK,RUNNING,MULTICAST,LOWER_UP> metric 0 mtu 16384 options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7 groups: lo nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> mvneta0: flags=1008a02<BROADCAST,ALLMULTI,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500 options=bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM> ether f0:ad:4e:08:6e:f1 media: Ethernet 1000baseT <full-duplex> status: active nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> enc0: flags=0 metric 0 mtu 1536 options=0 groups: enc nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> Starting devd. Starting Network: mvneta0. mvneta0: flags=1008a02<BROADCAST,ALLMULTI,SIMPLEX,MULTICAST,LOWER_UP> metric 0 mtu 1500 options=bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM> ether f0:ad:4e:08:6e:f1 media: Ethernet 1000baseT <full-duplex> status: active nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> Starting Network: enc0. enc0: flags=0 metric 0 mtu 1536 options=0 groups: enc nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> route: message indicates error: File exists add host 127.0.0.1: gateway lo0 fib 0: route already in table Additional inet routing options: gateway=YES. route: message indicates error: File exists add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Updating /var/run/os-release done. Creating and/or trimming log files. Clearing /tmp (X related). Starting syslogd. Starting local daemons:/dev/md3: 8.0MB (16384 sectors) block size 32768, fragment size 4096 using 4 cylinder groups of 2.03MB, 65 blks, 384 inodes. with soft updates super-block backups (for fsck_ffs -b #) at: 192, 4352, 8512, 12672 Creating the certificate key... Creating the nginx self-signed certificate... . Mounting late filesystems:. nextboot: unlink /boot/nextboot.conf: Read-only file system Performing sanity check on nginx configuration: nginx: the configuration file /usr/local/etc/nginx/nginx.conf syntax is ok nginx: configuration file /usr/local/etc/nginx/nginx.conf test is successful Starting nginx. Generating RSA host key. 3072 SHA256:Huw3RXRaqc5v9wz/poyu9Zs+oXib++9KdnSo+Escm84 root@pfSense-install (RSA) Generating ECDSA host key. 256 SHA256:zANJe3rOjMvW23hRRR5Pw4X1L2ZZtRo4M6MN7zxTRoI root@pfSense-install (ECDSA) Generating ED25519 host key. 256 SHA256:ODRVcVwXHT0OvRrUV3nyaggnPEyJd3KRD7owHt8Szik root@pfSense-install (ED25519) Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Sep 19 15:49:31 UTC 2024 FreeBSD/arm64 (pfSense-install) (ttyu0) ZFS filesystem version: 5 ZFS storage pool version: features support (5000) mmcsd0: Error indicated: 1 Timeout sdhci_xenon1-slot0: Got AutoCMD12 error 0x0001, but there is no active command. sdhci_xenon1-slot0: ============== REGISTER DUMP ============== sdhci_xenon1-slot0: Sys addr: 0x08080800 | Version: 0x00000002 sdhci_xenon1-slot0: Blk size: 0x00007200 | Blk cnt: 0x00000004 sdhci_xenon1-slot0: Argument: 0x007b1548 | Trn mode: 0x00000037 sdhci_xenon1-slot0: Present: 0x01f20000 | Host ctl: 0x00000025 sdhci_xenon1-slot0: Power: 0x0000000f | Blk gap: 0x00000000 sdhci_xenon1-slot0: Wake-up: 0x00000000 | Clock: 0x00000407 sdhci_xenon1-slot0: Timeout: 0x0000000c | Int stat: 0x00000000 sdhci_xenon1-slot0: Int enab: 0x01ff003b | Sig enab: 0x01ff003b sdhci_xenon1-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000 sdhci_xenon1-slot0: Caps: 0x25ec0099 | Caps2: 0x0000af77 sdhci_xenon1-slot0: Max curr: 0x00000000 | ADMA err: 0x00000000 sdhci_xenon1-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000 sdhci_xenon1-slot0: =========================================== mmcsd0: Error indicated: 1 Timeout mmcsd0: Error indicated: 1 Timeout mmcsd0: Error indicated: 1 Timeout Solaris: WARNING: Pool '$import-ffff000099168000-pfSense' has encountered an uncorrectable I/O failure and has been suspended.In the above then I find these things of interest:
GEOM: mmcsd0: the primary GPT table is corrupt or invalid. GEOM: mmcsd0: using the secondary instead -- recovery strongly advised.So it seems to recognize there is a secondary option. Also, da0 is recognized:
da0 at umass-sim0 bus 0 scbus0 target 0 lun 0 da0: <USB Flash Disk 8.07> Removable Direct Access SPC-2 SCSI device da0: Serial Number 9376A8A2 da0: 40.000MB/s transfers da0: 1920MB (3932160 512 byte sectors) da0: quirks=0x2<NO_6_BYTE>But I am not at all presented with any choice to install anywhere else.
I have tried with all the USB sticks I have, with various formats and types. I don't have a real USB harddisk, but I would expect that if I can create a bootable USB that Netgate can use, then it should also work for this, right?
Is it important if the USB stick is formatted or all partitions deleted (though I have tried both)?
I am running out of options it seems :-/
-
Just to show an error I also get, depending on the USB then I can also get this error:
Marvell>> usb reset resetting USB... USB0: Register 2000104 NbrPorts 2 Starting the controller USB XHCI 1.00 USB1: USB EHCI 1.00 scanning bus 0 for devices... Device NOT ready Request Sense returned 02 3A 00 Device NOT ready Request Sense returned 02 3A 00 Device NOT ready Request Sense returned 02 3A 00 2 USB Device(s) found scanning bus 1 for devices... EHCI timed out on TD - token=0x80008d80 USB device not accepting new address (error=22) 1 USB Device(s) found scanning usb for storage devices... 4 Storage Device(s) found Marvell>> run usbrecovery switch to partitions #0, OK mmc1(part 0) is current device MMC erase: dev # 1, block # 0, count 4194304 ... 4194304 blocks erased: OK resetting USB... USB0: Register 2000104 NbrPorts 2 Starting the controller USB XHCI 1.00 USB1: USB EHCI 1.00 scanning bus 0 for devices... Device NOT ready Request Sense returned 02 3A 00 Device NOT ready Request Sense returned 02 3A 00 Device NOT ready Request Sense returned 02 3A 00 2 USB Device(s) found scanning bus 1 for devices... EHCI timed out on TD - token=0x80008d80 USB device not accepting new address (error=22) 1 USB Device(s) found scanning usb for storage devices... 4 Storage Device(s) found ** Bad device size - usb 0 ** Marvell>>However, this is when using a card reader in between - a card reader that can take several USB types and CF cards, but when using this, it will always come with this error. So, I expect this reader/writer is not compatible or alike - not sure, but I would expect my real USB sticks would be fine (ranging from 2GB to 32GB).
-
Oh, yes be sure to use the USB drive directly. I've never managed to get it to work correctly via any sort of adapter.
You may also need to fully power cycle it to reset the USB controller after seeing error like that.
You should see both da0 and da1 in the boot logs when both drives are correctly detected.
-
@stephenw10 - can you tell what kind of USB stick you have used, and in which USB port it was located in (I expect blue, as this must be USB3?)? Maybe I can replicate that?
-
When I did it I used a USB2 drive in the USB2 slot because when both drives are present it tries to boot from the USB3 slot first. You should be able to move it afterwards.
It should at least recognise both drives in the boot messages if it is booting.
Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.