Upgrade appeared successful - but SG-1100 router is not working

[rolihlahla]

I upgraded my SG-1100 via the web gui yesterday from 2.5 to 21.02_1. I had the wan,lan and opt interfaces all configured working properly for several months. The upgrade appeared successful, and got to a point where it stated it was rebooting the appliance. However, it never rebooted or came back online. When I manually rebooted - I was unable to connect to the appliance via the web gui. I did manage to connect via putty to the console. However, when connecting this way, I am not presented with any menu options. Just a prompt '#' and whoami states I am the root user.

I read through the troubleshooting guide for upgrades and this appears unique. I'm not sure what to do. There was a suggestion to reinstall from scratch - but I do not have the official netgate software. I could use the community edition if necessary. Not a newbie to linux - but am relatively new to firewall configuration. Any suggestions/help greatly appreciated.

Boot output below:

FreeBSD EFI boot block
Loader path: /boot/loader.efi

Initializing modules: ZFS UFS
Probing 4 block devices......* done
ZFS found no pools
UFS found 1 partition
command args: -S115200

Consoles: EFI console
Reading loader env vars from /efi/freebsd/loader.env
Setting currdev to disk0p3:
FreeBSD/arm64 EFI loader, Revision 1.1

Command line arguments: loader.efi -S115200
EFI version: 2.05
EFI Firmware: Das U-boot (rev 0.00)
Console: efi (0)
Load Path: mmc_blk1:3
Load Device: mmc_blk1:3
Trying ESP: mmc_blk1:3
Setting currdev to disk0p3:
Loading /boot/defaults/loader.conf
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
Loading /boot/loader.conf
Loading /boot/loader.conf.local
\

•      __
  

  _ __ / |__ ___ _ __ ___ ___ _
  | '_ | |/ _|/ _ \ ' / __|/ _ \ | |
  | |) | _ \ / | | _ \ / | _|
  | ./|| |/_|| ||/_| ||
  |_|

╔═════Welcome to Netgate pfSense Plus═════╗ __________________________
║ ║ /
║ 1. Boot Multi user [Enter] ║ | / ║ 2. Boot Single user ║ | / :-| ║ 3. Escape to loader prompt ║ | _________ ___/ /_ | ║ 4. Reboot ║ | / ____ / / / |
║ 5. Cons: Serial ║ | / / / / / / |
║ ║ | / // / / / |
║ Options: ║ | / / / / _ |
║ 6. Kernel: default/kernel (1 of 2) ║ |/ / / / | | |
║ 7. Boot Options ║ / // | | |
║ ║ / || |
║ ║ /______________________/
╚═════════════════════════════════════════╝
Autoboot in 0 seconds, hit [Enter] to boot or any other key to stop

Loading kernel...
/boot/kernel/kernel text=0xc0eacc data=0x12e8920 data=0x0+0x2d587e syms=[0x8+0x17bda0+0x8+0x14317b]
Loading configured modules...
can't find '/boot/entropy'
can't find '/etc/hostid'
Using DTB provided by EFI at 0x8000000.
---<<BOOT>>---
Copyright (c) 1992-2020 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.2-STABLE 0e42b7d7eac(HEAD) pfSense arm64
FreeBSD clang version 10.0.1 (git@github.com:llvm/llvm-project.git llvmorg-10.0.1-0-gef32c611aa2)
VT: init without driver.
real memory = 1073733632 (1023 MB)
avail memory = 1006710784 (960 MB)
Starting CPU 1 (1)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
arc4random: no preloaded entropy cache
random: entropy device external interface
wlan: mac acl policy registered
ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_bss_fw, 0xffff000000221c14, 0) error 1
ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffff000000221cc0, 0) error 1
ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffff000000221d6c, 0) error 1
iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_bss_fw, 0xffff000000221e18, 0) error 1
iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffff000000221ec4, 0) error 1
iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffff000000221f70, 0) error 1
MAP 3e700000 mode 2 pages 1
MAP 3ffa6000 mode 2 pages 1
[ath_hal] loaded
kbd0 at kbdmux0
ofwbus0: <Open Firmware Device Tree>
simplebus0: <Flattened device tree simple bus> on ofwbus0
simplebus1: <Flattened device tree simple bus> on simplebus0
simple_mfd0: <Simple MFD (Multi-Functions Device)> mem 0x13800-0x138ff,0x13c00-0x13c1f on simplebus1
simple_mfd1: <Simple MFD (Multi-Functions Device)> mem 0x18800-0x188ff,0x18c00-0x18c1f on simplebus1
psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0
gic0: <ARM Generic Interrupt Controller v3.0> mem 0x1d00000-0x1d0ffff,0x1d40000-0x1d7ffff,0x1d80000-0x1d81fff,0x1d90000-0x1d91fff,0x1da0000-0x1dbffff irq 27 on simplebus1
gpio0: <Armada 37x0 North Bridge GPIO Controller> mem 0x13800-0x138ff,0x13c00-0x13c1f irq 28,29,30,31,32,33,34,35,36,37,38,39 on simple_mfd0
gpiobus0: <OFW GPIO bus> on gpio0
gpio1: <Armada 37x0 South Bridge GPIO Controller> mem 0x18800-0x188ff,0x18c00-0x18c1f irq 40,41,42,43,44 on simple_mfd1
gpiobus1: <OFW GPIO bus> on gpio1
gpioregulator0: <GPIO controlled regulator> on ofwbus0
generic_timer0: <ARMv8 Generic Timer> irq 0,1,2,3 on ofwbus0
Timecounter "ARM MPCore Timecounter" frequency 12500000 Hz quality 1000
Event timer "ARM MPCore Eventtimer" frequency 12500000 Hz quality 1000
cpulist0: <Open Firmware CPU Group> on ofwbus0
cpu0: <Open Firmware CPU> on cpulist0
cpu1: <Open Firmware CPU> on cpulist0
pmu0: <Performance Monitoring Unit> irq 4 on ofwbus0
spi0: <Armada 37x0 SPI controller> mem 0x10600-0x10fff irq 6 on simplebus1
iichb0: <Marvell Armada 37x0 IIC controller> mem 0x11000-0x11023 irq 7 on simplebus1
iicbus0: <OFW I2C bus> on iichb0
iic0: <I2C generic I/O> on iicbus0
uart0: <Marvell Armada 3700 UART> mem 0x12000-0x121ff irq 9,10,11 on simplebus1
uart0: console (115200,n,8,1)
gpioc0: <GPIO controller> on gpio0
syscon_generic_dev0: <syscon> mem 0x14000-0x1405f on simplebus1
gpioc1: <GPIO controller> on gpio1
mvneta0: <NETA controller> mem 0x30000-0x33fff irq 14 on simplebus1
mvneta0: version is 10
mvneta0: Ethernet address: f0:ad:4e:17:6d:94
mdio0: <MDIO> on mvneta0
e6000sw0: <Marvell 88E6341> on mdio0
e6000sw0: multi-chip addressing mode (0x1)
e6000sw0: CPU port at 0
e6000sw0: fixed port at 0
e6000sw0: PHY at port 1
miibus0: <MII bus> on e6000sw0
e1000phy0: <Marvell 88E1000 Gigabit PHY> PHY 17 on miibus0
e1000phy0: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto
e6000sw0: PHY at port 2
miibus1: <MII bus> on e6000sw0
e1000phy1: <Marvell 88E1000 Gigabit PHY> PHY 18 on miibus1
e1000phy1: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto
e6000sw0: PHY at port 3
miibus2: <MII bus> on e6000sw0
e1000phy2: <Marvell 88E1000 Gigabit PHY> PHY 19 on miibus2
e1000phy2: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto
e6000sw0: switch is ready.
etherswitch0: <Switch controller> on e6000sw0
xhci0: <Marvell Integrated USB 3.0 controller> mem 0x58000-0x5bfff irq 16 on simplebus1
xhci0: 32 bytes context size, 32-bit DMA
usbus0 on xhci0
ehci0: <Marvell Integrated USB 2.0 controller> mem 0x5e000-0x5ffff irq 17 on simplebus1
usbus1: EHCI version 1.0
usbus1 on ehci0
sdhci_xenon0: <Armada Xenon SDHCI controller> mem 0xd0000-0xd02ff,0x1e808-0x1e80b irq 24 on simplebus1
mmc0: <MMC/SD bus> on sdhci_xenon0
sdhci_xenon1: <Armada Xenon SDHCI controller> mem 0xd8000-0xd82ff,0x17808-0x1780b irq 25 on simplebus1
mmc1: <MMC/SD bus> on sdhci_xenon1
ahci0: <AHCI SATA controller> mem 0xe0000-0xe1fff irq 26 on simplebus1
ahci0: AHCI v1.30 with 1 6Gbps ports, Port Multiplier supported with FBS
ahcich0: <AHCI channel> at channel 0 on ahci0
pcib0: <Marvell Armada 3700 PCIe Bus Controller> mem 0xd0070000-0xd008ffff irq 5 on simplebus0
pcib0: link never came up
pci0: <PCI bus> on pcib0
gpioled0: <GPIO LEDs> on ofwbus0
cryptosoft0: <software crypto>
armv8crypto0: <AES-CBC>
Timecounters tick every 1.000 msec
mvneta0: link state changed to UP
spibus0: <OFW SPI bus> on spi0
mx25l0: <M25Pxx Flash Family> at cs 0 mode 0 on spibus0
mx25l0: device type mx25u3235f, size 4096K in 64 sectors of 64K, erase size 4K
e6000sw0port1: link state changed to DOWN
e6000sw0port2: link state changed to DOWN
e6000sw0port3: link state changed to DOWN
usbus0: 5.0Gbps Super Speed USB v3.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Marvell XHCI root HUB> at usbus0
uhub0: <Marvell XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <Marvell EHCI root HUB> at usbus1
uhub1: <Marvell EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
mmc0: No compatible cards found on bus
uhub0: 2 ports with 2 removable, self powered
mmc1: Failed to set VCCQ for card at relative address 2
mmcsd0: 8GB <MMCHC DG4008 0.1 SN D90C0217 MFG 08/2020 by 69 0x0000> at mmc1 50.0MHz/8bit/65535-block
mmcsd0boot0: 4MB partition 1 at mmcsd0
mmcsd0boot1: 4MB partition 2 at mmcsd0
mmcsd0rpmb: 4MB partition 3 at mmcsd0
Release APs...arc4random: no preloaded entropy cache
done
Trying to mount root from ufs:/dev/ufsid/5f60d5420316127a [rw,noatime]...
CPU 0: ARM Cortex-A53 r0p4 affinity: 0
Instruction Set Attributes 0 = <CRC32,SHA2,SHA1,AES+PMULL>
Instruction Set Attributes 1 = <>
Processor Features 0 = <GIC,AdvSIMD,Float,EL3 32,EL2 32,EL1 32,EL0 32>
Processor Features 1 = <0>
Memory Model Features 0 = <4k Granule,64k Granule,S/NS Mem,MixedEndian,16bit ASID,1TB PA>
Memory Model Features 1 = <>
Memory Model Features 2 = <32b CCIDX,48b VA>
Debug Features 0 = <2 CTX Breakpoints,4 Watchpoints,6 Breakpoints,PMUv3,Debug v8>
Debug Features 1 = <0>
Auxiliary Features 0 = <0>
Auxiliary Features 1 = <0>
CPU 1: ARM Cortex-A53 r0p4 affinity: 1
Warning: no time-of-day clock registered, system time will not be set accurately
uhub1: 1 port with 1 removable, self powered
Configuring crash dumps...
No suitable dump device was found.
/dev/ufsid/5f60d5420316127a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ufsid/5f60d5420316127a: clean, 1444284 free (2996 frags, 180161 blocks, 0.2% fragmentation)
Filesystems are clean, continuing...
Mounting filesystems...
random: read_random_uio unblock wait
random: unblocking device.

    __

_ __ / |__ ___ _ __ ___ ___ _
| '_ | |/ _|/ _ \ ' / __|/ _ \ | |
| |) | _ \ / | | _ \ / | _|
| ./|| |/_|| ||/_| ||
|_|

Welcome to Netgate pfSense Plus 21.02-RELEASE (Patch 1)...

...ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/lib/engines /usr/local/lib/compat/pkg /usr/local/lib/perl5/5.32/mach/CORE
done.
/usr/local/libexec/pfSense-upgrade: /usr/local/bin/ping-auth.sh: Exec format error
External config loader 1.0 is now starting... mmcsd0s1 mmcsd0s2 mmcsd0s3
Launching the init system...
Warning: PHP Startup: Unable to load dynamic library 'pfSense.so' (tried: /usr/local/lib/php/20190902/pfSense.so (/usr/local/lib/ipsec/libvici.so.0: Undefined symbol "chunk_empty"), /usr/local/lib/php/20190902/pfSense.so.so (/usr/local/lib/php/20190902/pfSense.so.so: invalid file format)) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'ldap.so' (tried: /usr/local/lib/php/20190902/ldap.so (Shared object "libldap-2.4.so.2" not found, required by "ldap.so"), /usr/local/lib/php/20190902/ldap.so.so (/usr/local/lib/php/20190902/ldap.so.so: invalid file format)) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'pfSense.so' (tried: /usr/local/lib/php/20190902/pfSense.so (/usr/local/lib/ipsec/libvici.so.0: Undefined symbol "chunk_empty"), /usr/local/lib/php/20190902/pfSense.so.so (/usr/local/lib/php/20190902/pfSense.so.so: invalid file format)) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'sqlite3.so' (tried: /usr/local/lib/php/20190902/sqlite3.so (Shared object "libsqlite3.so.0" not found, required by "sqlite3.so"), /usr/local/lib/php/20190902/sqlite3.so.so (/usr/local/lib/php/20190902/sqlite3.so.so: invalid file format)) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'zmq.so' (tried: /usr/local/lib/php/20190902/zmq.so (Shared object "libzmq.so.5" not found, required by "zmq.so"), /usr/local/lib/php/20190902/zmq.so.so (/usr/local/lib/php/20190902/zmq.so.so: invalid file format)) in Unknown on line 0

Warning: PHP Startup: Unable to load dynamic library 'pdo_sqlite.so' (tried: /usr/local/lib/php/20190902/pdo_sqlite.so (Shared object "libsqlite3.so.0" not found, required by "pdo_sqlite.so"), /usr/local/lib/php/20190902/pdo_sqlite.so.so (/usr/local/lib/php/20190902/pdo_sqlite.so.so: invalid file format)) in Unknown on line 0
....PHP ERROR: Type: 64, File: /etc/inc/captiveportal.inc, Line: 30, Message: require_once(): Failed opening required 'PEAR.php' (include_path='.:/etc/inc:/etc/inc/web:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg:/usr/local/www/classes:/usr/local/www/classes/Form:/usr/local/share/pear:/usr/local/share/openssl_x509_crl/')Starting CRON... done.
/usr/local/libexec/pfSense-upgrade: /usr/local/bin/ping-auth.sh: Exec format error
2021-04-04T23:08:53.240693-04:00 php-fpm 362 - - /rc.start_packages: PHP ERROR: Type: 64, File: /etc/inc/captiveportal.inc, Line: 30, Message: require_once(): Failed opening required 'PEAR.php' (include_path='.:/etc/inc:/etc/inc/web:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg:/usr/local/www/classes:/usr/local/www/classes/Form:/usr/local/share/pear:/usr/local/share/openssl_x509_crl/')
2021-04-04T23:08:53.277329-04:00 php-fpm 362 - - /rc.start_packages: New alert found: PHP ERROR: Type: 64, File: /etc/inc/captiveportal.inc, Line: 30, Message: require_once(): Failed opening required 'PEAR.php' (include_path='.:/etc/inc:/etc/inc/web:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg:/usr/local/www/classes:/usr/local/www/classes/Form:/usr/local/share/pear:/usr/local/share/openssl_x509_crl/')
PHP ERROR: Type: 64, File: /etc/inc/captiveportal.inc, Line: 30, Message: require_once(): Failed opening required 'PEAR.php' (include_path='.:/etc/inc:/etc/inc/web:/usr/local/www:/usr/local/captiveportal:/usr/local/pkg:/usr/local/www/classes:/usr/local/www/classes/Form:/usr/local/share/pear:/usr/local/share/openssl_x509_crl/')Netgate pfSense Plus 21.02-RELEASE (Patch 1) arm64 Mon Feb 22 09:37:39 EST 2021
Bootup complete

FreeBSD/arm64 (Amnesiac) (ttyu0)

[SteveITS]

@rolihlahla said in Upgrade appeared successful - but SG-1100 router is not working:

However, it never rebooted or came back online

Did you wait 10-30 minutes?

[rolihlahla]

@steveits Yes - I waited several hours yesterday evening - and did not try to login to the console until this morning.

I would be interested in knowing how to reset it - I have the old config file saved.

[SteveITS]

I sent my earlier response on the way out the door without reading closely. I'd expect the most straightforward method is to ask Netgate for a copy of the firmware and install it from scratch. You don't need a support subscription for that. Given all the PHP errors it sounds like it only partially updated, or similar.

The update (any of them) is not fast, though it depends on CPU and disk write speed. The counter starts at 90 seconds but in my experience on 2100 and faster hardware I'd allow 15 minutes before even starting to think about worrying.

[rolihlahla]

@steveits Thanks. Just did that and was able to reinstall and load my config file and am now sorted.