After upgrade 24.03 to 24.11 reboot hangs at start @ 0xffffff....

GripePotato · Dec 14, 2024, 7:04 PM

This thread indicates two types of devices experience problems:

Pfsense on VM
4200 MAX

The VM folks got a solution/recommendation of attaching a serial port to the VM. Is there a recommendation for the 4200 MAX other than trying again? I've tried a couple times already, both resulting in failure.

stephenw10 · Dec 16, 2024, 12:29 PM

Still unable to replicate this locally.

Is there anything about those devices that might be unique? Perhaps you made a BIOS setting change? Have something unusual connected to it?

jackyaz · Dec 16, 2024, 12:31 PM

@stephenw10 No BIOS changes on my side, never even been into the BIOS!

I do have a USB cable plugged into the USB A port on the side but the other end is disconnected - I'll occasionally need to use my phone as a USB tethering modem when my fibre drops out. I can try unplugging it to see if that makes a difference? I'd be surprised if it does considering its not connected to anything!

stephenw10 · Dec 16, 2024, 12:41 PM

Mmm, me too. It certainly shouldn't make any difference. Might be worth trying to rule it out though.

GripePotato · Dec 16, 2024, 5:47 PM

@stephenw10
My 4200 MAX is off the shelf with no special (e.g. BIOS) changes and nothing unusual (e.g. USB) plugged in.

jimp · Dec 16, 2024, 6:56 PM

@GripePotato said in After upgrade 24.03 to 24.11 reboot hangs at start @ 0xffffff....:

This thread indicates two types of devices experience problems:

Pfsense on VM

4200 MAX

The VM folks got a solution/recommendation of attaching a serial port to the VM. Is there a recommendation for the 4200 MAX other than trying again? I've tried a couple times already, both resulting in failure.

The VM issue was quite a bit different and unrelated to what's happening on the 4200, which still isn't clear.

As for the 4200, nobody has yet been able to capture the whole boot process on a system affected by the problem (See my request in https://forum.netgate.com/post/1197950 ) -- the other person who tried ended up having a successful upgrade on their next attempt.

So if you could, try the upgrade again and capture the whole next boot output from the serial console and attach it here (or send it via TAC).

It may also be worth checking to make sure you have /boot/loader.conf.lua present with appropriate content. Also make sure you have the pfSense, pfSense-plus, and pfSense-boot OS packages installed before upgrading. Check pkg info -x pfSense to see if they are in the list.

jackyaz · Dec 16, 2024, 7:00 PM

@jimp my output is literally all that's displayed, other than the loader menu. There's no other output whatsoever

jimp · Dec 16, 2024, 7:04 PM

@jackyaz said in After upgrade 24.03 to 24.11 reboot hangs at start @ 0xffffff....:

@jimp my output is literally all that's displayed, other than the loader menu. There's no other output whatsoever

I mean before that. The rest of the POST that happens from power on until it reaches the menu before it tries to boot the kernel. You're saying there is nothing else at all?

There should be output like:

Version 2.22.1285. Copyright (C) 2024 AMI                                       
BIOS Date: 02/01/2024 15:18:05 Ver: 2AZRT81                                     
Press <DEL> or <ESC> to enter setup. 

Consoles: EFI console  
    Reading loader env vars from /efi/freebsd/loader.env
Setting currdev to disk0p1:
FreeBSD/amd64 EFI loader, Revision 3.0
(Sun Dec 15 16:14:26 UTC 2024 root@freebsd)

   Command line arguments: loader.efi
   Image base: 0x54a1b000
   EFI version: 2.80
   EFI Firmware: American Megatrends (rev 5.26)
   Console: efi (0x1000)
   Load Path: \efi\freebsd\loader.efi
   Load Device: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(1,GPT,FAE2512E-DA37-11EE-B8CE-0008A212EC83,0x28,0x82000)
   BootCurrent: 0001
   BootOrder: 0001[*] 000c 0003 0004 0005 0006 0007 0008 0009 000a
   BootInfo Path: HD(1,GPT,FAE2512E-DA37-11EE-B8CE-0008A212EC83,0x28,0x82000)/\efi\freebsd\loader.efi
Ignoring Boot0001: Only one DP found
Trying ESP: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(1,GPT,FAE2512E-DA37-11EE-B8CE-0008A212EC83,0x28,0x82000)
Setting currdev to disk0p1:
Trying: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(2,GPT,FAF90874-DA37-11EE-B8CE-0008A212EC83,0x82028,0x400)
Setting currdev to disk0p2:
Trying: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(3,GPT,FB17245C-DA37-11EE-B8CE-0008A212EC83,0x82800,0x200000)
Setting currdev to disk0p3:
Trying: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(4,GPT,FB36C0A0-DA37-11EE-B8CE-0008A212EC83,0x282800,0x1AB1000)
Loading /boot/defaults/loader.confT/default_20241216101221:
Loading /boot/defaults/loader.confault:
Loading /boot/device.hints
Loading /boot/loader.conf
Loading /boot/loader.conf.lua
Netgate 4200 detected.
Loading /boot/loader.conf.local

I haven't seen anything like that in any other post in this thread, all the captures start too late in the process (menu or later)

jackyaz · Dec 16, 2024, 7:15 PM

@jimp I'll reboot to 24.11 tomorrow when I can get an hour's downtime in

Bogart-ICQa · Jan 8, 2025, 3:29 PM

We are also not able to upgrade to 24.11 on our 4200. The upgrade process itself completes but the box is not rebooting into the new version. Its just is stuck with solid light orange, purple, blue.
Only way to restart is to disconnect power to reboot into to the previous 24.03.

Any suggestions appreciated.

jackyaz · Jan 8, 2025, 1:07 PM

I finally got time to try upgrading again and despite 0 changes in the environment from the last attempt, it upgraded without issue. I'd love to know why!

stephenw10 · Jan 8, 2025, 3:29 PM

@Bogart-ICQa said in After upgrade 24.03 to 24.11 reboot hangs at start @ 0xffffff....:

The upgrade process itself completes but the box is not rebooting into the new version. Its just is stuck with solid light orange, purple, blue.

What does the console show while that is happening?

Bogart-ICQa · Jan 9, 2025, 11:31 AM

@stephenw10

Version 2.22.1285. Copyright (C) 2024 AMI
BIOS Date: 02/01/2024 15:18:05 Ver: 2AZRT81
Press <DEL> or <ESC> to enter setup.
Consoles: EFI console
    Reading loader env vars from /efi/freebsd/loader.env
Setting currdev to disk0p1:
FreeBSD/amd64 EFI loader, Revision 1.1
(Fri Nov 22 05:06:57 UTC 2024 root@freebsd)

   Command line arguments: loader.efi
   Image base: 0x54a1f000
   EFI version: 2.80
   EFI Firmware: American Megatrends (rev 5.26)
   Console: efi (0x1000)
   Load Path: \EFI\freebsd\loader.efi
   Load Device: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(1,GPT,E3589FC9-9482-11EE-975D-4550A2D939BA,0x3,0x64000)
   BootCurrent: 0001
   BootOrder: 0001[*] 0009 0000 000c 000d 000e 000f 0010 0011 0012 0013 0014 000a
   BootInfo Path: HD(1,GPT,E3589FC9-9482-11EE-975D-4550A2D939BA,0x3,0x64000)/\EFI\freebsd\loader.efi
Ignoring Boot0001: Only one DP found
Trying ESP: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(1,GPT,E3589FC9-9482-11EE-975D-4550A2D939BA,0x3,0x64000)
Setting currdev to disk0p1:
Trying: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(2,GPT,E3589FD1-9482-11EE-975D-4550A2D939BA,0x64003,0x197FFFD)
Setting currdev to zfs:pfSense/ROOT/default_20250107160359_20250108115934:
Loading /boot/defaults/loader.confault:
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
Loading /boot/loader.conf
Loading /boot/loader.conf.lua
Netgate 4200 detected.
Loading /boot/loader.conf.local
|
-
\          __
    _ __  / _|___  ___ _ __  ___  ___      _
   | '_ \| |_/ __|/ _ \ '_ \/ __|/ _ \   _| |_
   | |_) |  _\__ \  __/ | | \__ \  __/  |_   _|
   | .__/|_| |___/\___|_| |_|___/\___|    |_|
   |_|


 ╔════ Welcome to Netgate pfSense Plus ════╗      __________________________
 ║                                         ║     /                       ___\
 ║  1. Boot Multi user [Enter]             ║    |                      /`
 ║  2. Boot Single user                    ║    |                     /    :-|
 ║  3. Escape to loader prompt             ║    |      _________  ___/    /_ |
 ║  4. Reboot                              ║    |    /` ____   / /__    ___/ |
 ║  5. Cons: Serial                        ║    |   /  /   /  /    /   /     |
 ║                                         ║    |  /  /___/  /    /   /      |
 ║  Options:                               ║    | /   ______/    /   /  _    |
 ║  6. Kernel: default/kernel (1 of 2)     ║    |/   /          /   / _| |_  |
 ║  7. Boot Options                        ║        /          /___/ |_   _| |
 ║  8. Boot Environments                   ║       /                   |_|   |
 ║                                         ║      /_________________________/
 ╚═════════════════════════════════════════╝                                  |
   Autoboot in 0 seconds. [Space] to pause

Loading kernel...
/boot/kernel/kernel text=0x1a4c98 text=0xff3048 text=0x17ed568 data=0x180+0xe80 data=0x24c808+0x3b37f8 0x8+0x1d4108+0x8+0x1e9a19
Loading configured modules...
can't find '/boot/entropy'
/boot/kernel/zfs.ko size 0x619a40 at 0x37be000
/boot/kernel/opensolaris.ko size 0x1e2a8 at 0x3dd8000
can't find '/etc/hostid'
staging 0x3fa00000-0x43f40000 (not copying) tramp 0x43f40000 PT4 0x43f41000
Start @ 0xffffffff803a5000 ...
/

An there it is stuck. The working 24.03 boots as follows:

Version 2.22.1285. Copyright (C) 2024 AMI
BIOS Date: 02/01/2024 15:18:05 Ver: 2AZRT81
Press <DEL> or <ESC> to enter setup.
Consoles: EFI console
    Reading loader env vars from /efi/freebsd/loader.env
Setting currdev to disk0p1:
FreeBSD/amd64 EFI loader, Revision 1.1
(Fri Nov 22 05:06:57 UTC 2024 root@freebsd)

   Command line arguments: loader.efi
   Image base: 0x54a20000
   EFI version: 2.80
   EFI Firmware: American Megatrends (rev 5.26)
   Console: efi (0x1000)
   Load Path: \EFI\freebsd\loader.efi
   Load Device: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(1,GPT,E3589FC9-9482-11EE-975D-4550A2D939BA,0x3,0x64000)
   BootCurrent: 0001
   BootOrder: 0001[*] 0009 0000 000c 000d 000e 000f 0010 0011 0012 0013 0014 000a
   BootInfo Path: HD(1,GPT,E3589FC9-9482-11EE-975D-4550A2D939BA,0x3,0x64000)/\EFI\freebsd\loader.efi
Ignoring Boot0001: Only one DP found
Trying ESP: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(1,GPT,E3589FC9-9482-11EE-975D-4550A2D939BA,0x3,0x64000)
Setting currdev to disk0p1:
Trying: PciRoot(0x0)/Pci(0x14,0x0)/USB(0x5,0x0)/HD(2,GPT,E3589FD1-9482-11EE-975D-4550A2D939BA,0x64003,0x197FFFD)
Setting currdev to zfs:pfSense/ROOT/default_20250107160359_20250108115934:
Loading /boot/defaults/loader.conf
Loading /boot/defaults/loader.conf
Loading /boot/device.hints
Loading /boot/loader.conf
Loading /boot/loader.conf.lua
Netgate 4200 detected.
Loading /boot/loader.conf.local
\
-
-          __
    _ __  / _|___  ___ _ __  ___  ___      _
   | '_ \| |_/ __|/ _ \ '_ \/ __|/ _ \   _| |_
   | |_) |  _\__ \  __/ | | \__ \  __/  |_   _|
   | .__/|_| |___/\___|_| |_|___/\___|    |_|
   |_|


 ╔════ Welcome to Netgate pfSense Plus ════╗      __________________________
 ║                                         ║     /                       ___\
 ║  1. Boot Multi user [Enter]             ║    |                      /`
 ║  2. Boot Single user                    ║    |                     /    :-|
 ║  3. Escape to loader prompt             ║    |      _________  ___/    /_ |
 ║  4. Reboot                              ║    |    /` ____   / /__    ___/ |
 ║  5. Cons: Serial                        ║    |   /  /   /  /    /   /     |
 ║                                         ║    |  /  /___/  /    /   /      |
 ║  Options:                               ║    | /   ______/    /   /  _    |
 ║  6. Kernel: default/kernel (1 of 2)     ║    |/   /          /   / _| |_  |
 ║  7. Boot Options                        ║        /          /___/ |_   _| |
 ║  8. Boot Environments                   ║       /                   |_|   |
 ║                                         ║      /_________________________/
 ╚═════════════════════════════════════════╝                                  \
   Autoboot in 0 seconds. [Space] to pause

Loading kernel...
/boot/kernel/kernel text=0x19eec0 text=0xff4c38 text=0x17e3db4 data=0x180 data=0x22d718+0x3d18e8 0x8+0x1cb0f0+0x8+0x1da290|
Loading configured modules...
can't find '/etc/hostid'
/boot/kernel/opensolaris.ko size 0x1e2f0 at 0x35a6000
/boot/kernel/zfs.ko size 0x5ea9a0 at 0x35c5000
can't find '/boot/entropy'
staging 0x3fc00000-0x43f40000 (not copying) tramp 0x43f40000 PT4 0x43f41000
Start @ 0xffffffff8039f000 ...
GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
---<<BOOT>>---
Copyright (c) 1992-2024 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 15.0-CURRENT #0 plus-RELENG_24_03-n256311-e71f834dd81: Fri Apr 19 00:28:14 UTC 2024
    root@freebsd:/var/jenkins/workspace/pfSense-Plus-snapshots-24_03-main/obj/amd64/Y4MAEJ2R/var/jenkins/workspace/pfSense-Plus-snapshots-24_03-main/sources/FreeBSD-src-plus-RELENG_24_03/amd64.amd64/sys/pfSense amd64
FreeBSD clang version 17.0.6 (https://github.com/llvm/llvm-project.git llvmorg-17.0.6-0-g6009708b4367)
VT(vga): resolution 640x480
CPU: Genuine Intel(R) Atom C1110 processor (2112.00-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906a4  Family=0x6  Model=0x9a  Stepping=4
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffafbbf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x239ca7eb<FSGSBASE,TSCADJ,BMI1,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,NFPUSG,PQE,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,PROCTRACE,SHA>
  Structured Extended Features2=0x984007bc<UMIP,PKU,OSPKE,WAITPKG,GFNI,VAES,VPCLMULQDQ,RDPID,MOVDIRI,MOVDIR64B>
  Structured Extended Features3=0xfc184410<FSRM,MD_CLEAR,IBT,IBPB,STIBP,L1DFL,ARCH_CAP,CORE_CAP,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  IA32_ARCH_CAPS=0x188fd6b<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO,TAA_NO>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
real memory  = 4294967296 (4096 MB)
avail memory = 3887665152 (3707 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
WARNING: L3 data cache covers more APIC IDs than a package (7 > 3)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0 <Version 2.0> irqs 0-119
Launching APs: 1 3 2
TCP_ratelimit: Is now initialized
ipw_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_bss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_bss_fw, 0xffffffff80750310, 0) error 1
ipw_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_ibss: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_ibss_fw, 0xffffffff807503c0, 0) error 1
ipw_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_ipw.LICENSE.
ipw_monitor: If you agree with the license, set legal.intel_ipw.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (ipw_monitor_fw, 0xffffffff80750470, 0) error 1
iwi_bss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_bss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_bss_fw, 0xffffffff80770010, 0) error 1
iwi_ibss: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_ibss: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_ibss_fw, 0xffffffff807700c0, 0) error 1
iwi_monitor: You need to read the LICENSE file in /usr/share/doc/legal/intel_iwi.LICENSE.
iwi_monitor: If you agree with the license, set legal.intel_iwi.license_ack=1 in /boot/loader.conf.
module_register_init: MOD_LOAD (iwi_monitor_fw, 0xffffffff80770170, 0) error 1
random: entropy device external interface
wlan: mac acl policy registered
kbd0 at kbdmux0
WARNING: Device "spkr" is Giant locked and may be deleted before FreeBSD 15.0.
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
netgate0: <Netgate 4200>
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0x61c66000-0x61c66017
smbios0: Version: 3.5
acpi0: <ALASKA A M I >
acpi_ec1: <Embedded Controller: GPE 0x6e, ECDT> port 0x62,0x66 on acpi0
acpi0: Power Button (fixed)
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 19200000 Hz quality 950
Event timer "HPET" frequency 19200000 Hz quality 550
Event timer "HPET1" frequency 19200000 Hz quality 440
Event timer "HPET2" frequency 19200000 Hz quality 440
Event timer "HPET3" frequency 19200000 Hz quality 440
Event timer "HPET4" frequency 19200000 Hz quality 440
atrtc1: <AT realtime clock> on acpi0
atrtc1: Warning: Couldn't map I/O.
atrtc1: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
xhci0: <Intel Alder Lake-P Thunderbolt 4 USB controller> mem 0x4000040000-0x400004ffff at device 13.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <simple comms, UART> at device 18.0 (no driver attached)
pci0: <mass storage> at device 18.7 (no driver attached)
xhci1: <Intel Alder Lake USB 3.2 controller> mem 0x4000020000-0x400002ffff at device 20.0 on pci0
xhci1: 32 bytes context size, 64-bit DMA
usbus1 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
pci0: <memory, RAM> at device 20.2 (no driver attached)
pci0: <serial bus> at device 21.0 (no driver attached)
pci0: <serial bus> at device 21.1 (no driver attached)
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <serial bus> at device 25.0 (no driver attached)
pci0: <serial bus> at device 25.1 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 28.4 on pci0
pci2: <ACPI PCI bus> on pcib2
igc0: <Intel(R) Ethernet Controller I226-V> mem 0x67a00000-0x67afffff,0x67b00000-0x67b03fff at device 0.0 on pci2
igc0: Using 1024 TX descriptors and 1024 RX descriptors
igc0: Using 1 RX queues 1 TX queues
igc0: Using MSI-X interrupts with 2 vectors
igc0: Ethernet address: 90:ec:77:8e:56:21
igc0: netmap queues/slots: TX 1/1024, RX 1/1024
pcib3: <ACPI PCI-PCI bridge> at device 28.5 on pci0
pci3: <ACPI PCI bus> on pcib3
igc1: <Intel(R) Ethernet Controller I226-V> mem 0x67700000-0x677fffff,0x67800000-0x67803fff at device 0.0 on pci3
igc1: Using 1024 TX descriptors and 1024 RX descriptors
igc1: Using 1 RX queues 1 TX queues
igc1: Using MSI-X interrupts with 2 vectors
igc1: Ethernet address: 90:ec:77:8e:56:20
igc1: netmap queues/slots: TX 1/1024, RX 1/1024
pcib4: <ACPI PCI-PCI bridge> at device 28.6 on pci0
pci4: <ACPI PCI bus> on pcib4
igc2: <Intel(R) Ethernet Controller I226-V> mem 0x67400000-0x674fffff,0x67500000-0x67503fff at device 0.0 on pci4
igc2: Using 1024 TX descriptors and 1024 RX descriptors
igc2: Using 1 RX queues 1 TX queues
igc2: Using MSI-X interrupts with 2 vectors
igc2: Ethernet address: 90:ec:77:8e:56:1f
igc2: netmap queues/slots: TX 1/1024, RX 1/1024
pcib5: <ACPI PCI-PCI bridge> at device 28.7 on pci0
pci5: <ACPI PCI bus> on pcib5
igc3: <Intel(R) Ethernet Controller I226-V> mem 0x67100000-0x671fffff,0x67200000-0x67203fff at device 0.0 on pci5
igc3: Using 1024 TX descriptors and 1024 RX descriptors
igc3: Using 1 RX queues 1 TX queues
igc3: Using MSI-X interrupts with 2 vectors
igc3: Ethernet address: 90:ec:77:8e:56:1e
igc3: netmap queues/slots: TX 1/1024, RX 1/1024
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
pci0: <serial bus> at device 31.5 (no driver attached)
acpi_acad0: <AC Adapter> on acpi0
ns8250: UART FCR is brokene> iomem 0xfe03e000-0xfe03e007 irq 16 on acpi0
uart2: console (115200,n,8,1)
acpi_button0: <Sleep Button> on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_42000: <Netgate 4200 LED controller SILC1001> on acpi0
atrtc0: <AT realtime clock> at port 0x70 irq 8 on isa0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
atrtc0: Can't map interrupt.
hwpstate_intel0: <Intel Speed Shift> on cpu0
hwpstate_intel1: <Intel Speed Shift> on cpu1
hwpstate_intel2: <Intel Speed Shift> on cpu2
hwpstate_intel3: <Intel Speed Shift> on cpu3
Timecounter "TSC" frequency 2112003010 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <Intel XHCI root HUB> at usbus0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
uhub0 on usbus0
uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <Intel XHCI root HUB> at usbus1
Trying to mount root from zfs:pfSense/ROOT/default_20250107160359_20250108115934 []...
uhub1 on usbus1
uhub1: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub0: 3 ports with 3 removable, self powered
uhub1: 16 ports with 16 removable, self powered
Root mount waiting for: usbus1 CAM
Root mount waiting for: usbus1 CAM
ugen1.2: <Generic Ultra Fast Media> at usbus1
umass0 on uhub1
umass0: <Generic Ultra Fast Media, class 0/0, rev 2.00/1.98, addr 1> on usbus1
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
Root mount waiting for: CAM
da0 at umass-sim0 bus 0 scbus0 target 0 lun 0
da0: <Generic Ultra HS-COMBO 1.98> Removable Direct Access SCSI device
da0: Serial Number 000000225001
da0: 40.000MB/s transfers
da0: 14952MB (30621696 512 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
Configuring crash dumps...
No suitable dump device was found.
Filesystems are clean, continuing...
Mounting filesystems...
Mounting ZFS boot environment...done.

        __
 _ __  / _|___  ___ _ __  ___  ___      _
| '_ \| |_/ __|/ _ \ '_ \/ __|/ _ \   _| |_
| |_) |  _\__ \  __/ | | \__ \  __/  |_   _|
| .__/|_| |___/\___|_| |_|___/\___|    |_|
|_|


Welcome to Netgate pfSense Plus 24.03-RELEASE (Patch 1)...

...ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat/pkg /usr/local/lib/graphviz /usr/local/lib/ipsec /usr/local/lib/mysql /usr/local/lib/perl5/5.36/mach/CORE
32-bit compatibility ldconfig path:
done.
3379
>>> Removing vital flag from php83...done.
External config loader 1.0 is now starting... da0p1 da0p2 da0p3
Launching the init system...Updating CPU Microcode...
CPU: Genuine Intel(R) Atom C1110 processor (2112.00-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906a4  Family=0x6  Model=0x9a  Stepping=4
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffafbbf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x239ca7eb<FSGSBASE,TSCADJ,BMI1,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,NFPUSG,PQE,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,PROCTRACE,SHA>
  Structured Extended Features2=0x984007bc<UMIP,PKU,OSPKE,WAITPKG,GFNI,VAES,VPCLMULQDQ,RDPID,MOVDIRI,MOVDIR64B>
  Structured Extended Features3=0xfc184410<FSRM,MD_CLEAR,IBT,IBPB,STIBP,L1DFL,ARCH_CAP,CORE_CAP,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  IA32_ARCH_CAPS=0x188fd6b<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO,TAA_NO>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
Done.
 done.
Initializing.................... done.
Starting device manager (devd)...ig4iic0: <Intel Alder Lake-P I2C Controller-0> at device 21.0 on pci0
ig4iic0: Using MSI
iicbus0: <Philips I2C bus (ACPI-hinted)> on ig4iic0
iicbus0: <unknown card> at addr 0x14
ig4iic1: <Intel Alder Lake-P I2C Controller-1> at device 21.1 on pci0
ig4iic1: Using MSI
iicbus1: <Philips I2C bus (ACPI-hinted)> on ig4iic1
ig4iic2: <Intel Alder Lake-P I2C Controller-4> at device 25.0 on pci0
ig4iic2: Using MSI
iicbus2: <Philips I2C bus (ACPI-hinted)> on ig4iic2
ig4iic3: <Intel Alder Lake-P I2C Controller-5> at device 25.1 on pci0
ig4iic3: Using MSI
iicbus3: <Philips I2C bus (ACPI-hinted)> on ig4iic3
driver bug: Unable to set devclass (class: uart devname: (unknown))
driver bug: Unable to set devclass (class: atkbdc devname: (unknown))
ichsmb0: <Intel Alder Lake SMBus controller> port 0xefa0-0xefbf mem 0x4000064000-0x40000640ff at device 31.4 on pci0
smbus0: <System Management Bus> on ichsmb0
done.
Loading configuration....done.
Updating configuration...done.
Loading cryptographic accelerator drivers...aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
done.
Setting up extended sysctls...done.
Executing early shell commands...WireGuard service is disabled
done.
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
Setting timezone...done.
Configuring looplo0: link state changed to UP
back interface...done.
Starting syslog...done.
Setting up interfaces microcode...done.
Configuring loopback interface...done.
Configuring WAN interface...done.
Configuring LAN interface...done.
Configuring DMZ interface...done.
Configuring CARP settings...done.
Starting Secure Shell Services...done.
Syncing OpenVPN settings...done.
[fib_algo] inet.0 (bsearch4#22) rebuild_fd_flm: switching algo to radix4_lockless
route: route has not been found
route: route has not been found
Configuring firewall..load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched FQ_CODEL loaded
load_dn_sched dn_sched FQ_PIE loaded
load_dn_aqm dn_aqm CODEL loaded
load_dn_aqm dn_aqm PIE loaded
....done.
Starting PFLOG...done.
Setting up gateway monitors...done.
Setting up static routes...done.
Setting up DNSs...
Starting DNS Resolver...done.
Synchronizing user settings...done.
Configuring CRON...done.
Bootstrapping clock...done.
Starting NTP Server...done.
Starting webConfigurator...config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
done.
Configuring firewall..config_aqm Unable to configure flowset, flowset busy!
config_aqm Unable to configure flowset, flowset busy!
....done.
Generating RRD graphs...done.
Starting syslog...config_aqm Unable to configure flowset, flowset busy!
done.
Starting CRON... done.
 Starting package AWS VPC Wizard...done.
 Starting package IPsec Profile Wizard...done.
 Starting package Netgate Firmware Upgrade...done.
 Starting package WireGuard...done.
 Starting package pfBlockerNG...done.
 Starting package Traffic Totals...done.
 Starting package Tailscale...done.
 Starting package OpenVPN Client Export Utility...done.
 Starting package haproxy...done.
 Starting package acme...done.
 Starting package nrpe...done.
 Starting package ntopng...done.
 Starting package arpwatch...done.
 Starting /usr/local/etc/rc.d/pfb_dnsbl.sh...done.
 Starting /usr/local/etc/rc.d/pfb_filter.sh...done.
 Starting /usr/local/etc/rc.d/vnstatd.sh...done.
Netgate pfSense Plus 24.03-RELEASE (Patch 1) amd64 20240424-1738
Bootup complete
Performing automatic boot verification...done.

FreeBSD/amd64 (pfSense.ccdrdag.com) (ttyu2)

Netgate 4200 - Serial: 2006240239 - Netgate Device ID: 053c5c7683fe73b0f27e

*** Welcome to Netgate pfSense Plus 24.03-RELEASE (amd64) on pfSense ***

  Current Boot Environment: default_20250107160359_20250108115934
     Next Boot Environment: default_20250107160359_20250108115934

 WAN (wan)  -> igc3 -> v4: 10.199.100.10/24
 LAN (lan)  -> igc2 -> v4: 192.168.201.1/24
 DMZ (opt1) -> igc1 -> v4: 10.10.100.1/24

 0) Logout (SSH only)                  9) pfTop
 1) Assign Interfaces                 10) Filter Logs
 2) Set interface(s) IP address       11) Restart GUI
 3) Reset admin account and password  12) PHP shell + Netgate pfSense Plus tools
 4) Reset to factory defaults         13) Update from console
 5) Reboot system                     14) Disable Secure Shell (sshd)
 6) Halt system                       15) Restore recent configuration
 7) Ping host                         16) Restart PHP-FPM
 8) Shell

Enter an option:

stephenw10 · Jan 9, 2025, 8:54 PM

And that is just booting the two BEs? No other changes?

Bogart-ICQa · Jan 9, 2025, 9:34 PM

@stephenw10

Yes.

Bogart-ICQa · Jan 10, 2025, 11:56 AM

I got it booting into 24.11 using the console upgrade option (lucky number 13).
Had to reboot twice though. After the first reboot the GUI wasn't working (bad request error).
Now it seems to be ok (fingers crossed).

stephenw10 · Jan 10, 2025, 1:54 PM

Hmm, so upgrading via the gui resulted in no boot but upgrading via the CLI succeeded?

There should be no difference between those.

jimp · Jan 10, 2025, 1:57 PM

@stephenw10 said in After upgrade 24.03 to 24.11 reboot hangs at start @ 0xffffff....:

Hmm, so upgrading via the gui resulted in no boot but upgrading via the CLI succeeded?

There should be no difference between those.

Others upthread had success when they tried it again, so it may have been the retry that did it and not the method. Still doesn't make a lot of sense, but at least seems to be consistently inconsistent.

Bogart-ICQa · Jan 10, 2025, 2:19 PM

@jimp with the GUI i tried twice with the same outcome. First from home which had me to turn into the office at night to fix it.

GripePotato · Mar 19, 2025, 4:57 PM

Successfully upgraded from 24.03 to 24.11 via command line (SSH).

I'd been dreading the unpleasant task of dealing with the previous GUI update failures, but SSH -> Option 13 -> Reboot and back up in ~3min with little trouble.