Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    ZFS zpool mirror 24.03.r.20240410.1729

    Scheduled Pinned Locked Moved Plus 24.03 Development Snapshots (Retired)
    26 Posts 3 Posters 1.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • L
      LostInIgnorance
      last edited by

      @stephenw10 Yes, I just upgraded and I am still seeing the same issue where I cannot boot after the upgrade on a ZFS mirror. I am not sitting by the firewall, but I will grab a pic of the error as it makes it to the pfSense boot selection options, but halts there after.

      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        Ok digging.....

        1 Reply Last reply Reply Quote 0
        • L
          LostInIgnorance
          last edited by

          @stephenw10 As a side note, the mirroring didn't have a problem till the 4/10 image. The prior one on 3/22 did not have this issue with the booting.

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Are interesting. Are you booting UEFI?

            L 1 Reply Last reply Reply Quote 0
            • L
              LostInIgnorance @stephenw10
              last edited by

              @stephenw10 If memory serves me correctly, I think I am using uefi, but I can check when I make it back home later today to confirm.

              1 Reply Last reply Reply Quote 1
              • L
                LostInIgnorance
                last edited by LostInIgnorance

                @stephenw10 I am attaching the screenshot of the boot sequence where it hangs. I have to press 6 then the kernel becomes kernel.old and I can boot the firewall.

                Boot Hang.png

                Attached Upgrade.txt is my upgrade from 23.09.1 to 24.03.r.20240416.0005

                Also doesn't seem to matter on if I use legacy or UEFI, the boot locks up at exactly the same place each time.
                Boot Options.jpg

                The system is the Super Micro C2758 systems that the store used to sell.

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Ah so it appears to upgrade OK but just fails to boot past the loader. Hmm....

                  L 1 Reply Last reply Reply Quote 0
                  • L
                    LostInIgnorance @stephenw10
                    last edited by

                    @stephenw10 Is there anything I can add to the configuration/boot to allow higher detail to maybe give an idea on what it's hanging up on?

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      You could try booting in verbose mode from the loader prompt (boot -v) but I doubt it will show anything extra.

                      The upgrade log looks fine too. 🤔

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Can I assume it was booting UEFI in 23.09.1?

                        Do you have the serial console enabled/connected on that device?

                        L 1 Reply Last reply Reply Quote 0
                        • L
                          LostInIgnorance @stephenw10
                          last edited by

                          @stephenw10 Yes, I was in UEFI when I was upgrading, just didn't grab another screen shot from IPMI to reflect that

                          Unfortunately I'm using the serial port for a GPS timesink

                          1 Reply Last reply Reply Quote 1
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            What version was this originally installed as? When the ZFS mirror was created?

                            L 1 Reply Last reply Reply Quote 0
                            • L
                              LostInIgnorance @stephenw10
                              last edited by

                              @stephenw10 I backed up the config and rebuilt it as there were issues prior to 23.09 so once that was released, I backed up my configuration and reloaded it. I know I had problems on 23.01 with ZFS.

                              1 Reply Last reply Reply Quote 0
                              • stephenw10S
                                stephenw10 Netgate Administrator
                                last edited by

                                Hmm, so it was a clean 23.09 install?

                                L 1 Reply Last reply Reply Quote 0
                                • L
                                  LostInIgnorance @stephenw10
                                  last edited by LostInIgnorance

                                  @stephenw10 I am sorry, I was thinking of my SG-1100. I looked back on my history, so the last time this was rebuilt is on my post before with 2.6

                                  I was able to replicate it twice after the reload. If you do a setup with 2.6 on the device, upgrade it to plus pushing it into 22.01, then do the upgrade to 22.05, and finally upgrade to the latest snapshot, I was able to wreck the EFI ZFS booting on the firewall.

                                  https://forum.netgate.com/post/1071604

                                  1 Reply Last reply Reply Quote 0
                                  • stephenw10S
                                    stephenw10 Netgate Administrator
                                    last edited by

                                    Hmm, but since then you were able to upgrade to 23.09.1 OK? And in fact to the last public beta image of 24.03 OK?

                                    Also when this fails you are booting the old kernel to get access to the system, then rolling back the ZFS snapshot?

                                    This feels like a UEFI quirk with the upgraded boot-loader. Though if the old kernel boots using the new loader that refutes that. 🤔

                                    L 1 Reply Last reply Reply Quote 0
                                    • L
                                      LostInIgnorance @stephenw10
                                      last edited by

                                      @stephenw10 I am only able to boot with the kernel.old after upgrade. When I do this, it rolls it back to the last successful upgrade which was 3/22. I rolled it manually back by selecting the star to 23.09.1 as my primary snapshot now. I had tried the upgrade to 24.03.r.20240410.1729 and any prior snapshot that was released worked up until the pause on builds till the 4/10 image where the issues started.

                                      stephenw10S 1 Reply Last reply Reply Quote 0
                                      • stephenw10S
                                        stephenw10 Netgate Administrator @LostInIgnorance
                                        last edited by

                                        @LostInIgnorance said in ZFS zpool mirror 24.03.r.20240410.1729:

                                        When I do this, it rolls it back to the last successful upgrade which was 3/22.

                                        Ah you mean it automatically rolls back the BE snapshot because it failed to boot into the RC?

                                        L 1 Reply Last reply Reply Quote 0
                                        • L
                                          LostInIgnorance @stephenw10
                                          last edited by

                                          @stephenw10 Yes that is correct

                                          1 Reply Last reply Reply Quote 1
                                          • stephenw10S
                                            stephenw10 Netgate Administrator
                                            last edited by

                                            Ok. We're still trying to replicate this locally.

                                            JeGrJ 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.