• Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login
Netgate Discussion Forum
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Search
  • Register
  • Login

ZFS zpool mirror 24.03.r.20240410.1729

Plus 24.03 Development Snapshots (Retired)
3
26
1.2k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • L
    LostInIgnorance
    last edited by LostInIgnorance Apr 17, 2024, 12:16 AM Apr 16, 2024, 11:57 PM

    @stephenw10 I am attaching the screenshot of the boot sequence where it hangs. I have to press 6 then the kernel becomes kernel.old and I can boot the firewall.

    login-to-view

    Attached Upgrade.txt is my upgrade from 23.09.1 to 24.03.r.20240416.0005

    Also doesn't seem to matter on if I use legacy or UEFI, the boot locks up at exactly the same place each time.
    login-to-view

    The system is the Super Micro C2758 systems that the store used to sell.

    1 Reply Last reply Reply Quote 0
    • S
      stephenw10 Netgate Administrator
      last edited by Apr 17, 2024, 12:21 AM

      Ah so it appears to upgrade OK but just fails to boot past the loader. Hmm....

      L 1 Reply Last reply Apr 17, 2024, 12:25 AM Reply Quote 0
      • L
        LostInIgnorance @stephenw10
        last edited by Apr 17, 2024, 12:25 AM

        @stephenw10 Is there anything I can add to the configuration/boot to allow higher detail to maybe give an idea on what it's hanging up on?

        1 Reply Last reply Reply Quote 0
        • S
          stephenw10 Netgate Administrator
          last edited by Apr 17, 2024, 11:31 AM

          You could try booting in verbose mode from the loader prompt (boot -v) but I doubt it will show anything extra.

          The upgrade log looks fine too. 🤔

          1 Reply Last reply Reply Quote 0
          • S
            stephenw10 Netgate Administrator
            last edited by Apr 17, 2024, 8:30 PM

            Can I assume it was booting UEFI in 23.09.1?

            Do you have the serial console enabled/connected on that device?

            L 1 Reply Last reply Apr 17, 2024, 8:33 PM Reply Quote 0
            • L
              LostInIgnorance @stephenw10
              last edited by Apr 17, 2024, 8:33 PM

              @stephenw10 Yes, I was in UEFI when I was upgrading, just didn't grab another screen shot from IPMI to reflect that

              Unfortunately I'm using the serial port for a GPS timesink

              1 Reply Last reply Reply Quote 1
              • S
                stephenw10 Netgate Administrator
                last edited by Apr 17, 2024, 8:39 PM

                What version was this originally installed as? When the ZFS mirror was created?

                L 1 Reply Last reply Apr 17, 2024, 9:26 PM Reply Quote 0
                • L
                  LostInIgnorance @stephenw10
                  last edited by Apr 17, 2024, 9:26 PM

                  @stephenw10 I backed up the config and rebuilt it as there were issues prior to 23.09 so once that was released, I backed up my configuration and reloaded it. I know I had problems on 23.01 with ZFS.

                  1 Reply Last reply Reply Quote 0
                  • S
                    stephenw10 Netgate Administrator
                    last edited by Apr 17, 2024, 9:40 PM

                    Hmm, so it was a clean 23.09 install?

                    L 1 Reply Last reply Apr 17, 2024, 10:55 PM Reply Quote 0
                    • L
                      LostInIgnorance @stephenw10
                      last edited by LostInIgnorance Apr 17, 2024, 10:56 PM Apr 17, 2024, 10:55 PM

                      @stephenw10 I am sorry, I was thinking of my SG-1100. I looked back on my history, so the last time this was rebuilt is on my post before with 2.6

                      I was able to replicate it twice after the reload. If you do a setup with 2.6 on the device, upgrade it to plus pushing it into 22.01, then do the upgrade to 22.05, and finally upgrade to the latest snapshot, I was able to wreck the EFI ZFS booting on the firewall.

                      https://forum.netgate.com/post/1071604

                      1 Reply Last reply Reply Quote 0
                      • S
                        stephenw10 Netgate Administrator
                        last edited by Apr 18, 2024, 11:50 AM

                        Hmm, but since then you were able to upgrade to 23.09.1 OK? And in fact to the last public beta image of 24.03 OK?

                        Also when this fails you are booting the old kernel to get access to the system, then rolling back the ZFS snapshot?

                        This feels like a UEFI quirk with the upgraded boot-loader. Though if the old kernel boots using the new loader that refutes that. 🤔

                        L 1 Reply Last reply Apr 18, 2024, 12:37 PM Reply Quote 0
                        • L
                          LostInIgnorance @stephenw10
                          last edited by Apr 18, 2024, 12:37 PM

                          @stephenw10 I am only able to boot with the kernel.old after upgrade. When I do this, it rolls it back to the last successful upgrade which was 3/22. I rolled it manually back by selecting the star to 23.09.1 as my primary snapshot now. I had tried the upgrade to 24.03.r.20240410.1729 and any prior snapshot that was released worked up until the pause on builds till the 4/10 image where the issues started.

                          S 1 Reply Last reply Apr 18, 2024, 1:06 PM Reply Quote 0
                          • S
                            stephenw10 Netgate Administrator @LostInIgnorance
                            last edited by Apr 18, 2024, 1:06 PM

                            @LostInIgnorance said in ZFS zpool mirror 24.03.r.20240410.1729:

                            When I do this, it rolls it back to the last successful upgrade which was 3/22.

                            Ah you mean it automatically rolls back the BE snapshot because it failed to boot into the RC?

                            L 1 Reply Last reply Apr 18, 2024, 1:08 PM Reply Quote 0
                            • L
                              LostInIgnorance @stephenw10
                              last edited by Apr 18, 2024, 1:08 PM

                              @stephenw10 Yes that is correct

                              1 Reply Last reply Reply Quote 1
                              • S
                                stephenw10 Netgate Administrator
                                last edited by Apr 18, 2024, 1:26 PM

                                Ok. We're still trying to replicate this locally.

                                J 1 Reply Last reply Apr 19, 2024, 8:38 AM Reply Quote 0
                                • J
                                  JeGr LAYER 8 Moderator @stephenw10
                                  last edited by JeGr Apr 19, 2024, 8:38 AM Apr 19, 2024, 8:38 AM

                                  @stephenw10 Just to chime in: I have a 6100 as a dev-box with 2 NVMes installed and with a ZMirror Pool, that one updated all the way from 23.09.1 to various betas to RC currently without problems with booting. So could be something more specific to the C2758 otherwise I'd guess I'd have stumbled upon it as well?

                                  login-to-view

                                  Cheers

                                  Don't forget to upvote 👍 those who kindly offered their time and brainpower to help you!

                                  If you're interested, I'm available to discuss details of German-speaking paid support (for companies) if needed.

                                  1 Reply Last reply Reply Quote 0
                                  • S
                                    stephenw10 Netgate Administrator
                                    last edited by Apr 19, 2024, 1:09 PM

                                    Yes indeed. It feels like some UEFI quirk with the BIOS in that device. So far we have not seen it here on anything tested.

                                    L 1 Reply Last reply Apr 20, 2024, 12:45 PM Reply Quote 0
                                    • L
                                      LostInIgnorance @stephenw10
                                      last edited by LostInIgnorance Apr 20, 2024, 12:45 PM Apr 20, 2024, 12:45 PM

                                      @stephenw10 After a deep discovery on my device, it looks like the ZFS mirror has not been rebuilt for quite some time (unsure really of how long as I have had this C2758 for quite a while for home). I know there was some problems long ago with some partitions not being sized correctly as part of an upgrade, needed to be rebuilt. I cleared all data from both drives and re-installed the CE edition with a "GPT (UEFI)" mirror. The prior mirror had been built with "GPT (BIOS)" and the new one is strictly "GPT (UEFI)". From there restored my config and upgraded to Plus.

                                      I am unsure how many of these oddities played into the issue I had seen on a few different releases, but it is not always bad to start from a clean slate.

                                      Shortly I am going to be testing my upgrade to the latest RC.

                                      1 Reply Last reply Reply Quote 0
                                      • S
                                        stephenw10 Netgate Administrator
                                        last edited by Apr 20, 2024, 1:48 PM

                                        Hmm, interesting. Where it stops there is at the EFI framebuffer which is something I'd only expect when it boots UEFI.

                                        1 Reply Last reply Reply Quote 0
                                        17 out of 26
                                        • First post
                                          17/26
                                          Last post
                                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.