Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Netgate 6100 Max ZFS Install Location

    Scheduled Pinned Locked Moved Official Netgate® Hardware
    25 Posts 6 Posters 3.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • E
      ericafterdark @stephenw10
      last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • E
        ericafterdark @stephenw10
        last edited by

        @stephenw10 said in Netgate 6100 Max ZFS Install Location:

        The easiest thing to do if that happens is to reinstall to the eMMC as UFS then make sure the NVMe drive is above it in the boot order.

        This was the solution. Thank you!

        1 Reply Last reply Reply Quote 1
        • C
          cdturri @stephenw10
          last edited by

          @stephenw10 New user here, 6100 non-Max with custom SSD upgrade. I ran into this issue as the 6100 now comes with ZFS preinstalled and I did another ZFS installation on the SSD but it is booting from the eMMC and mouting it. This makes it impossible for the "zpool labelclear" command to succeed. I booted up with the installer, went to the shell and I tried the command but I got an error, any ideas?

          # zpool labelclear -f /dev/mmcsd0p3
          failed to read label from /dev/mmcsd0p3
          # zpool list
          no pools available
          # ls -al /dev/mmcsd0p3
          crw-r-----  1 root  operator  0x5f Aug 31 13:52 /dev/mmcsd0p3
          #
          
          1 Reply Last reply Reply Quote 0
          • jimpJ
            jimp Rebel Alliance Developer Netgate
            last edited by

            https://docs.netgate.com/pfsense/en/latest/troubleshooting/boot-issues.html#multiple-disk-boot-issues

            Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

            Need help fast? Netgate Global Support!

            Do not Chat/PM for help!

            C 1 Reply Last reply Reply Quote 0
            • C
              cdturri @jimp
              last edited by

              @jimp Thanks. I did try few things there but none helped. In the end I did the other suggestions from @stephenw10 which was to reinstall reinstall to the eMMC as UFS then make sure the NVMe drive is above it in the boot order. I rather have a functional installation in the eMMC which I can always use in case of SSD failure (provided I have a good config backup of course). But it will be better if the installer could detect deal with this issue as it is likely to happen more often now that pfsense is installed on ZFS by default. I wasn't sure if I should rename the defaul ZFS pool name, this sort of changes can sometimes lead to upgrade issues. Is it safe to name whatever the installer wants?

              jimpJ 1 Reply Last reply Reply Quote 0
              • jimpJ
                jimp Rebel Alliance Developer Netgate @cdturri
                last edited by

                @cdturri said in Netgate 6100 Max ZFS Install Location:

                @jimp Thanks. I did try few things there but none helped. In the end I did the other suggestions from @stephenw10 which was to reinstall reinstall to the eMMC as UFS then make sure the NVMe drive is above it in the boot order. I rather have a functional installation in the eMMC which I can always use in case of SSD failure (provided I have a good config backup of course). But it will be better if the installer could detect deal with this issue as it is likely to happen more often now that pfsense is installed on ZFS by default. I wasn't sure if I should rename the defaul ZFS pool name, this sort of changes can sometimes lead to upgrade issues. Is it safe to name whatever the installer wants?

                Having the second install is more likely to be a source of problems than a helpful backup. Read the section of the doc I posted a bit deeper, it explains why. Also you're passing the wrong parameter to zpool labelclear and the example on the doc has the correct syntax.

                Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                Need help fast? Netgate Global Support!

                Do not Chat/PM for help!

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Hmm, interesting I'm sure I tested that at the time...

                  I've never seen a problem using UFS and ZFS installs though it would obviously be possible to boot the alternative install perhaps without intending to.

                  Steve

                  C 1 Reply Last reply Reply Quote 0
                  • C
                    cdturri @stephenw10
                    last edited by

                    @jimp @stephenw10 In this case it was two ZFS, one on eMMC and the other on SSD. If having two installs is bad practice then why not have the installer prevent this by wipping the other install at the same time? Anyway I am sorted now, new ZFS install on the SSD and the Netgate boots to the correct drive.

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      Just for reference the actual required command there for a default ZFS install to eMMC on a 6100 is:

                      zpool labelclear -f /dev/mmcsd0p4
                      

                      Neither p3 or the base device work.

                      # zpool labelclear -f /dev/mmcsd0p3
                      failed to clear label for /dev/mmcsd0p3
                      # zpool labelclear -f /dev/mmcsd0
                      failed to clear label for /dev/mmcsd0
                      # zpool labelclear -f /dev/mmcsd0p4
                      # 
                      

                      Steve

                      1 Reply Last reply Reply Quote 0
                      • N
                        NETLOGIC @ericafterdark
                        last edited by NETLOGIC

                        @stephenw10 I know this is an old topic, however I have a sg6100 formatted UFS and I want to reformat - reinstall with ZFS.. Only question I have is the location of the file with the boot order so that I can ensure that the drive :
                        Geom name: nvd0
                        is the primary boot drive.
                        Any insights on this would be greatly appreciated. I am asking in advance of doing this so that I can avoid messing it up.

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by

                          If youre just switching from UFS to ZFS you should be able to simply reinstall as ZFS and everything will work as it should.
                          The boot order is held in the BIOS (blinkboot) UEFI variables. You can view or change it using the boot menu option presented by Blinkboot if you need to. But you shouldn't.

                          Steve

                          N 1 Reply Last reply Reply Quote 1
                          • N
                            NETLOGIC @stephenw10
                            last edited by

                            @stephenw10 I think I forgot to mention that my 6100 is a max model with a second drive.. As long as I know I can find the boot order page I can figure it out.
                            I saw from the previous posts there is a way to write the image to the nvd0 drive and hopefully it will boot from that drive and not the smaller drive.

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              It was in the thread title. 😉

                              That's also fine as long as you have not installed to eMMC at any time.

                              The only problem you might face is that if you install as ZFS with the default pool name (pfSense) to both eMMC and m.2 you can end up mounting root from the wrong drive.

                              Steve

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.