Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    After upgrade to 23.05.1, pfSense on Netgate 3100 basically dead

    Scheduled Pinned Locked Moved General pfSense Questions
    14 Posts 5 Posters 1.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      SteveITS Galactic Empire @MordyT
      last edited by

      @MordyT what does “waited 10 minutes” mean? Hopefully that’s when it naturally finished?

      I would have expected it to go straight to 23.05.1.

      Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
      When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
      Upvote 👍 helpful posts!

      M 1 Reply Last reply Reply Quote 1
      • M
        MordyT @SteveITS
        last edited by

        @SteveITS After the upgrade finished and the webui was available again, I waited 10 minutes just in case of any background tasks before going to update and moving to the .1 release.

        S 1 Reply Last reply Reply Quote 0
        • S
          SteveITS Galactic Empire @MordyT
          last edited by

          @MordyT I would try:

          • Check if the console (cable) shows any errors at the time

          • check storage write life: https://docs.netgate.com/pfsense/en/latest/troubleshooting/disk-lifetime.html

          • try a reinstall: https://docs.netgate.com/pfsense/en/latest/solutions/sg-3100/reinstall-pfsense.html

          Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
          When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
          Upvote 👍 helpful posts!

          M 1 Reply Last reply Reply Quote 1
          • M
            MordyT @SteveITS
            last edited by

            @SteveITS said in After upgrade to 23.05.1, pfSense on Netgate 3100 basically dead:

            https://docs.netgate.com/pfsense/en/latest/troubleshooting/disk-lifetime.html

            All good on that front, apparently under 10% used
            c965cca5-8dd0-473d-90b5-19d4d27e923e-image.png

            @SteveITS said in After upgrade to 23.05.1, pfSense on Netgate 3100 basically dead:

            Check if the console (cable) shows any errors at the time

            That's going to be tricky, but I'll work on it. Any other way to get the output?

            @SteveITS said in After upgrade to 23.05.1, pfSense on Netgate 3100 basically dead:

            try a reinstall: https://docs.netgate.com/pfsense/en/latest/solutions/sg-3100/reinstall-pfsense.html

            I've opened a ticket for the image.

            1 Reply Last reply Reply Quote 0
            • M
              MordyT
              last edited by MordyT

              Reflashing the image and restoring the backup seems to have stabilized the system.

              Of note, you can't use just any flash drive - a 5 year old 64GB Kingston USB3.0 drive would crash during the run recovery stage and I had to dig out a 8GB USB2.0 drive for it to work.

              I still don't have boot environments though, I thought a reflash brought it to ZFS?

              B S 2 Replies Last reply Reply Quote 0
              • B
                bigsy @MordyT
                last edited by

                @MordyT ZFS is not supported on ARM32 appliances (Netgate 3100 and 1000).

                R 1 Reply Last reply Reply Quote 2
                • jimpJ jimp moved this topic from Problems Installing or Upgrading pfSense Software on
                • S
                  SteveITS Galactic Empire @MordyT
                  last edited by

                  @MordyT said in After upgrade to 23.05.1, pfSense on Netgate 3100 basically dead:

                  Reflashing the image and restoring the backup seems to have stabilized the system.

                  The brute force method, but it's in a known good state going forward.

                  Re: console, I was hoping it would show something at the time of the crash, maybe a disk error or something. Doesn't sound disk related though so that's good.

                  Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
                  When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
                  Upvote 👍 helpful posts!

                  1 Reply Last reply Reply Quote 1
                  • R
                    rcoleman-netgate Netgate @bigsy
                    last edited by

                    @bigsy said in After upgrade to 23.05.1, pfSense on Netgate 3100 basically dead:

                    @MordyT ZFS is not supported on ARM32 appliances (Netgate 3100 and 1000).

                    This is 100% accurate.

                    Ryan
                    Repeat, after me: MESH IS THE DEVIL! MESH IS THE DEVIL!
                    Requesting firmware for your Netgate device? https://go.netgate.com
                    Switching: Mikrotik, Netgear, Extreme
                    Wireless: Aruba, Ubiquiti

                    1 Reply Last reply Reply Quote 1
                    • M
                      MordyT
                      last edited by

                      Unfortunately, about 30 hours post flash, the issue has returned.

                      1. All traffic to the WAN (dedicated WAN port on the box) just dies. SSHing to the box shows that WAN1 no longer has an IP or anything assigned. I can set my gateway to WAN2 and have connectivity - WAN2 is in OPT1.
                      2. The pfSense box responds to ping, SSH, but the WebUI is either dead or very slow to respond. If I reset option 16 on the console/SSH, I can get it back for a few minutes, then it starts to 504 on me. Option 11 does not help at all.

                      What logs should I looking for? How should I troubleshoot this?

                      There are no errors displayed on the console.

                      S 1 Reply Last reply Reply Quote 0
                      • S
                        SteveITS Galactic Empire @MordyT
                        last edited by

                        @MordyT is something stuck/using CPU if you run top? Your note and the PHP error above sound like PHP is not responding.

                        Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
                        When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
                        Upvote 👍 helpful posts!

                        M 1 Reply Last reply Reply Quote 1
                        • M
                          MordyT @SteveITS
                          last edited by MordyT

                          @SteveITS
                          Looks ok to me...
                          8084687f-37f4-4fad-a2c5-d72e3e4f36a3-image.png

                          I have a ton of this in dmesg though
                          08891c2e-0584-40fc-8799-92e87233c9d5-image.png

                          That is the WAN1 interface.

                          S 1 Reply Last reply Reply Quote 0
                          • S
                            SteveITS Galactic Empire @MordyT
                            last edited by

                            @MordyT mvneta2 is the WAN port so that matches what you're saying originally. Sounds like you tried the same patch cable on a laptop. I'd try replacing it anyway just to see. Another thing that helps some people is to put a switch between pfSense and the ISP router so the link stays up as far as pfSense knows.

                            Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
                            When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
                            Upvote 👍 helpful posts!

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              What's the WAN actually connected to? Is it actually losing link like that?
                              Not that the WAN flapping should cause php to get hung up like you're seeing.

                              What's in the main system logs when that happens?

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.