Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Web GUI crashes after upgrade from 22.05 to 23.01

    Scheduled Pinned Locked Moved Plus 23.01 Development Snapshots (Retired)
    77 Posts 4 Posters 17.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • stephenw10S
      stephenw10 Netgate Administrator
      last edited by

      Assuming it's policy based IPSec do you have static route via LAN in place to allow that access on the remote pfSense?

      1 Reply Last reply Reply Quote 0
      • J
        jjstecchino @stephenw10
        last edited by

        @stephenw10 this is the only way I can test it. At the moment I don't have local access to this firewall. Once I do have local access I want to try a default config and if it works add ipsec and then packages. It will be a few weeks before I can go to the other house.

        1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator
          last edited by

          Do you have something behind it you could try accessing it via? Something you could remote desktop to maybe?

          J 2 Replies Last reply Reply Quote 0
          • J
            jjstecchino @stephenw10
            last edited by

            @stephenw10 Not at the moment. maybe tomorrow I can remote to my son Macbook and try local access.

            Don't know if it does matter but the problem firewall is running both ipv4 and ipv6

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              The IPSec tunnel is IPv4 only though?

              J 1 Reply Last reply Reply Quote 0
              • J
                jjstecchino @stephenw10
                last edited by

                @stephenw10 yes

                1 Reply Last reply Reply Quote 1
                • J
                  jjstecchino @stephenw10
                  last edited by jjstecchino

                  @stephenw10 Ok, local login to the firewall works without crashes. So it is the combination of logging in to the GUI through the ipsec vpn that is causing the problem.

                  Weird enough I can access webcams, ssh without issues.

                  The configuration is the same I was using on 22.05 without issues.

                  1 Reply Last reply Reply Quote 0
                  • stephenw10S
                    stephenw10 Netgate Administrator
                    last edited by

                    Ok, that's good info. Our devs are looking into this I'll try to replicate it...

                    J 1 Reply Last reply Reply Quote 0
                    • J
                      jjstecchino @stephenw10
                      last edited by

                      @stephenw10 Were you guys able to replicate the issue?
                      I may be able to go to the other house this weekend. Should I try a fresh reinstall?

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        I haven't replicated it yet.
                        Do you have SWAP enabled on that device? What size if so? Getting a full core dump from that would be useful.

                        Steve

                        J 1 Reply Last reply Reply Quote 0
                        • J
                          jjstecchino @stephenw10
                          last edited by jjstecchino

                          @stephenw10
                          /root: swapinfo
                          Device 1K-blocks Used Avail Capacity
                          /dev/ada0p3 1048576 0 1048576 0%

                          How do I get you a full core dump?

                          1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            If you install the debug kernel with:

                            [23.01-RC][root@6100.stevew.lan]/root: pkg install pfSense-kernel-debug-pfSense
                            Updating pfSense-core repository catalogue...
                            pfSense-core repository is up to date.
                            Updating pfSense repository catalogue...
                            pfSense repository is up to date.
                            All repositories are up to date.
                            The following 1 package(s) will be affected (of 0 checked):
                            
                            New packages to be INSTALLED:
                                    pfSense-kernel-debug-pfSense: 23.01.b.20230106.0600 [pfSense-core]
                            
                            Number of packages to be installed: 1
                            
                            The process will require 709 MiB more space.
                            145 MiB to be downloaded.
                            
                            Proceed with this action? [y/N]: y
                            [1/1] Fetching pfSense-kernel-debug-pfSense-23.01.b.20230106.0600.pkg: 100%  145 MiB   5.2MB/s    00:29    
                            Checking integrity... done (0 conflicting)
                            [1/1] Installing pfSense-kernel-debug-pfSense-23.01.b.20230106.0600...
                            [1/1] Extracting pfSense-kernel-debug-pfSense-23.01.b.20230106.0600: 100%
                            

                            Then when you reboot you can select that by hitting option 6 at the boot loader menu. However if you only have remote access that could be a problem.

                            Steve

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              Still failing to replicate this.

                              What IPSec config are you using?

                              What firewall rules do you have?

                              J 1 Reply Last reply Reply Quote 0
                              • J
                                jjstecchino @stephenw10
                                last edited by

                                @stephenw10 I will be at the other house this weekend and I am going to try to get core dumps with the debug kernel.

                                As far as ipsec config, it is a tunnel between the two firewall.
                                Phase1: Key exchange is IKEv2, protocol is ipv4 only, auth is Mutual PSK, identifiers are the ip addresses. auth is AES 256 SHA256 DH 14, life time 31680 sec, rekey time at default 90% of lifetime.
                                Phase2: mode is Tunnel ipv4, Local network is my lan subnet, remote network is set to the remote network ip/24, no nat. Key exchange/SA mode is ESP, encryption is AES256-GCM 128bits PFS key group 14, life time 5400, rekey time 4860 sec.

                                Once I get to the other house (the remote pfsense), the first thing I want to try is to access the firewall GUI of my primary pfsense through the ipsec vpn and see if it crashes or not. The two firewalls run on different hardware with different packages installed.

                                I will then try to get you core dumps. I will try to see if going back to a default config with just the ipsec configuration makes any difference.

                                Anything else I should try?

                                1 Reply Last reply Reply Quote 0
                                • jimpJ
                                  jimp Rebel Alliance Developer Netgate
                                  last edited by

                                  Do you have any special gateways/route table entries setup which refer to the IPsec network(s)? Or any other config in other areas of the firewall itself that relates to the tunnel outside of the IPsec config you described?

                                  Things like this sort of setup:
                                  https://docs.netgate.com/pfsense/en/latest/vpn/ipsec/access-firewall-over-ipsec.html

                                  Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                                  Need help fast? Netgate Global Support!

                                  Do not Chat/PM for help!

                                  J 1 Reply Last reply Reply Quote 0
                                  • J
                                    jjstecchino @jimp
                                    last edited by

                                    @jimp yes I had to add gateways and static routes on both end points

                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      Did it just fail to connect without those static routes? I assume those changes were added in an earlier version, before 22.05?

                                      J 2 Replies Last reply Reply Quote 0
                                      • J
                                        jjstecchino @stephenw10
                                        last edited by

                                        @stephenw10 as we discussed it is not a failed connection. The firewall reboots with a kernel fault. Yes those gateways and static routes were added before 22.05. Is that workaround not needed anymore?

                                        stephenw10S 1 Reply Last reply Reply Quote 0
                                        • stephenw10S
                                          stephenw10 Netgate Administrator @jjstecchino
                                          last edited by

                                          @jjstecchino said in Web GUI crashes after upgrade from 22.05 to 23.01:

                                          Is that workaround not needed anymore?

                                          Maybe not. At least for incoming connections like this. In my testing here I found I did not need it to access the webgui on a remote firewall. I'm just trying to determine if that's specific to my setup. Though I doubt it is since my setup is very basic.
                                          I haven't been able to replicate the crash with or without the static routes though.

                                          J 1 Reply Last reply Reply Quote 0
                                          • J
                                            jjstecchino @stephenw10
                                            last edited by

                                            @stephenw10

                                            Ok this is puzzling to me. I am now at the remote location, if ii access the GUI of my primary home firewall through the IPsec tunnel it works just fine. The two firewalls have different hardware and different update paths. I am going to try a clean full install

                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.