Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PfSense Crash under Proxmox 7.3

    Scheduled Pinned Locked Moved
    Virtualization
    crash virtualization
    4
    8
    1.4k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • N
      notoriousimpatient
      last edited by

      I've had two crashes of PfSense 22.05 under proxmox 7.3. I moved to 22.05 due to Intel V-226 nics.

      High level setup:

      • pass-thru NIC for WAN traffic [WAN during install]
      • virtio for proxmox bridge that carries management traffic [VLAN created during install and later renamed from LAN to MGMT]
      • virtio for proxmox bridge network traffic
      • pass-thru NIC for Vendor-managed DMZ

      ProxMox
      nic1: Linux bridge --> VLAN 10.99.0.11 Proxmox management
      ----- virtio --> VLAN 99 10.99.0.21 PfSense [LAN renamed MGMT]
      nic2: Linux bridge --> VLAN 20, VLAN 30 for Proxmox VMs
      ----- virtio --> VLAN 20 10.20.0.1 for PfSense routing/firewall
      -----> VLAN 30 10.30.0.1 for PfSense routing/firewall
      nic3: pass-thru --> Pfsense igc0 [Vendor DMZ] 172.x.y.z
      nic4: pass-thru --> PfSense igc1 [WAN] DHCP

      pfSense is running on local storage but the Proxmox node has several VMs running on shared storage (TrueNAS ZFS over iSCSI) to support failover/migration

      Crash 2 - extensions were originally .1
      info.0 textdump.tar.0

      Crash 1
      info.0 textdump.tar.0

      A 1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by stephenw10

        There seems to be a known issue with Proxmox on Jasper Lake CPUs and this certainly fits the descriptions:
        https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/
        https://forum.netgate.com/post/1079708

        Do you see any other VMs crash?

        N 1 Reply Last reply Reply Quote 0
        • stephenw10S
          stephenw10 Netgate Administrator
          last edited by

          This post is deleted!
          1 Reply Last reply Reply Quote 0
          • A
            AdriftAtlas @notoriousimpatient
            last edited by

            @notoriousimpatient

            Yeah, this a known issue with KVM/QEMU on N5105/N6005. Unraid experiences the same symptoms as Proxmox as they're both based on the same hypervisor.

            It's not isolated to pfSense/OPNsense (FreeBSD) VMs. Ubuntu (Linux) VMs are also crashing. Host always stays up though.

            I'm currently trying out kernel 6.1.6 on Proxmox:
            https://forum.proxmox.com/threads/opt-in-linux-6-1-kernel-for-proxmox-ve-7-x-available.119483/

            No clear fix yet...

            1 Reply Last reply Reply Quote 1
            • N
              notoriousimpatient @stephenw10
              last edited by

              @stephenw10 No other crashes. I read the Proxmox thread and other Jasper Lake related posts. I've applied all of the workaround I could - most were performed before PfSense install. I'm running the latest Promox patches available in the pve-no-subscription repo.

              At the moment, I'm only experience unexplained hangs after logs are rotated in PfSense around 2 am. This is bearable since it's running at home and most of time we're sleep.

              I'll continue to watch the progress on the Proxmox side.

              T 1 Reply Last reply Reply Quote 0
              • T
                thebear @notoriousimpatient
                last edited by

                @notoriousimpatient how many vCPUs you have configured?

                N 1 Reply Last reply Reply Quote 0
                • jimpJ jimp referenced this topic on
                • jimpJ jimp referenced this topic on
                • A
                  AdriftAtlas
                  last edited by

                  The issue is fixed with 0x24000024 microcode:
                  https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/post-538922

                  1 Reply Last reply Reply Quote 2
                  • N
                    notoriousimpatient @thebear
                    last edited by

                    @thebear 2 vCPUs and 8G memory.

                    1 Reply Last reply Reply Quote 1
                    • jimpJ jimp moved this topic from General pfSense Questions on
                    • bmeeksB bmeeks referenced this topic on
                    • bmeeksB bmeeks referenced this topic on
                    • bmeeksB bmeeks referenced this topic on
                    • bmeeksB bmeeks referenced this topic on
                    • First post
                      Last post