PfSense Crash under Proxmox 7.3

[notoriousimpatient]

I've had two crashes of PfSense 22.05 under proxmox 7.3. I moved to 22.05 due to Intel V-226 nics.

High level setup:

• pass-thru NIC for WAN traffic [WAN during install]
• virtio for proxmox bridge that carries management traffic [VLAN created during install and later renamed from LAN to MGMT]
• virtio for proxmox bridge network traffic
• pass-thru NIC for Vendor-managed DMZ

ProxMox
nic1: Linux bridge --> VLAN 10.99.0.11 Proxmox management
----- virtio --> VLAN 99 10.99.0.21 PfSense [LAN renamed MGMT]
nic2: Linux bridge --> VLAN 20, VLAN 30 for Proxmox VMs
----- virtio --> VLAN 20 10.20.0.1 for PfSense routing/firewall
-----> VLAN 30 10.30.0.1 for PfSense routing/firewall
nic3: pass-thru --> Pfsense igc0 [Vendor DMZ] 172.x.y.z
nic4: pass-thru --> PfSense igc1 [WAN] DHCP

pfSense is running on local storage but the Proxmox node has several VMs running on shared storage (TrueNAS ZFS over iSCSI) to support failover/migration

Crash 2 - extensions were originally .1
info.0 textdump.tar.0

Crash 1
info.0 textdump.tar.0

[stephenw10]

There seems to be a known issue with Proxmox on Jasper Lake CPUs and this certainly fits the descriptions:
https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/
https://forum.netgate.com/post/1079708

Do you see any other VMs crash?

[stephenw10]

This post is deleted!

[AdriftAtlas]

@notoriousimpatient

Yeah, this a known issue with KVM/QEMU on N5105/N6005. Unraid experiences the same symptoms as Proxmox as they're both based on the same hypervisor.

It's not isolated to pfSense/OPNsense (FreeBSD) VMs. Ubuntu (Linux) VMs are also crashing. Host always stays up though.

I'm currently trying out kernel 6.1.6 on Proxmox:
https://forum.proxmox.com/threads/opt-in-linux-6-1-kernel-for-proxmox-ve-7-x-available.119483/

No clear fix yet...

[notoriousimpatient]

@stephenw10 No other crashes. I read the Proxmox thread and other Jasper Lake related posts. I've applied all of the workaround I could - most were performed before PfSense install. I'm running the latest Promox patches available in the pve-no-subscription repo.

At the moment, I'm only experience unexplained hangs after logs are rotated in PfSense around 2 am. This is bearable since it's running at home and most of time we're sleep.

I'll continue to watch the progress on the Proxmox side.

[thebear]

@notoriousimpatient how many vCPUs you have configured?

[AdriftAtlas]

The issue is fixed with 0x24000024 microcode:
https://forum.proxmox.com/threads/vm-freezes-irregularly.111494/post-538922

[notoriousimpatient]

@thebear 2 vCPUs and 8G memory.