Issues Panic String: double fault

netcat · Apr 21, 2023, 5:28 AM

****Does anyone know why this is happening?

It happens since I use version 2.7 of Pfsense**

Random crashes every 2 days - 1 day, sometimes

Latest version of Proxmox
Latest version of pfsense 2.7 DEV

Hypervisor: https://es.aliexpress.com/item/1005004326534253.html?spm=a2g0o.order_list.order_list_main.154.21ef194digXQhv&gatewayAdapt=glo2esp

ModelA Celeron N5105

NIC,S INTEL I226-V**

Crash report begins. Anonymous machine information:

amd64
14.0-CURRENT
FreeBSD 14.0-CURRENT #0 devel-main-n255842-696a2a414a0: Tue Apr 18 06:30:11 UTC 2023 root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-master-main/obj/amd64/IvdZpabB/var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-dev

Crash report details:

No PHP errors found.

Filename: /var/crash/info.0
Dump header from device: /dev/da0p2
Architecture: amd64
Architecture Version: 4
Dump Length: 97280
Blocksize: 512
Compression: none
Dumptime: 2023-04-20 21:18:55 +0200
Hostname: pfSense.hide.com
Magic: FreeBSD Text Dump
Version String: FreeBSD 14.0-CURRENT #0 devel-main-n255842-696a2a414a0: Tue Apr 18 06:30:11 UTC 2023
root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-master-main/obj/amd64/IvdZpabB/var/jenkins/w
Panic String: double fault
Dump Parity: 446368847
Bounds: 0
Dump Status: good

Filename: /var/crash/textdump.tar.0
ddb.txt��0600��0��0��140000��14420310037� 7064� ��ustar��root��wheel��db:3:kdb.enter.default> show registers
cs 0x20
ds 0x3b
es 0x3b
fs 0x13
gs 0x1b
ss 0x28
rax 0x12
rcx 0x1
rdx 0xffffffff814f7bcc
rbx 0x4
rsp 0xffffffff836a4530 idt0+0xb20
rbp 0xffffffff836a4530 idt0+0xb20
rsi 0x80
rdi 0xffffffff83542c60 cnputs_mtx
r8 0
r9 0x304f _binary_elf_vdso_so_1_size+0x2a3f
r10 0xffffffff83183658 vt_consdev
r11 0x19
r12 0x1
r13 0
r14 0xffffffff836a45c0 idt0+0xbb0
r15 0xfffffe00060063a0
rip 0xffffffff80dcea52 kdb_enter+0x32
rflags 0x82
kdb_enter+0x32: movq $0,0x27bf3b3(%rip)
db:3:kdb.enter.default> run lockinfo
Script stack too deep
db:3:kdb.enter.default> show pcpu
cpuid = 0
dynamic pcpu = 0x13f2280
curthread = 0xfffffe00060063a0: pid 11 tid 100003 critnest 2 "idle: cpu0"
curpcb = 0xfffffe00060068c0
fpcurthread = none
idlethread = 0xfffffe00060063a0: tid 100003 "idle: cpu0"
self = 0xffffffff84810000
curpmap = 0xffffffff83541f10
tssp = 0xffffffff84810384
rsp0 = 0xfffffe00051af000
kcr3 = 0xffffffffffffffff
ucr3 = 0xffffffffffffffff
scr3 = 0x4641000
gs32p = 0xffffffff84810404
ldt = 0xffffffff84810444
tss = 0xffffffff84810434
curvnet = 0
spin locks held:
db:3:kdb.enter.default> bt
Tracing pid 11 tid 100003 td 0xfffffe00060063a0
kdb_enter() at kdb_enter+0x32/frame 0xffffffff836a4530
vpanic() at vpanic+0x183/frame 0xffffffff836a4580
panic() at panic+0x43/frame 0xffffffff836a45e0
_epoch_enter_preempt() at _epoch_enter_preempt+0x156/frame 0xffffffff836a4600
tcp_rl_shutdown() at tcp_rl_shutdown+0x1f/frame 0xffffffff836a4650
kern_reboot() at kern_reboot+0x2ae/frame 0xffffffff836a4690
db_reset() at db_reset+0xc9/frame 0xffffffff836a46b0
db_command() at db_command+0x372/frame 0xffffffff836a4780
db_script_exec() at db_script_exec+0x1b8/frame 0xffffffff836a4830
db_script_kdbenter() at db_script_kdbenter+0x55/frame 0xffffffff836a4870
db_trap() at db_trap+0xe1/frame 0xffffffff836a4900
kdb_trap() at kdb_trap+0x1fd/frame 0xffffffff836a4970
trap() at trap+0x8c6/frame 0xffffffff836a4a90
calltrap() at calltrap+0x8/frame 0xffffffff836a4a90
--- trap 0x3, rip = 0xffffffff80dcea52, rsp = 0xffffffff836a4b60, rbp = 0xffffffff836a4b60 ---
kdb_enter() at kdb_enter+0x32/frame 0xffffffff836a4b60
vpanic() at vpanic+0x183/frame 0xffffffff836a4bb0
panic() at panic+0x43/frame 0xffffffff836a4c10
_epoch_enter_preempt() at _epoch_enter_preempt+0x156/frame 0xffffffff836a4c30
... more

netcat · Apr 21, 2023, 5:30 AM

<118>Bootup complete
lock order reversal:
1st 0xffffffff83652498 bpf global lock (bpf global lock, sx) @ /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/net/bpf.c:1519
2nd 0xffffffff83653810 vlan_sx (vlan_sx, sx) @ /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/net/if_vlan.c:2133
lock order bpf global lock -> vlan_sx attempted at:
#0 0xffffffff80df2253 at witness_checkorder+0xbb3
#1 0xffffffff80d8b9c3 at _sx_xlock+0x63
#2 0xffffffff80eddf13 at vlan_ioctl+0x203
#3 0xffffffff80ebf4c4 at if_setflag+0xe4
#4 0xffffffff80ebf38a at ifpromisc+0x2a
#5 0xffffffff80eae8c8 at bpfioctl+0xe98
#6 0xffffffff80bed5bc at devfs_ioctl+0xcc
#7 0xffffffff80e881aa at vn_ioctl+0xba
#8 0xffffffff80bedc6e at devfs_ioctl_f+0x1e
#9 0xffffffff80df7d6e at kern_ioctl+0x1fe
#10 0xffffffff80df7b04 at sys_ioctl+0x154
#11 0xffffffff8134d4f0 at amd64_syscall+0x140
#12 0xffffffff813205ab at fast_syscall_common+0xf8
<6>igc1: promiscuous mode enabled
<6>igc1.21: promiscuous mode enabled
lock order reversal:
1st 0xffffffff83652498 bpf global lock (bpf global lock, sx) @ /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/net/bpf.c:1519
2nd 0xfffff80005a0bd80 iflib ctx lock (iflib ctx lock, sx) @ /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/net/iflib.c:4525
lock order iflib ctx lock -> bpf global lock established at:
#0 0xffffffff80df199b at witness_checkorder+0x2fb
#1 0xffffffff80d8b9c3 at _sx_xlock+0x63
#2 0xffffffff80eac3a8 at bpfattach2+0xd8
#3 0xffffffff80ecbbdc at ether_ifattach+0xec
#4 0xffffffff80ee1217 at iflib_device_register+0xbf7
#5 0xffffffff80ee5a15 at iflib_device_attach+0xb5
#6 0xffffffff80dbd9e0 at device_attach+0x3c0
#7 0xffffffff80dbd590 at device_probe_and_attach+0x70
#8 0xffffffff80dbebe8 at bus_generic_attach+0x18
#9 0xffffffff809431f0 at pci_attach+0xe0
#10 0xffffffff81227a79 at acpi_pci_attach+0x19
#11 0xffffffff80dbd9e0 at device_attach+0x3c0
#12 0xffffffff80dbd590 at device_probe_and_attach+0x70
#13 0xffffffff80dbebe8 at bus_generic_attach+0x18
#14 0xffffffff8122acf2 at acpi_pcib_acpi_attach+0x432
#15 0xffffffff80dbd9e0 at device_attach+0x3c0
#16 0xffffffff80dbd590 at device_probe_and_attach+0x70
#17 0xffffffff80dbebe8 at bus_generic_attach+0x18
lock order bpf global lock -> iflib ctx lock attempted at:
#0 0xffffffff80df2253 at witness_checkorder+0xbb3
#1 0xffffffff80d8b9c3 at _sx_xlock+0x63
#2 0xffffffff80eed1a2 at iflib_if_ioctl+0x2e2
#3 0xffffffff80ebf4c4 at if_setflag+0xe4
#4 0xffffffff80ebf38a at ifpromisc+0x2a
#5 0xffffffff80eae8c8 at bpfioctl+0xe98
#6 0xffffffff80bed5bc at devfs_ioctl+0xcc
#7 0xffffffff80e881aa at vn_ioctl+0xba
#8 0xffffffff80bedc6e at devfs_ioctl_f+0x1e
#9 0xffffffff80df7d6e at kern_ioctl+0x1fe
#10 0xffffffff80df7b04 at sys_ioctl+0x154
#11 0xffffffff8134d4f0 at amd64_syscall+0x140
#12 0xffffffff813205ab at fast_syscall_common+0xf8
<6>igc0: promiscuous mode enabled
<6>igc1: link state changed to DOWN
<6>igc1.21: link state changed to DOWN
<6>igc1: link state changed to UP
<6>igc1.21: link state changed to UP

Fatal double fault
rip 0xffffffff8131fd10 rsp 0xffffffff836a59d0 rbp 0xfffffe00051aedd0
rax 0xf1e99c806d41 rdx 0xf1e900000000 rbx 0
rcx 0 rsi 0 rdi 0
r8 0 r9 0xfffff8000548bc00 r10 0xfffff8000548bc40
r11 0x80ca50fb r12 0xfffff80005775028 r13 0xfffffe0006001ab8
r14 0xf1e99c806d41 r15 0xfffff80005775000 rflags 0x10046
cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b
fsbase 0x2cf2da83f120 gsbase 0xffffffff84810000 kgsbase 0
cpuid = 0; apic id = 00
panic: double fault
cpuid = 0
time = 1682018335
KDB: enter: panic
panic: Assertion kstack_contains(td, (vm_offset_t)et, sizeof(*et)) failed at /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/kern/subr_epoch.c:473
cpuid = 0
time = 1682018335
KDB: enter: panic
panic: Assertion kstack_contains(td, (vm_offset_t)et, sizeof(*et)) failed at /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/kern/subr_epoch.c:473
cpuid = 0
time = 1682018335
KDB: enter: panic
panic: Assertion kstack_contains(td, (vm_offset_t)et, sizeof(*et)) failed at /var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/sys/kern/subr_epoch.c:473
cpuid = 0
time = 1682018335
KDB: enter: panic
panic.txt 0600 0 0 14 14420310037 7125 ustar root wheel double fault version.txt 0600 0 0 437 14420310037 7611 ustar root wheel FreeBSD 14.0-CURRENT #0 devel-main-n255842-696a2a414a0: Tue Apr 18 06:30:11 UTC 2023
root@freebsd:/var/jenkins/workspace/pfSense-CE-snapshots-master-main/obj/amd64/IvdZpabB/var/jenkins/workspace/pfSense-CE-snapshots-master-main/sources/FreeBSD-src-devel-main/amd64.amd64/sys/pfSense

jimp · Apr 21, 2023, 12:28 PM

Celeron N5105 is a Jasper Lake CPU, there are known issues with Proxmox on there but IIRC they are solved in the latest version of Proxmox with current CPU microcode. There are multiple threads about it on the Virtualization category here.