New pfSense 2.6.0 installation crashing

pshaw

About once per day I am getting a crash report:

"Firewall has encountered an error"

This is a brand new installation on a Protectli Vault.

I am new to pfSense and openBSD so please tell me what you need (and how to get it) and thanks in advance for any troubleshooting you can help with!

My crash report is attached.

pfSense_Crash.txt

stephenw10

Back trace:

db:0:kdb.enter.default>  bt
Tracing pid 12 tid 100063 td 0xfffff8000549a000
kdb_enter() at kdb_enter+0x37/frame 0xfffffe00005b3870
vpanic() at vpanic+0x197/frame 0xfffffe00005b38c0
panic() at panic+0x43/frame 0xfffffe00005b3920
trap_fatal() at trap_fatal+0x391/frame 0xfffffe00005b3980
trap() at trap+0x67/frame 0xfffffe00005b3a90
calltrap() at calltrap+0x8/frame 0xfffffe00005b3a90
--- trap 0x1, rip = 0xffffffff803d96d2, rsp = 0xfffffe00005b3b60, rbp = 0xfffffe00005b3bb0 ---
daregister() at daregister+0x852/frame 0xfffffe00005b3bb0
xpt_done_process() at xpt_done_process+0x407/frame 0xfffffe00005b3bf0
xpt_done_direct() at xpt_done_direct+0x44/frame 0xfffffe00005b3c20
ahci_ch_intr_direct() at ahci_ch_intr_direct+0x105/frame 0xfffffe00005b3c60
ahci_intr() at ahci_intr+0xf1/frame 0xfffffe00005b3c90
ithread_loop() at ithread_loop+0x23c/frame 0xfffffe00005b3cf0
fork_exit() at fork_exit+0x7e/frame 0xfffffe00005b3d30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b3d30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Panic:

Fatal trap 1: privileged instruction fault while in kernel mode
cpuid = 3; apic id = 06
instruction pointer	= 0x20:0xffffffff803d96d2
stack pointer	        = 0x28:0xfffffe00005b3b60
frame pointer	        = 0x28:0xfffffe00005b3bb0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 12 (irq256: ahci0)
trap number		= 1
panic: privileged instruction fault
cpuid = 3
time = 1664799821
KDB: enter: panic

BT2:

db:0:kdb.enter.default>  bt
Tracing pid 21 tid 100110 td 0xfffff8000583b740
kdb_enter() at kdb_enter+0x37/frame 0xfffffe004a2a9920
vpanic() at vpanic+0x197/frame 0xfffffe004a2a9970
panic() at panic+0x43/frame 0xfffffe004a2a99d0
trap_fatal() at trap_fatal+0x391/frame 0xfffffe004a2a9a30
trap_pfault() at trap_pfault+0x4f/frame 0xfffffe004a2a9a80
trap() at trap+0x286/frame 0xfffffe004a2a9b90
calltrap() at calltrap+0x8/frame 0xfffffe004a2a9b90
--- trap 0xc, rip = 0xffffffff810844cb, rsp = 0xfffffe004a2a9c60, rbp = 0xfffffe004a2a9c80 ---
pf_state_expires() at pf_state_expires+0xb/frame 0xfffffe004a2a9c80
pf_purge_expired_states() at pf_purge_expired_states+0xd5/frame 0xfffffe004a2a9cc0
pf_purge_thread() at pf_purge_thread+0x10f/frame 0xfffffe004a2a9cf0
fork_exit() at fork_exit+0x7e/frame 0xfffffe004a2a9d30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe004a2a9d30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Panic2:

Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 04
fault virtual address	= 0x8000000011
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff810844cb
stack pointer	        = 0x28:0xfffffe004a2a9c60
frame pointer	        = 0x28:0xfffffe004a2a9c80
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 21 (pf purge)
trap number		= 12
panic: page fault
cpuid = 2
time = 1664816289
KDB: enter: panic

BT3:

db:0:kdb.enter.default>  bt
Tracing pid 31 tid 100243 td 0xfffff80027284740
kdb_enter() at kdb_enter+0x37/frame 0xfffffe000246fdc0
vpanic() at vpanic+0x197/frame 0xfffffe000246fe10
panic() at panic+0x43/frame 0xfffffe000246fe70
dblfault_handler() at dblfault_handler+0x1d1/frame 0xfffffe000246ff30
Xdblfault() at Xdblfault+0xd2/frame 0xfffffe000246ff30
--- trap 0x17, rip = 0xffffffff80ce1197, rsp = 0x2, rbp = 0xfffffe004e54e9f0 ---
g_part_start() at g_part_start+0x317/frame 0xfffffe004e54e9f0
g_io_request() at g_io_request+0x26d/frame 0xfffffe004e54ea40
zio_vdev_io_start() at zio_vdev_io_start+0x2a6/frame 0xfffffe004e54eaa0
zio_execute() at zio_execute+0xac/frame 0xfffffe004e54eaf0
zio_nowait() at zio_nowait+0xc7/frame 0xfffffe004e54eb30
vdev_mirror_io_start() at vdev_mirror_io_start+0x40f/frame 0xfffffe004e54ebb0
zio_vdev_io_start() at zio_vdev_io_start+0x159/frame 0xfffffe004e54ec10
zio_execute() at zio_execute+0xac/frame 0xfffffe004e54ec60
taskqueue_run_locked() at taskqueue_run_locked+0x144/frame 0xfffffe004e54ecc0
taskqueue_thread_loop() at taskqueue_thread_loop+0xb6/frame 0xfffffe004e54ecf0
fork_exit() at fork_exit+0x7e/frame 0xfffffe004e54ed30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe004e54ed30
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---

Panic3:

Fatal double fault
rip 0xffffffff80ce1197 rsp 0x2 rbp 0xfffffe004e54e9f0
rax 0xfffff800271eb200 rdx 0 rbx 0xfffff800272038d0
rcx 0xffffffff80ccca00 rsi 0xfffff800272038d0 rdi 0x2d
r8 0x6000 r9 0x198083b000 r10 0x6000
r11 0x200 r12 0xfffff80005863800 r13 0xfffff80027202200
r14 0xfffff800270c7380 r15 0xfffff800271c3900 rflags 0x10292
cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b
fsbase 0x800d0d0d0 gsbase 0xffffffff84212000 kgsbase 0
cpuid = 2; apic id = 04
panic: double fault
cpuid = 2
time = 1664837264
KDB: enter: panic

So 3 seemingly unrelated panics there. That's not good that's not a software issue. Random failures like that are often bad RAM. Run a memory checker through a few cycles to be sure.

Steve

pshaw

At work, will run memory checker tonight. Thanks for the suggestion!