PFSense/Netgate c2758 Crashing issue (2.4.1-RELEASE)
-
Hello all,
I'm trying to determine why my PFSense C2758 netgate box started crashing this morning. It runs for a few hours and then dies again. The tail of the crash reporter is posted below. I'm trying to isolate whether this is the clock signal issue (CPU failing) or something else. The I/O channel check is leading me to think the SSD or controller has failed.
===========Tail of log===============
<2>NMI ISA 60, EISA 0
<2>I/O channel check, likely hardware failure.
panic: NMI indicates hardware failure
cpuid = 3
KDB: enter: panic
panic.txt0600003613202135560 7134 ustarrootwheelNMI indicates hardware failureversion.txt06000027313202135560 7612 ustarrootwheelFreeBSD 11.1-RELEASE-p2 #6 r313908+7eae9364d25(RELENG_2_4): Sun Oct 22 17:32:35 CDT 2017
root@buildbot2.netgate.com:/builder/ce-241/tmp/obj/builder/ce-241/tmp/FreeBSD-src/sys/pfSense============end tail of log===========
Another interesting point in the log I found was this:
==========log snippet============
Filename: /var/crash/textdump.tar.0
ddb.txt06000014000013202135560 7067 ustarrootwheeldb:0:kdb.enter.default> run lockinfo
db:1:lockinfo> show locks
No such command
db:1:locks> show alllocks
No such command
db:1:alllocks> show lockedvnods
Locked vnodes
db:0:kdb.enter.default> show pcpu
cpuid = 3
dynamic pcpu = 0xfffffe0097d3af80
curthread = 0xfffff8000339c560: pid 11 "idle: cpu3"
curpcb = 0xfffffe001a3d5cc0
fpcurthread = none
idlethread = 0xfffff8000339c560: tid 100006 "idle: cpu3"
curpmap = 0xffffffff82a3aa40
tssp = 0xffffffff82a73c48
commontssp = 0xffffffff82a73c48
rsp0 = 0xfffffe001a3d5cc0
gs32p = 0xffffffff82a7a4a0
ldt = 0xffffffff82a7a4e0
tss = 0xffffffff82a7a4d0
db:0:kdb.enter.default> bt
Tracing pid 11 tid 100006 td 0xfffff8000339c560
kdb_enter() at kdb_enter+0x3b/frame 0xfffffe001a394c20
vpanic() at vpanic+0x1a3/frame 0xfffffe001a394ca0
panic() at panic+0x43/frame 0xfffffe001a394d00
nmi_call_kdb() at nmi_call_kdb+0x77/frame 0xfffffe001a394d30
nmi_call_kdb_smp() at nmi_call_kdb_smp+0x44/frame 0xfffffe001a394d60
trap() at trap+0x298/frame 0xfffffe001a394f20
nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe001a394f20
–- trap 0x13, rip = 0xffffffff8123436a, rsp = 0xfffffe001a3d5ad0, rbp = 0xfffffe001a3d5ae0 ---
cpu_idle() at cpu_idle+0xba/frame 0xfffffe001a3d5ae0
sched_idletd() at sched_idletd+0xca/frame 0xfffffe001a3d5bb0
fork_exit() at fork_exit+0x85/frame 0xfffffe001a3d5bf0
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe001a3d5bf0
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
db:0:kdb.enter.default> ps===============end log snippet=================
This might point to core 3 being dead? The system is likely out of warranty so just looking to see if I should find a replacement board or scrap it altogether. Lesson learned, second hand is not always a good idea.
Thanks all.
-
Definitely is a hardware issue, though it's not clear what it is. The cpuid isn't necessarily related there.
How old is the device? Even if it's out of the Netgate warranty it may still be under warranty from Supermicro
