2020.05 Report

yon 0

Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 10
fault virtual address = 0x70
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80ebbde6
stack pointer = 0x28:0xfffffe0097fc44e0
frame pointer = 0x28:0xfffffe0097fc45d0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 52022 (zebra_dplane)
trap number = 12
panic: page fault
cpuid = 0
time = 1589051672
KDB: enter: panic
panic.txt0600001213655600430 7133 ustarrootwheelpage faultversion.txt0600006213655600430 7533 ustarrootwheelFreeBSD 12.1-STABLE c06426ac255(devel-12) pfSense

jimp

Tracing pid 52022 tid 101001 td 0xfffff8042ce89740
kdb_enter() at kdb_enter+0x37/frame 0xfffffe0097fc4140
vpanic() at vpanic+0x19a/frame 0xfffffe0097fc41a0
panic() at panic+0x43/frame 0xfffffe0097fc4200
trap_pfault() at trap_pfault/frame 0xfffffe0097fc4270
trap_pfault() at trap_pfault+0x4f/frame 0xfffffe0097fc42e0
trap() at trap+0x288/frame 0xfffffe0097fc4410
calltrap() at calltrap+0x8/frame 0xfffffe0097fc4410
--- trap 0xc, rip = 0xffffffff80ebbde6, rsp = 0xfffffe0097fc44e0, rbp = 0xfffffe0097fc45d0 ---
rtrequest1_fib() at rtrequest1_fib+0x296/frame 0xfffffe0097fc45d0
route_output() at route_output+0xd95/frame 0xfffffe0097fc4850
sosend_generic() at sosend_generic+0x4ea/frame 0xfffffe0097fc4900
sosend() at sosend+0x50/frame 0xfffffe0097fc4930
soo_write() at soo_write+0x32/frame 0xfffffe0097fc4970
dofilewrite() at dofilewrite+0xb0/frame 0xfffffe0097fc49c0
sys_write() at sys_write+0xc0/frame 0xfffffe0097fc4a30
amd64_syscall() at amd64_syscall+0x357/frame 0xfffffe0097fc4b70
fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0097fc4b70

Looks like it's still failing in route table operations.

jimp

That backtrace appears to match https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=241191

I also added more notes to https://redmine.pfsense.org/issues/9544

yon 0

yes, Should be caused by this reason route always has the bugs.

yon 0

Is there any progress in solving this problem?

jimp

Not yet. Any progress will be reported on the Redmine issue linked above.

w0w

@jimp
Do we have any option to disable RADIX_MPATH, other then compile kernel without this option enabled?

jimp

No. It must be changed in the kernel configuration.

yon 0

2020.08 report

<118>pfSense 2.5.0-DEVELOPMENT amd64 Thu Aug 13 13:04:02 EDT 2020
<118>Bootup complete
<6>ovpnc3: link state changed to UP
<6>ovpnc7: link state changed to UP
<3>rn_delete: couldn't find our annotation


Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 11
fault virtual address	= 0x70
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff80ecad66
stack pointer	        = 0x28:0xfffffe00899844f0
frame pointer	        = 0x28:0xfffffe00899845e0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= interrupt enabled, resume, IOPL = 0
current process		= 31031 (zebra)
trap number		= 12
panic: page fault
cpuid = 1
time = 1597357663
KDB: enter: panic
panic.txt0600001213715337137  7143 ustarrootwheelpage faultversion.txt0600006213715337137  7543 ustarrootwheelFreeBSD 12.1-STABLE 1424107d9b0(devel-12) pfSense

yon 0

pkg install pfSense-pkg-frr
Updating pfSense-core repository catalogue...
Fetching meta.txz: 100% 916 B 0.9kB/s 00:01
Fetching packagesite.txz: 100% 2 KiB 1.8kB/s 00:01
Processing entries: 100%
pfSense-core repository update completed. 7 packages processed.
Updating pfSense repository catalogue...
Fetching meta.conf: 100% 163 B 0.2kB/s 00:01
Fetching packagesite.txz: 100% 137 KiB 2.7kB/s 00:51
Processing entries: 0%
Newer FreeBSD version for package cpustats:
To ignore this error set IGNORE_OSVERSION=yes

package: 1201519
running kernel: 1200086
Ignore the mismatch and continue? [Y/n]: y