Secondary Pfsense Crash after CARP Configuration
-
I am stuck in an issues since last two weeks because my pfsense crashes and went into to endless loop of reboot whenever i configure CARP on seconday pfsense . Even i have tested on different hardwares and different versions old and latest of pfsense . Please if someone can guide
-
You must provide more detail about the crashes. Can you see any part of the error/backtrace/etc that happens? If you disconnect the sync cable does the reboot loop stop?
Are you using any limiters? (Limiters + pfsync is a known panic trigger for HA)
-
Hi
I have the same issue i am using 2.4.2 i followed the following video.Ā https://www.youtube.com/watch?v=gxIPHR-eX_U it works up until enabling carp then send my pfsense in a massive boot loops.
I do have limiters so maybe that could be the issue im facing.
-
You must provide more detail about the crashes. Can you see any part of the error/backtrace/etc that happens? If you disconnect the sync cable does the reboot loop stop?
Are you using any limiters? (Limiters + pfsync is a known panic trigger for HA)
Did you fix this?
-
No it is still an open bug.
Delete the limiters or disable pfsync.
-
No it is still an open bug.
Delete the limiters or disable pfsync.
Can you not uncheck the toggle for Traffic Shaper Limiters configuration & Traffic Shaper configuration?
Mat
-
If whatever you try works, yes.
It is a problem specific to limiters. The shaper itself (altq) works fine.
-
Thanks. I did try without it checked but still crashed. Iāll delete the limiters and try that instead.
Mat
-
Hi,
I solved mine with this ā¦ https://redmine.pfsense.org/issues/4310#note-44
Edwin
-
Hi again
i have deleted all my limiters and it still crashes.Ā here is the crash report.Ā HELP Please!
Crash report begins.Ā Anonymous machine information:
amd64
11.1-RELEASE-p4
FreeBSD 11.1-RELEASE-p4 #5 r313908+79c92265a31(RELENG_2_4): Mon Nov 20 08:18:22 CST 2017Ā Ā root@buildbot2.netgate.com:/builder/ce-242/tmp/obj/builder/ce-242/tmp/FreeBSD-src/sys/pfSenseCrash report details:
No PHP errors found.
Filename: /var/crash/bounds
1Filename: /var/crash/info.0
Dump header from device: /dev/gptid/78cabbc4-dad6-11e7-b9e4-005056b3ced1
Ā Architecture: amd64
Ā Architecture Version: 1
Ā Dump Length: 106496
Ā Blocksize: 512
Ā Dumptime: Sat DecĀ 9 17:23:14 2017
Ā Hostname: srvtcfw01
Ā Magic: FreeBSD Text Dump
Ā Version String: FreeBSD 11.1-RELEASE-p4 #5 r313908+79c92265a31(RELENG_2_4): Mon Nov 20 08:18:22 CST 2017
Ā Ā root@buildbot2.netgate.com:/builder/ce-242/tmp/obj/builder/ce-242/tmp/FreeBSD-src/sys/pfSense
Ā Panic String: pfsync_undefer_state: unable to find deferred state
Ā Dump Parity: 583539232
Ā Bounds: 0
Ā Dump Status: goodFilename: /var/crash/info.last
Dump header from device: /dev/gptid/78cabbc4-dad6-11e7-b9e4-005056b3ced1
Ā Architecture: amd64
Ā Architecture Version: 1
Ā Dump Length: 106496
Ā Blocksize: 512
Ā Dumptime: Sat DecĀ 9 17:23:14 2017
Ā Hostname: srvtcfw01
Ā Magic: FreeBSD Text Dump
Ā Version String: FreeBSD 11.1-RELEASE-p4 #5 r313908+79c92265a31(RELENG_2_4): Mon Nov 20 08:18:22 CST 2017
Ā Ā root@buildbot2.netgate.com:/builder/ce-242/tmp/obj/builder/ce-242/tmp/FreeBSD-src/sys/pfSense
Ā Panic String: pfsync_undefer_state: unable to find deferred state
Ā Dump Parity: 583539232
Ā Bounds: 0
Ā Dump Status: goodFilename: /var/crash/minfree
2048Filename: /var/crash/textdump.tar.0
ddb.txt06000014000013213016002Ā 7056 ustarrootwheeldb:0:kdb.enter.default>Ā run lockinfo
db:1:lockinfo> show locks
No such command
db:1:locks>Ā show alllocks
No such command
db:1:alllocks>Ā show lockedvnods
Locked vnodes
db:0:kdb.enter.default>Ā show pcpu
cpuidĀ Ā Ā Ā = 0
dynamic pcpu = 0x7ebf00
curthreadĀ Ā = 0xfffff80007d6f000: pid 15262 "openvpn"
curpcbĀ Ā Ā = 0xfffffe0096381cc0
fpcurthreadĀ = 0xfffff80007d6f000: pid 15262 "openvpn"
idlethreadĀ = 0xfffff8000351d000: tid 100003 "idle: cpu0"
curpmapĀ Ā Ā = 0xfffff80007d47138
tsspĀ Ā Ā Ā = 0xffffffff82a73b90
commontsspĀ = 0xffffffff82a73b90
rsp0Ā Ā Ā Ā = 0xfffffe0096381cc0
gs32pĀ Ā Ā Ā = 0xffffffff82a7a3e8
ldtĀ Ā Ā Ā Ā = 0xffffffff82a7a428
tssĀ Ā Ā Ā Ā = 0xffffffff82a7a418
db:0:kdb.enter.default>Ā bt
Tracing pid 15262 tid 100109 td 0xfffff80007d6f000
kdb_enter() at kdb_enter+0x3b/frame 0xfffffe0096381250
vpanic() at vpanic+0x1a3/frame 0xfffffe00963812d0
panic() at panic+0x43/frame 0xfffffe0096381330
pfsync_update_state() at pfsync_update_state+0x3c5/frame 0xfffffe0096381380
pf_test() at pf_test+0x21cf/frame 0xfffffe00963815c0
pf_check_out() at pf_check_out+0x1d/frame 0xfffffe00963815e0
pfil_run_hooks() at pfil_run_hooks+0x7b/frame 0xfffffe0096381670
ip_output() at ip_output+0x22b/frame 0xfffffe00963817c0
ip_forward() at ip_forward+0x323/frame 0xfffffe0096381860
ip_input() at ip_input+0x75a/frame 0xfffffe00963818c0
netisr_dispatch_src() at netisr_dispatch_src+0xa0/frame 0xfffffe0096381910
tunwrite() at tunwrite+0x226/frame 0xfffffe0096381950
devfs_write_f() at devfs_write_f+0xe2/frame 0xfffffe00963819b0
dofilewrite() at dofilewrite+0xc8/frame 0xfffffe0096381a00
sys_writev() at sys_writev+0x8c/frame 0xfffffe0096381a60
amd64_syscall() at amd64_syscall+0x6c4/frame 0xfffffe0096381bf0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0096381bf0
ā- syscall (121, FreeBSD ELF64, sys_writev), rip = 0x8015a581a, rsp = 0x7fffffffde18, rbp = 0x7fffffffde50 ---
db:0:kdb.enter.default>Ā ps
Ā pidĀ ppidĀ pgrpĀ uidĀ stateĀ wmesgĀ Ā Ā Ā wchanĀ Ā Ā Ā cmd
51715Ā 308Ā 308Ā Ā 0Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 php-fpm
49963 70428Ā 308Ā Ā 0Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 sleep
71262 71220 69187Ā Ā 0Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 sleep
71220Ā Ā 1 69187Ā Ā 0Ā SĀ Ā Ā waitĀ Ā 0xfffff8001c105000 sh
9738Ā 9585Ā 9738 65534Ā SsĀ Ā Ā sbwaitĀ 0xfffff800079fa4a4 darkstat
9585Ā Ā 1Ā 9585 65534Ā SsĀ Ā Ā selectĀ 0xfffff8001c237b40 darkstat
7039 71757Ā 7039Ā Ā 0Ā SsĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā sshlockout_pf
100091Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā piperdĀ 0xfffff8001c39f8e8 sshlockout_pf
100169Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 sshlockout_pf
6749Ā Ā 1Ā 6749Ā Ā 0Ā SsĀ Ā Ā selectĀ 0xfffff800074f9b40 bsnmpd
70428Ā Ā 1Ā 308Ā Ā 0Ā SĀ Ā Ā waitĀ Ā 0xfffff80007ea4000 sh
69866Ā Ā 1 69866Ā 136Ā SsĀ Ā Ā selectĀ 0xfffff80007f20cc0 dhcpd
63516Ā Ā 1 63516Ā Ā 59Ā SsĀ Ā Ā kqreadĀ 0xfffff80007744900 unbound
52767Ā Ā 1 52767Ā Ā 0Ā SsĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā dpinger
100156Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā uwaitĀ Ā 0xfffff8001c278080 dpinger
100165Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā sbwaitĀ 0xfffff800079f8144 dpinger
100166Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 dpinger
100167Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 dpinger
100168Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā acceptĀ 0xfffff800079f906c dpinger
52697Ā Ā 1 52697Ā Ā 0Ā SsĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā dpinger
100155Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā uwaitĀ Ā 0xfffff8001c2fbf00 dpinger
100161Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā sbwaitĀ 0xfffff80007be1144 dpinger
100162Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 dpinger
100163Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 dpinger
100164Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā acceptĀ 0xfffff800076bc3cc dpinger
Ā 415Ā Ā 1Ā 415Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff80007504cb0 getty
Ā 407Ā Ā 1Ā 407Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800075050b0 getty
Ā 123Ā Ā 1Ā 123Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800075054b0 getty
99998Ā Ā 1 99998Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800075058b0 getty
99937Ā Ā 1 99937Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800074d78b0 getty
99644Ā Ā 1 99644Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800074b00b0 getty
99639Ā Ā 1 99639Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800074ae8b0 getty
99388Ā Ā 1 99388Ā Ā 0Ā Ss+Ā Ā ttyinĀ Ā 0xfffff800074ae4b0 getty
82736Ā Ā 1 82213Ā Ā 0Ā SĀ Ā Ā selectĀ 0xfffff8001c0ec340 vmtoolsd
79421 78825 78825Ā Ā 0Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 minicron
78825Ā Ā 1 78825Ā Ā 0Ā SsĀ Ā Ā waitĀ Ā 0xfffff800079c3000 minicron
77900 77877 77877Ā Ā 0Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 minicron
77877Ā Ā 1 77877Ā Ā 0Ā SsĀ Ā Ā waitĀ Ā 0xfffff800079c4000 minicron
77783 77255 77255Ā Ā 0Ā SĀ Ā Ā nanslpĀ 0xffffffff828b51e0 minicron
77255Ā Ā 1 77255Ā Ā 0Ā SsĀ Ā Ā waitĀ Ā 0xfffff800079c5000 minicron
71757Ā Ā 1 71757Ā Ā 0Ā SsĀ Ā Ā selectĀ 0xfffff80007617cc0 syslogd
32516Ā Ā 1 32516Ā Ā 0Ā SsĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā ntpd
100117Ā Ā Ā Ā Ā Ā Ā Ā Ā SĀ Ā Ā selectĀ 0xfffff80007daae40 ntpd
31992Ā Ā 1 31992Ā Ā 0Ā SsĀ Ā Ā nanslpĀ 0xffffffff828b51e0 cron
31697 31441 31441Ā Ā 0Ā SĀ Ā Ā kqreadĀ 0xfffff80007d5f100 nginx
31679 31441 31441Ā Ā 0Ā SĀ Ā Ā kqreadĀ 0xfffff80007d5f200 nginx
31441Ā Ā 1 31441Ā Ā 0Ā SsĀ Ā Ā pauseĀ Ā 0xfffff8000754d630 nginx
15591Ā Ā 1 15591Ā Ā 0Ā SsĀ Ā Ā bpfĀ Ā Ā 0xfffff80007bdca00 filterlog
15262Ā Ā 1 15262Ā Ā 0Ā RsĀ Ā Ā CPU 0Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā openvpn
14091Ā Ā 1 14091Ā Ā 0Ā SsĀ Ā Ā selectĀ 0xfffff80007cde3c0 openvpn
7334Ā Ā 1Ā 7334Ā Ā 0Ā SsĀ Ā Ā selectĀ 0xfffff800074f71c0 sshd
Ā 336Ā Ā 1Ā 336Ā Ā 0Ā SsĀ Ā Ā selectĀ 0xfffff800074f60c0 devd
Ā 324Ā 322Ā 322Ā Ā 0Ā SĀ Ā Ā kqreadĀ 0xfffff80007745600 check_reload_status
Ā 322Ā Ā 1Ā 322Ā Ā 0Ā SsĀ Ā Ā kqreadĀ 0xfffff80007745500 check_reload_status
Ā 308Ā Ā 1Ā 308Ā Ā 0Ā SsĀ Ā Ā kqreadĀ 0xfffff80007746100 php-fpm
Ā 58Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā mdwaitĀ 0xfffff80007524800 [md0]
Ā 25Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā syncerĀ 0xffffffff829aee00 [syncer]
Ā 24Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā vlruwtĀ 0xfffff8000754a588 [vnlru]
Ā 23Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā [bufdaemon]
100083Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā psleepĀ 0xffffffff829ad604 [bufdaemon]
100092Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā sdflushĀ 0xfffff8000752b8e8 [/ worker]
Ā 22Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xffffffff829ae2bc [bufspacedaemon]
Ā 21Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā pgzeroĀ 0xffffffff829c2a64 [pagezero]
Ā 20Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā psleepĀ 0xffffffff829bef14 [vmdaemon]
Ā 19Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā [pagedaemon]
100079Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā psleepĀ 0xffffffff82a72f85 [pagedaemon]
100086Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā laundsĀ 0xffffffff829beec4 [laundry: dom0]
100087Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā umarclĀ 0xffffffff829be838 [uma]
Ā 18Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xffffffff829ace14 [soaiod4]
Ā 17Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xffffffff829ace14 [soaiod3]
Ā 16Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xffffffff829ace14 [soaiod2]
Ā 15Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xffffffff829ace14 [soaiod1]
Ā Ā 9Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xffffffff82789700 [rand_harvestq]
Ā Ā 8Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā pftmĀ Ā 0xffffffff80e930b0 [pf purge]
Ā Ā 7Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā waiting_ 0xffffffff82a61d70 [sctp_iterator]
Ā Ā 6Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā -Ā Ā Ā Ā 0xfffff800039c4448 [fdc0]
Ā Ā 5Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā idleĀ Ā 0xfffffe0000ee1000 [mpt_recovery0]
Ā Ā 4Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā [cam]
100020Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xffffffff8265c480 [doneq0]
100074Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xffffffff8265c2c8 [scanner]
Ā Ā 3Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā crypto_r 0xffffffff829bd3f0 [crypto returns]
Ā Ā 2Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā crypto_w 0xffffffff829bd298 [crypto]
Ā 14Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā [geom]
100014Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xffffffff82a39e20 [g_event]
100015Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xffffffff82a39e28 [g_up]
100016Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xffffffff82a39e30 [g_down]
Ā 13Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā sleepĀ Ā 0xffffffff82615c70 [ng_queue0]
Ā 12Ā Ā 0Ā Ā 0Ā Ā 0Ā WLĀ Ā Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā [intr]
100004Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi1: netisr 0]
100005Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi3: vm]
100006Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi4: clock (0)]
100008Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi6: task queue]
100009Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi6: Giant taskq]
100012Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi5: fast taskq]
100021Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq14: ata0]
100022Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq15: ata1]
100023Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq17: mpt0]
100025Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq256: ahci0]
100026Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq257: pcib3]
100027Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq258: vmx0]
100028Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq259: pcib4]
100029Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq260: pcib5]
100030Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq261: pcib6]
100031Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq262: pcib7]
100032Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq263: pcib8]
100033Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq264: pcib9]
100034Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq265: pcib10]
100035Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq266: pcib11]
100036Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq267: vmx1]
100037Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq268: pcib12]
100038Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq269: pcib13]
100039Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq270: pcib14]
100040Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq271: pcib15]
100041Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq272: pcib16]
100042Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq273: pcib17]
100043Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq274: pcib18]
100044Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq275: pcib19]
100045Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq276: vmx2]
100046Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq277: pcib20]
100047Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq278: pcib21]
100048Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq279: pcib22]
100049Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq280: pcib23]
100050Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq281: pcib24]
100051Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq282: pcib25]
100052Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq283: pcib26]
100053Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq284: pcib27]
100054Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq285: pcib28]
100055Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq286: pcib29]
100056Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq287: pcib30]
100057Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq288: pcib31]
100058Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq289: pcib32]
100059Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq290: pcib33]
100060Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq291: pcib34]
100061Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq1: atkbd0]
100062Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [irq12: psm0]
100067Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi1: pf send]
100068Ā Ā Ā Ā Ā Ā Ā Ā Ā IĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [swi1: pfsync]
Ā 11Ā Ā 0Ā Ā 0Ā Ā 0Ā RLĀ Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā Ā [idle: cpu0]
Ā Ā 1Ā Ā 0Ā Ā 1Ā Ā 0Ā SLsĀ Ā waitĀ Ā 0xfffff80003518588 [init]
Ā 10Ā Ā 0Ā Ā 0Ā Ā 0Ā DLĀ Ā Ā audit_wo 0xffffffff82a68f40 [audit]
Ā Ā 0Ā Ā 0Ā Ā 0Ā Ā 0Ā DLsĀ Ā (threaded)Ā Ā Ā Ā Ā Ā Ā Ā Ā [kernel]
100000Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā swapinĀ 0xffffffff82a39e68 [swapper]
100007Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xfffff80003507900 [kqueue_ctx taskq]
100010Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xfffff80003507100 [aiod_kick taskq]
100011Ā Ā Ā Ā Ā Ā Ā Ā Ā DĀ Ā Ā -Ā Ā Ā Ā 0xfffff80003506e00 -
Also been reading that the WAN has to be on the same NIC interface on backup cluster?
Im using vmware on both boxes so does that mean same vswitch?
-
Also be sure you remove all the calls to the limiters in the rules.
Disable state syncing on both nodes and try again. Does it still crash? If so you might be looking at a different problem.
Also been reading that the WAN has to be on the same NIC interface on backup cluster?
ALL NICs have to be the same on both nodes in the same order. If WAN is igb0 on the primary, WAN has to be igb0 on the secondary, and so on. Generally not the source of a panic however, just "unexpected" behavior.
You might want to start again - small, and get WAN+LAN working in a very basic HA pair before moving on to more advanced configurations. They're VMs. It don't cost nothin'.
Both nodes have to be able to pass multicast between each other.
Inability to do so will not result in a crash, however, but a MASTER/MASTER split brain issue.
-
Thanks
I think the problem i have is the interfaces arent the same so ill have to try and move stuff around to get same interface names.
so it has to be the same physical nic its not based on virtual nic?
Mat
-
An interface has a physical name (em0, re0, igb0, xn0, igb0.1000, lagg2.1001) and an internal name (wan, lan, opt1, opt2, opt3, optX).
They all have to match exactly on both nodes.
Use Status > Interfaces to verify.
This is all covered in detail here: https://portal.pfsense.org/docs/book/highavailability/index.html
-
An interface has a physical name (em0, re0, igb0, xn0, igb0.1000, lagg2.1001) and an internal name (wan, lan, opt1, opt2, opt3, optX).
They all have to match exactly on both nodes.
Use Status > Interfaces to verify.
This is all covered in detail here: https://portal.pfsense.org/docs/book/highavailability/index.html
Painful lol.
Internally they are all named the same but physical there not so ill have to change some bits around.
few more days of playing then.
-
Ok set up quick test boxes on same host for now.Ā all HA works however cant ping the LAN Virtual IP until i set the MAC as static on the hosts.
Now i can ping but its up and down like a yoyo.
Any ideas?
-
https://doc.pfsense.org/index.php/CARP_Configuration_Troubleshooting
-
https://doc.pfsense.org/index.php/CARP_Configuration_Troubleshooting
I have done the
Enable promiscuous mode on the vSwitch
Enable "MAC Address changes"
Enable "Forged transmits"I have VM_Prod for VMS
I now have another port group of VM_Prod-PF and changed pfsense LAN to this port group.
Same problem though.
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Request timed out.
Request timed out.
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Request timed out.
Request timed out. -
Sorry. Runs great under XenServer. Someone else will have to help with VMware. It's certainly something in your virtual environment.
Moving to Virtualization.
-
Thanks for your help up to now anyway.
Anyone had this issue?
Cant ping virtual ip until the following is enabled
Enable promiscuous mode on the vSwitch
Enable "MAC Address changes"
Enable "Forged transmits"Once enabled i start to get ping return but it times out.
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Request timed out.
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=40ms TTL=64
Reply from 192.168.50.254: bytes=32 time=56ms TTL=64
Reply from 192.168.50.254: bytes=32 time=72ms TTL=64
Reply from 192.168.50.254: bytes=32 time=90ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=2ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
Request timed out.
Request timed out.
Reply from 192.168.50.254: bytes=32 time=1ms TTL=64
