Frr with get two BGP full route tables from Neighbors with openvpn Update Source

yon 0 · Nov 6, 2019, 9:01 AM

@jimp That could be from the RADIX_MPATH / multipath options we enabled in the kernel and FRR on 2.5.0 to allow for multi-path/ECMP routing. It's entirely possible the code doesn't work as well as it should, since it's not as heavily tested.

maybe should check this.

yon 0 · Nov 6, 2019, 12:32 PM

i had try use frr vtysh shell add two openvpn ipv6 address , it still down too. So i think the pf frr with openvpn has bug.

yon 0 · Nov 7, 2019, 5:48 PM

@jimp said in Frr with use two ipv6 BGP Neighbors openvpn Update Source:

There isn't enough information to say what exactly is wrong yet, and we haven't been able to reproduce any crashes here so far. So there is no ETA on a fix.

2.5.0 is under development, it's not expected to be stable at this point.

your try frr get two ipv6 full table upstream. why only has one ipv6 upstream is normal work.

frr and system bug

yon 0 · Nov 19, 2019, 7:44 PM

@jimp i try setup use openbgpd normarl work ipv6 with openvpn. so i think the frr sure has bugs.

yon 0 · Nov 21, 2019, 7:45 AM

frr v7.2 is out, we need for upgrade?

yon 0 · Nov 23, 2019, 6:17 AM

<118>Configuring LAGG interfaces...
<6>lagg0: IPv6 addresses on igb0 have been removed before adding it as a member to prevent IPv6 address scope violation.
<6>lagg0: link state changed to DOWN
<6>lagg0: IPv6 addresses on igb1 have been removed before adding it as a member to prevent IPv6 address scope violation.
<118>done.
<118>Configuring VLAN interfaces...
<6>vlan0: changing name to 'igb1.2'
<118>done.
<118>Configuring QinQ interfaces...done.
<118>Configuring IPsec VTI interfaces...done.
<118>Configuring WAN interface...
<6>ng0: changing name to 'pppoe0'
<6>igb2: link state changed to UP
<6>igb0: link state changed to UP
<6>igb1: link state changed to UP
<6>igb1.2: link state changed to UP
<118>done.
<118>Configuring LAN interface...done.
<118>Configuring WAN2 interface...
<6>ng1: changing name to 'pppoe2'
<6>igb3: link state changed to UP
<6>lagg0: link state changed to UP
<118>done.
<118>Configuring CARP settings...done.
<118>Syncing OpenVPN settings...
<6>tun7: changing name to 'ovpnc7'
<6>tun3: changing name to 'ovpnc3'
<6>tun9: changing name to 'ovpnc9'
<6>tun10: changing name to 'ovpnc10'
<6>tun11: changing name to 'ovpnc11'
<118>done.
<6>pflog0: promiscuous mode enabled
<118>Configuring firewall......done.
<118>Starting PFLOG...done.
<118>Setting up gateway monitors...done.
<118>Setting up static routes...done.
<118>Setting up DNSs...
<118>Synchronizing user settings...done.
<118>Starting webConfigurator...done.
<118>Configuring CRON...done.
<118>Starting NTP time client...done.
<118>Starting DHCP service...done.
<118>Starting DHCPv6 service...done.
<118>Configuring firewall......done.
<6>gif4: link state changed to DOWN
<6>gif4: link state changed to UP
<118>Generating RRD graphs...done.
<118>Starting UPnP service... done.
<6>gif0: link state changed to DOWN
<6>gif0: link state changed to UP
<118>Starting syslog...done.
<118>Starting CRON... done.
<118>>>> Removing unnecessary packages... done.
<118>>>> Cleanup pkg cache... done.
<118> Starting package Shellcmd...done.
<118> Starting package Cron...done.
<118> Starting package Backup...done.
<118> Starting package Filer...done.
<118> Starting package LADVD...done.
<118> Starting package iftop...done.
<118> Starting package mtr-nox11...done.
<118> Starting package RRD Summary...done.
<118> Starting package Service Watchdog...done.
<118> Starting package Notes...done.
<118> Starting package OpenBGPD...done.
<118> Starting package acme...done.
<118> Starting package Traffic Totals...done.
<118> Starting package System Patches...done.
<118> Starting package sudo...done.
<118> Starting package OpenVPN Client Export Utility...done.
<118> Starting package iperf...done.
<118> Starting /usr/local/etc/rc.d/bgpd.sh...done.
<118>pfSense 2.5.0-DEVELOPMENT amd64 Thu Nov 21 21:28:02 EST 2019
<118>Bootup complete
<6>ovpnc7: link state changed to UP
<6>ovpnc10: link state changed to UP
<6>ovpnc3: link state changed to UP
<6>ovpnc11: link state changed to UP
<6>ovpnc9: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc3: link state changed to DOWN
<6>ovpnc3: link state changed to UP
<6>ovpnc3: link state changed to DOWN
<6>ovpnc9: link state changed to DOWN
<6>ovpnc9: link state changed to UP
<6>ovpnc3: link state changed to UP
<6>re0: link state changed to DOWN
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<6>ovpnc7: link state changed to DOWN
<6>ovpnc7: link state changed to UP
<3>rn_delete: Orphaned Mask 0xfffff801c10ab060 at 0
<3>rn_delete: Orphaned Mask 0xfffff803c6d3b320 at 0
<3>rn_delete: Orphaned Mask 0xfffff8042a4741a0 at 0
<3>rn_delete: Orphaned Mask 0xfffff803c6e202c0 at 0
<3>rn_delete: Orphaned Mask 0xfffff801c0875a80 at 0
<3>rn_delete: couldn't find our annotation

Fatal trap 12: page fault while in kernel mode
cpuid = 1; apic id = 11
fault virtual address = 0x70
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80e7d451
stack pointer = 0x28:0xfffffe0095ab53c0
frame pointer = 0x28:0xfffffe0095ab54c0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 64872 (bgpd)
version.txt0600007113566056012 7535 ustarrootwheelFreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

yon 0 · Nov 30, 2019, 12:21 AM

<118> Starting package Service Watchdog...done.
<118> Starting package Notes...done.
<118> Starting package System Patches...done.
<118> Starting package iperf...done.
<118> Starting package FRR...done.
<118>pfSense 2.5.0-DEVELOPMENT amd64 Fri Nov 29 08:22:22 EST 2019
<118>Bootup complete
<6>ovpnc11: link state changed to UP
<6>ovpnc9: link state changed to UP
<6>ovpnc3: link state changed to UP
<6>ovpnc10: link state changed to UP
<6>ovpnc7: link state changed to UP
<3>rn_delete: couldn't find our annotation

Fatal trap 12: page fault while in kernel mode
cpuid = 3; apic id = 13
fault virtual address = 0x70
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80e7d451
stack pointer = 0x28:0xfffffe00944f43a0
frame pointer = 0x28:0xfffffe00944f44a0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 53160 (Zebra dplane)
version.txt0600007113570412703 7533 ustarrootwheelFreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

yon 0 · Dec 4, 2019, 12:42 PM

i need edit this, when frr got two or more and ipv4 or ipv6 full route tables from neighbors via openvpn update Source, then frr will down.

yon 0 · Dec 7, 2019, 6:04 PM

The results of repeated tests should be that there is a problem with the system, which has an impact on multiple BGP software, but it has the greatest impact on frr, causing the system to be paralyzed.

yon 0 · Dec 12, 2019, 3:16 AM

i have to change back to pf 2.4.4-p3, this version bgp work normal. so i think pfsense 2.5 has bugs now.

yon 0 · Dec 16, 2019, 6:51 AM

report

pf.txt

yon 0 · Dec 20, 2019, 10:42 PM

use openbgpd get the same issue.

pf-openbgpd.txt

yon 0 · Dec 25, 2019, 1:31 PM

@yon-0 said in Frr with get two BGP full route tables from Neighbors with openvpn Update Source:

openbgpd

openbgpd

pf-openbgpd.txt

yon 0 · Dec 29, 2019, 11:55 PM

Version String: FreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

pf.txt

yon 0 · Dec 31, 2019, 7:12 AM

2.5.0-DEVELOPMENT (amd64)
built on Sun Dec 29 11:28:22 EST 2019
FreeBSD 12.0-RELEASE-p10

Crash report pf.txt

yon 0 · Jan 1, 2020, 12:37 PM

2.5.0-DEVELOPMENT (amd64)
built on Sun Dec 29 11:28:22 EST 2019
FreeBSD 12.0-RELEASE-p10

FRR Crash report
pf.txt

yon 0 · Jan 5, 2020, 6:47 AM

the same config work in pf 2.4.4, but it is crash in pf2.5

2.5.0-DEVELOPMENT (amd64)
built on Fri Jan 03 22:01:28 EST 2020
FreeBSD 12.0-RELEASE-p10

pf.txt

yon 0 · Jan 6, 2020, 10:59 AM

2.5.0-DEVELOPMENT (amd64)
built on Sun Jan 05 00:41:14 EST 2020
FreeBSD 12.0-RELEASE-p10

pf.txt

yon 0 · Jan 7, 2020, 2:46 PM

amd64
12.0-RELEASE-p10
FreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

Crash report details:

No PHP errors found.

Filename: /var/crash/info.0
Dump header from device: /dev/label/swap0
Architecture: amd64
Architecture Version: 4
Dump Length: 154112
Blocksize: 512
Compression: none
Dumptime: Tue Jan 7 22:22:34 2020
Hostname:
Magic: FreeBSD Text Dump
Version String: FreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense
Panic String:
Dump Parity: 397621510
Bounds: 0
Dump Status: good

Filename: /var/crash/textdump.tar.0
ddb.txt06000014000013605112052 7065 ustarrootwheeldb:0:kdb.enter.default> run lockinfo
db:1:lockinfo> show locks
No such command; use "help" to list available commands
db:1:lockinfo> show alllocks
No such command; use "help" to list available commands
db:1:lockinfo> show lockedvnods
Locked vnodes
db:0:kdb.enter.default> show pcpu
cpuid = 2
dynamic pcpu = 0xfffffe008199dac0
curthread = 0xfffff80238bbd000: pid 49739 tid 100232 "bgpd"
curpcb = 0xfffffe0095a74b00
fpcurthread = 0xfffff80238bbd000: pid 49739 "bgpd"
idlethread = 0xfffff80004566000: tid 100005 "idle: cpu2"
curpmap = 0xfffff8023837c130
tssp = 0xffffffff82db74f0
commontssp = 0xffffffff82db74f0
rsp0 = 0xfffffe0095a74b00
gs32p = 0xffffffff82dbe128
ldt = 0xffffffff82dbe168
tss = 0xffffffff82dbe158
curvnet = 0xfffff80004088f40
db:0:kdb.enter.default> bt
Tracing pid 49739 tid 100232 td 0xfffff80238bbd000
rtrequest1_fib() at rtrequest1_fib+0x2b1/frame 0xfffffe0095a744c0
route_output() at route_output+0xc61/frame 0xfffffe0095a74740
sosend_generic() at sosend_generic+0x586/frame 0xfffffe0095a747f0
sosend() at sosend+0x50/frame 0xfffffe0095a74820
soo_write() at soo_write+0x33/frame 0xfffffe0095a74860
dofilewrite() at dofilewrite+0xb2/frame 0xfffffe0095a748b0
sys_writev() at sys_writev+0x70/frame 0xfffffe0095a74900
amd64_syscall() at amd64_syscall+0x369/frame 0xfffffe0095a74a30
fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0095a74a30
--- syscall (121, FreeBSD ELF64, sys_writev), rip = 0x80042090a, rsp = 0x7fffffffe928, rbp = 0x7fffffffeae0 ---
db:0:kdb.enter.default> ps

Fatal trap 12: page fault while in kernel mode
cpuid = 2; apic id = 12
fault virtual address = 0x70
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff80e7d451
stack pointer = 0x28:0xfffffe0095a743c0
frame pointer = 0x28:0xfffffe0095a744c0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 49739 (bgpd)
version.txt0600007113605112052 7524 ustarrootwheelFreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

yon 0 · Jan 9, 2020, 11:40 PM

pf.txt