Frr with get two BGP full route tables from Neighbors with openvpn Update Source


  • Rebel Alliance Developer Netgate

    There isn't enough information to say what exactly is wrong yet, and we haven't been able to reproduce any crashes here so far. So there is no ETA on a fix.

    2.5.0 is under development, it's not expected to be stable at this point.



  • @jimp That could be from the RADIX_MPATH / multipath options we enabled in the kernel and FRR on 2.5.0 to allow for multi-path/ECMP routing. It's entirely possible the code doesn't work as well as it should, since it's not as heavily tested.

    maybe should check this.



  • i had try use frr vtysh shell add two openvpn ipv6 address , it still down too. So i think the pf frr with openvpn has bug.



  • @jimp said in Frr with use two ipv6 BGP Neighbors openvpn Update Source:

    There isn't enough information to say what exactly is wrong yet, and we haven't been able to reproduce any crashes here so far. So there is no ETA on a fix.

    2.5.0 is under development, it's not expected to be stable at this point.

    your try frr get two ipv6 full table upstream. why only has one ipv6 upstream is normal work.

    frr and system bug



  • @jimp i try setup use openbgpd normarl work ipv6 with openvpn. so i think the frr sure has bugs.



  • frr v7.2 is out, we need for upgrade?



  • <118>Configuring LAGG interfaces...
    <6>lagg0: IPv6 addresses on igb0 have been removed before adding it as a member to prevent IPv6 address scope violation.
    <6>lagg0: link state changed to DOWN
    <6>lagg0: IPv6 addresses on igb1 have been removed before adding it as a member to prevent IPv6 address scope violation.
    <118>done.
    <118>Configuring VLAN interfaces...
    <6>vlan0: changing name to 'igb1.2'
    <118>done.
    <118>Configuring QinQ interfaces...done.
    <118>Configuring IPsec VTI interfaces...done.
    <118>Configuring WAN interface...
    <6>ng0: changing name to 'pppoe0'
    <6>igb2: link state changed to UP
    <6>igb0: link state changed to UP
    <6>igb1: link state changed to UP
    <6>igb1.2: link state changed to UP
    <118>done.
    <118>Configuring LAN interface...done.
    <118>Configuring WAN2 interface...
    <6>ng1: changing name to 'pppoe2'
    <6>igb3: link state changed to UP
    <6>lagg0: link state changed to UP
    <118>done.
    <118>Configuring CARP settings...done.
    <118>Syncing OpenVPN settings...
    <6>tun7: changing name to 'ovpnc7'
    <6>tun3: changing name to 'ovpnc3'
    <6>tun9: changing name to 'ovpnc9'
    <6>tun10: changing name to 'ovpnc10'
    <6>tun11: changing name to 'ovpnc11'
    <118>done.
    <6>pflog0: promiscuous mode enabled
    <118>Configuring firewall......done.
    <118>Starting PFLOG...done.
    <118>Setting up gateway monitors...done.
    <118>Setting up static routes...done.
    <118>Setting up DNSs...
    <118>Synchronizing user settings...done.
    <118>Starting webConfigurator...done.
    <118>Configuring CRON...done.
    <118>Starting NTP time client...done.
    <118>Starting DHCP service...done.
    <118>Starting DHCPv6 service...done.
    <118>Configuring firewall......done.
    <6>gif4: link state changed to DOWN
    <6>gif4: link state changed to UP
    <118>Generating RRD graphs...done.
    <118>Starting UPnP service... done.
    <6>gif0: link state changed to DOWN
    <6>gif0: link state changed to UP
    <118>Starting syslog...done.
    <118>Starting CRON... done.
    <118>>>> Removing unnecessary packages... done.
    <118>>>> Cleanup pkg cache... done.
    <118> Starting package Shellcmd...done.
    <118> Starting package Cron...done.
    <118> Starting package Backup...done.
    <118> Starting package Filer...done.
    <118> Starting package LADVD...done.
    <118> Starting package iftop...done.
    <118> Starting package mtr-nox11...done.
    <118> Starting package RRD Summary...done.
    <118> Starting package Service Watchdog...done.
    <118> Starting package Notes...done.
    <118> Starting package OpenBGPD...done.
    <118> Starting package acme...done.
    <118> Starting package Traffic Totals...done.
    <118> Starting package System Patches...done.
    <118> Starting package sudo...done.
    <118> Starting package OpenVPN Client Export Utility...done.
    <118> Starting package iperf...done.
    <118> Starting /usr/local/etc/rc.d/bgpd.sh...done.
    <118>pfSense 2.5.0-DEVELOPMENT amd64 Thu Nov 21 21:28:02 EST 2019
    <118>Bootup complete
    <6>ovpnc7: link state changed to UP
    <6>ovpnc10: link state changed to UP
    <6>ovpnc3: link state changed to UP
    <6>ovpnc11: link state changed to UP
    <6>ovpnc9: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc3: link state changed to DOWN
    <6>ovpnc3: link state changed to UP
    <6>ovpnc3: link state changed to DOWN
    <6>ovpnc9: link state changed to DOWN
    <6>ovpnc9: link state changed to UP
    <6>ovpnc3: link state changed to UP
    <6>re0: link state changed to DOWN
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <6>ovpnc7: link state changed to DOWN
    <6>ovpnc7: link state changed to UP
    <3>rn_delete: Orphaned Mask 0xfffff801c10ab060 at 0
    <3>rn_delete: Orphaned Mask 0xfffff803c6d3b320 at 0
    <3>rn_delete: Orphaned Mask 0xfffff8042a4741a0 at 0
    <3>rn_delete: Orphaned Mask 0xfffff803c6e202c0 at 0
    <3>rn_delete: Orphaned Mask 0xfffff801c0875a80 at 0
    <3>rn_delete: couldn't find our annotation

    Fatal trap 12: page fault while in kernel mode
    cpuid = 1; apic id = 11
    fault virtual address = 0x70
    fault code = supervisor read data, page not present
    instruction pointer = 0x20:0xffffffff80e7d451
    stack pointer = 0x28:0xfffffe0095ab53c0
    frame pointer = 0x28:0xfffffe0095ab54c0
    code segment = base 0x0, limit 0xfffff, type 0x1b
    = DPL 0, pres 1, long 1, def32 0, gran 1
    processor eflags = interrupt enabled, resume, IOPL = 0
    current process = 64872 (bgpd)
    version.txt0600007113566056012 7535 ustarrootwheelFreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense



  • <118> Starting package Service Watchdog...done.
    <118> Starting package Notes...done.
    <118> Starting package System Patches...done.
    <118> Starting package iperf...done.
    <118> Starting package FRR...done.
    <118>pfSense 2.5.0-DEVELOPMENT amd64 Fri Nov 29 08:22:22 EST 2019
    <118>Bootup complete
    <6>ovpnc11: link state changed to UP
    <6>ovpnc9: link state changed to UP
    <6>ovpnc3: link state changed to UP
    <6>ovpnc10: link state changed to UP
    <6>ovpnc7: link state changed to UP
    <3>rn_delete: couldn't find our annotation

    Fatal trap 12: page fault while in kernel mode
    cpuid = 3; apic id = 13
    fault virtual address = 0x70
    fault code = supervisor read data, page not present
    instruction pointer = 0x20:0xffffffff80e7d451
    stack pointer = 0x28:0xfffffe00944f43a0
    frame pointer = 0x28:0xfffffe00944f44a0
    code segment = base 0x0, limit 0xfffff, type 0x1b
    = DPL 0, pres 1, long 1, def32 0, gran 1
    processor eflags = interrupt enabled, resume, IOPL = 0
    current process = 53160 (Zebra dplane)
    version.txt0600007113570412703 7533 ustarrootwheelFreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense



  • i need edit this, when frr got two or more and ipv4 or ipv6 full route tables from neighbors via openvpn update Source, then frr will down.



  • The results of repeated tests should be that there is a problem with the system, which has an impact on multiple BGP software, but it has the greatest impact on frr, causing the system to be paralyzed.



  • i have to change back to pf 2.4.4-p3, this version bgp work normal. so i think pfsense 2.5 has bugs now.



  • report

    pf.txt



  • use openbgpd get the same issue.

    pf-openbgpd.txt





  • Version String: FreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

    pf.txt



  • 2.5.0-DEVELOPMENT (amd64)
    built on Sun Dec 29 11:28:22 EST 2019
    FreeBSD 12.0-RELEASE-p10

    Crash report pf.txt



  • 2.5.0-DEVELOPMENT (amd64)
    built on Sun Dec 29 11:28:22 EST 2019
    FreeBSD 12.0-RELEASE-p10

    FRR Crash report
    pf.txt



  • the same config work in pf 2.4.4, but it is crash in pf2.5

    2.5.0-DEVELOPMENT (amd64)
    built on Fri Jan 03 22:01:28 EST 2020
    FreeBSD 12.0-RELEASE-p10

    pf.txt



  • 2.5.0-DEVELOPMENT (amd64)
    built on Sun Jan 05 00:41:14 EST 2020
    FreeBSD 12.0-RELEASE-p10

    pf.txt



  • amd64
    12.0-RELEASE-p10
    FreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense

    Crash report details:

    No PHP errors found.

    Filename: /var/crash/info.0
    Dump header from device: /dev/label/swap0
    Architecture: amd64
    Architecture Version: 4
    Dump Length: 154112
    Blocksize: 512
    Compression: none
    Dumptime: Tue Jan 7 22:22:34 2020
    Hostname:
    Magic: FreeBSD Text Dump
    Version String: FreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense
    Panic String:
    Dump Parity: 397621510
    Bounds: 0
    Dump Status: good

    Filename: /var/crash/textdump.tar.0
    ddb.txt06000014000013605112052 7065 ustarrootwheeldb:0:kdb.enter.default> run lockinfo
    db:1:lockinfo> show locks
    No such command; use "help" to list available commands
    db:1:lockinfo> show alllocks
    No such command; use "help" to list available commands
    db:1:lockinfo> show lockedvnods
    Locked vnodes
    db:0:kdb.enter.default> show pcpu
    cpuid = 2
    dynamic pcpu = 0xfffffe008199dac0
    curthread = 0xfffff80238bbd000: pid 49739 tid 100232 "bgpd"
    curpcb = 0xfffffe0095a74b00
    fpcurthread = 0xfffff80238bbd000: pid 49739 "bgpd"
    idlethread = 0xfffff80004566000: tid 100005 "idle: cpu2"
    curpmap = 0xfffff8023837c130
    tssp = 0xffffffff82db74f0
    commontssp = 0xffffffff82db74f0
    rsp0 = 0xfffffe0095a74b00
    gs32p = 0xffffffff82dbe128
    ldt = 0xffffffff82dbe168
    tss = 0xffffffff82dbe158
    curvnet = 0xfffff80004088f40
    db:0:kdb.enter.default> bt
    Tracing pid 49739 tid 100232 td 0xfffff80238bbd000
    rtrequest1_fib() at rtrequest1_fib+0x2b1/frame 0xfffffe0095a744c0
    route_output() at route_output+0xc61/frame 0xfffffe0095a74740
    sosend_generic() at sosend_generic+0x586/frame 0xfffffe0095a747f0
    sosend() at sosend+0x50/frame 0xfffffe0095a74820
    soo_write() at soo_write+0x33/frame 0xfffffe0095a74860
    dofilewrite() at dofilewrite+0xb2/frame 0xfffffe0095a748b0
    sys_writev() at sys_writev+0x70/frame 0xfffffe0095a74900
    amd64_syscall() at amd64_syscall+0x369/frame 0xfffffe0095a74a30
    fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0095a74a30
    --- syscall (121, FreeBSD ELF64, sys_writev), rip = 0x80042090a, rsp = 0x7fffffffe928, rbp = 0x7fffffffeae0 ---
    db:0:kdb.enter.default> ps

    Fatal trap 12: page fault while in kernel mode
    cpuid = 2; apic id = 12
    fault virtual address = 0x70
    fault code = supervisor read data, page not present
    instruction pointer = 0x20:0xffffffff80e7d451
    stack pointer = 0x28:0xfffffe0095a743c0
    frame pointer = 0x28:0xfffffe0095a744c0
    code segment = base 0x0, limit 0xfffff, type 0x1b
    = DPL 0, pres 1, long 1, def32 0, gran 1
    processor eflags = interrupt enabled, resume, IOPL = 0
    current process = 49739 (bgpd)
    version.txt0600007113605112052 7524 ustarrootwheelFreeBSD 12.0-RELEASE-p10 fe839027797(RELENG_2_5) pfSense





  • Crash report begins. Anonymous machine information:

    amd64
    12.0-RELEASE-p10
    FreeBSD 12.0-RELEASE-p10 b03a341e64a(RELENG_2_5) pfSense

    Crash report details:

    PHP Errors:
    [14-Jan-2020 06:53:30 Asia/Shanghai] PHP Warning: file_get_contents(/tmp/ovpnc5_router): failed to open stream: No such file or directory in /etc/inc/gwlb.inc on line 1480

    No FreeBSD crash data found.



  • Crash report begins. Anonymous machine information:

    amd64
    12.0-RELEASE-p10
    FreeBSD 12.0-RELEASE-p10 b03a341e64a(RELENG_2_5) pfSense

    Crash report details:

    PHP Errors:
    [15-Jan-2020 03:33:01 Asia/Shanghai] PHP Fatal error: Unable to start pfSense module in Unknown on line 0

    No FreeBSD crash data found.



  • Fatal trap 12: page fault while in kernel mode
    cpuid = 0; apic id = 10
    fault virtual address = 0x70
    fault code = supervisor read data, page not present
    instruction pointer = 0x20:0xffffffff80e7d451
    stack pointer = 0x28:0xfffffe0095ac03c0
    frame pointer = 0x28:0xfffffe0095ac04c0
    code segment = base 0x0, limit 0xfffff, type 0x1b
    = DPL 0, pres 1, long 1, def32 0, gran 1
    processor eflags = interrupt enabled, resume, IOPL = 0
    current process = 37261 (bgpd)
    version.txt0600007113611076410 7530 ustarrootwheelFreeBSD 12.0-RELEASE-p10 b03a341e64a(RELENG_2_5) pfSense

    pf.txt



  • i have test work in pf2.4.5 now, but not normal work in pf 2.5.


Log in to reply