Routing isn't working as it should

Ofloo

# netstat -rn -f inet6 | grep -i fc00:ffff
fc00:ffff::/64                    link#2                        U           re1
fc00:ffff::1                      link#2                        UHS         lo0
#

# route get -inet6 fc00:fff::1
   route to: fc00:fff::1
destination: default
       mask: default
    gateway: fe80::207:7dff:fe56:5900%pppoe0
        fib: 0
  interface: pppoe0
      flags: <up,gateway,done,static>recvpipe  sendpipe  ssthresh  rtt,msec    mtu        weight    expire
       0         0         0         0      1492         1         0 
#</up,gateway,done,static>

why would it go to the default while re1 holds the range !?

cmb

Because fff and ffff are different subnets.

Ofloo

right just typed it wrong (for the example), .. did tcpdump it had same issues with other routes, removed sticky connections suddenly it started working not sure if it has anything to do with it. Most started working after I added them as static routes.

Ofloo

They don't work anymore


# netstat -rn -f inet6 | grep -i fc00:1::
2001:470:b112::/48                fc00:1::1                     UGS      ovpnc4
fc00:1::/64                       link#14                       U        ovpnc4
fc00:1::11                        link#14                       UHS         lo0
# route get -inet6 fc00:1::1
   route to: fc00:1::1
destination: default
       mask: default
    gateway: fe80::207:7dff:fe56:5900%pppoe0
        fib: 0
  interface: pppoe0
      flags: <up,gateway,done,static>recvpipe  sendpipe  ssthresh  rtt,msec    mtu        weight    expire
       0         0         0         0      1492         1         0 
#</up,gateway,done,static>

I double checked this time, however I just woke up. I've even added the route static but it's no use.

Ofloo

# ifconfig re1
re1: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
	options=82098 <vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,linkstate>ether 00:0d:b9:35:83:d9
	inet6 fe80::20d:b9ff:fe35:83d9%re1 prefixlen 64 scopeid 0x2 
	inet 192.168.1.1 netmask 0xffffff00 broadcast 192.168.1.255 
	inet6 fc00:ffff::1 prefixlen 64 
	nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
	status: active
# ping6 fc00:ffff::1
PING6(56=40+8+8 bytes) fc00:ffff::1 --> fc00:ffff::1
^C
--- fc00:ffff::1 ping6 statistics ---
4 packets transmitted, 0 packets received, 100.0% packet loss

# route get -inet6 fc00:ffff::1
   route to: rte
destination: default
       mask: default
    gateway: fe80::207:7dff:fe56:5900%pppoe0
        fib: 0
  interface: pppoe0
      flags: <up,gateway,done,static>recvpipe  sendpipe  ssthresh  rtt,msec    mtu        weight    expire
       0         0         0         0      1492         1         0 
# ping6 fc00:ffff::1
PING6(56=40+8+8 bytes) fc00:ffff::1 --> fc00:ffff::1
^C
--- fc00:ffff::1 ping6 statistics ---
1 packets transmitted, 0 packets received, 100.0% packet loss

#</up,gateway,done,static></full-duplex></performnud,auto_linklocal></vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,linkstate></up,broadcast,running,simplex,multicast>

it gets weirder

Ofloo

ifa_del_loopback_route: deletion failed: 3
ifa_del_loopback_route: deletion failed: 3
ifa_del_loopback_route: deletion failed: 3
ifa_del_loopback_route: deletion failed: 3
ifa_del_loopback_route: deletion failed: 3
cannot forward src fe80:2::226:c7ff:fe2a:c17e, dst 2001:67c:1560:8003::c7, nxt 17, rcvif re1, outif pppoe0

it is the firewall that's causing this behaviour, .. i get it when this happens and when i add a new rule or something everything works again.

Ofloo

an other thing i've noticed is that after a while i have to ifconfig the interfaces again, like

ovpnc2 has fc00::11/64 then I'm required to do

ifconfig ovpnc2 inet6 fc00::11/64

and the interface works again, ..? Even though it has that IP already.

Ofloo

did release upgrade today..

can anyone explain this .. obliviously when i did route get -inet6 it was the default gateway. it went to rather then the interface, but why.

ifconfig re1_vlan10
re1_vlan10: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
        ether 00:0d:b9:35:83:d9
        inet6 fe80::20d:b9ff:fe35:83d9%re1_vlan10 prefixlen 64 scopeid 0x8 
        inet 172.16.1.1 netmask 0xffffff00 broadcast 172.16.1.255 
        inet6 fc00:ffee::1 prefixlen 64 
        nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
        vlan: 10 vlanpcp: 0 parent interface: re1
ping6 fc00:ffee::1
PING6(56=40+8+8 bytes) fc00:ffee::1 --> fc00:ffee::1
^C
--- fc00:ffee::1 ping6 statistics ---
3 packets transmitted, 0 packets received, 100.0% packet loss

ifconfig re1_vlan10 inet6 fc00:ffee::1 prefixlen 64 
ifconfig re1_vlan10 inet6 fc00:ffee::1 prefixlen 64 
ping6 fc00:ffee::1
PING6(56=40+8+8 bytes) fc00:ffee::1 --> fc00:ffee::1
16 bytes from fc00:ffee::1, icmp_seq=0 hlim=64 time=0.519 ms
16 bytes from fc00:ffee::1, icmp_seq=1 hlim=64 time=1.536 ms
16 bytes from fc00:ffee::1, icmp_seq=2 hlim=64 time=0.287 ms
^C
--- fc00:ffee::1 ping6 statistics ---
3 packets transmitted, 3 packets received, 0.0% packet loss
round-trip min/avg/max/std-dev = 0.287/0.781/1.536/0.542 ms</full-duplex></performnud,auto_linklocal></up,broadcast,running,simplex,multicast>

oh and this behaviour is not limited to vlans.

cmb

If you're doing any manual ifconfig, you're doing something wrong. Maybe you're trying to manually configure IPs on things, which will get stomped on, and bypasses input validation that prevents invalid configs. Overlapping/conflicting subnets on multiple interfaces might be another reason you'd have issues along those lines. You're losing a link route for the IP where 'route get' shows the IP going via the default gateway.