Multiple interface problems after rebooting

[pokrifchakd]

I'm seeing some strange behavior on my Netgate 7100. Whenever I reboot, I get an error stating that tailscale0 interface is missing, then that kicks off an error that says there's an interface mismatch. I'm then forced to reassign all of the lagg0.xxxx VLANs to the physical interface.

Second, I have also noticed that ix2 and ix3, the 2.5G uplinks to the SOC, are only brought up at 1G. I've attached the output of dmesg from my last reboot, which shows the 1G vs 2.5G connection.

Netgate 7100 dmesg.txt

Any thoughts on how to rectify this? To me, it looks like there is some sort of bug in bringing up the tailscale0 interface. It appears the boot process is checking all of the interfaces from the previous run state, then fails when the tailscale interface isn't up yet.

[pokrifchakd]

Bump.

Also, I just rebooted my pfSense+ VM and experienced the same issue with forgotten port and VLAN assignments.

Any ideas on what's going on and how to fix it?

[stephenw10]

Hmm, curious. Does it only do that when booting in verbose mode?

What does ifconfig show after booting for the state on ix2/3?

The tailscale interface should be excluded from the interface check: https://github.com/pfsense/pfsense/blob/master/src/etc/inc/util.inc#L2493
However that should be tun0 at that point. It could be the timing change caused by running in verbose mode.

[pokrifchakd]

@stephenw10 No, pretty much every reboot. The output I posted was from a standard console menu initiated reboot. Same thing for the VM.

ifconfig output from my 7100:

ix2: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
        ether 00:08:a2:0d:68:63
        media: Ethernet autoselect (2500Base-KX <full-duplex,rxpause,txpause>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
ix3: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
        ether 00:08:a2:0d:68:63
        hwaddr 00:08:a2:0d:68:64
        media: Ethernet autoselect (2500Base-KX <full-duplex,rxpause,txpause>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

[stephenw10]

Ah, so they are linked at 2.5G after boot is complete?

The boot log you posted shows a verbose boot. It was set in verbose mode at the loader.

Do you have the tailscale interface assigned? It should not be:
https://redmine.pfsense.org/issues/13924#note-3

Steve

[pokrifchakd]

@stephenw10 At the time I captured all of this, it was. I spent yesterday doing a factory reset and rebuild, but haven't configured tailscale yet. Thanks for the bug, report. I'll be sure to use the tailscale group instead of creating an interface from now on. I had the same config on the VM, so that would explain what I was seeing there as well.

[stephenw10]

Yes, I think that has tripped up a few users. I wasn't aware of it until recently but now I am I'm pretty sure most of the recent interface assignment reports are due to this.

I'll see what we can do to prevent it.

[t1ck3ts]

@stephenw10 regards to this issue of the tailscale0 interface not being up in time on system reboot, halting a complete boot, how would I go about setting routes to go through tailscale if we are unable to assign an interface and link static routes to it/its gateway?

I am confused/new to the whole "tailscale interface group" concept or if it even relates to routing.

[t1ck3ts]

@t1ck3ts said in Multiple interface problems after rebooting:

@stephenw10 regards to this issue of the tailscale0 interface not being up in time on system reboot, halting a complete boot, how would I go about setting routes to go through tailscale if we are unable to assign an interface and link static routes to it/its gateway?

I am confused/new to the whole "tailscale interface group" concept or if it even relates to routing.

Never mind, read up on some NAT and Routing docs from tailscale and "NOW" understand the workings!

The fix for me, since I run Hybrid/Manual Outbound NAT, was to create a NAT rule using the Tailscale group as interface, to translation address.

[stephenw10]

The best info there is in Christian's video:
Youtube Video