Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    (solved) Bridged Interfaces Flapping after discon/recon

    Scheduled Pinned Locked Moved 2.2 Snapshot Feedback and Problems - RETIRED
    27 Posts 4 Posters 6.4k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • chpalmerC
      chpalmer
      last edited by

      2.2-BETA (amd64)
      built on Fri Nov 21 17:06:59 CST 2014

      Ive bridged my WAN to opt1 in order to bypass NAT for 1 device.  If I reboot the unit while everything is connected all is fine.  If I unplug a cable and plug it back in that port flaps.

      Watchguard XTM505 em0 and em1

      Triggering snowflakes one by one..
      Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

      1 Reply Last reply Reply Quote 0
      • chpalmerC
        chpalmer
        last edited by

        https://forum.pfsense.org/index.php?topic=66908.15

        edit- removed redundant sentence.

        Triggering snowflakes one by one..
        Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

        1 Reply Last reply Reply Quote 0
        • C
          cmb
          last edited by

          I wasn't able to replicate that in ESX with vmxnet nor e1000, thought that was replicable across all e1000-type NICs previously when it was an issue. I'll try it on physical hardware and see.

          1 Reply Last reply Reply Quote 0
          • chpalmerC
            chpalmer
            last edited by

            If it doesn't show up for you Ill blow this thing up and reload.  Ive been playing with this particular build (test box) for a while and may have broke something…

            
Nov 25 09:58:48     php-fpm[9437]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:58:48     php-fpm[9437]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:58:50     kernel: em0: link state changed to UP
Nov 25 09:58:50     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em0''
Nov 25 09:58:50     check_reload_status: Linkup starting em0
Nov 25 09:58:51     php-fpm[9437]: /rc.linkup: Hotplug event detected for WAN(wan) but ignoring since interface is configured with static IP (172.18.20.242 )
Nov 25 09:58:51     check_reload_status: rc.newwanip starting em0
Nov 25 09:58:52     php-fpm[9437]: /rc.newwanip: rc.newwanip: Info: starting on em0.
Nov 25 09:58:52     php-fpm[9437]: /rc.newwanip: rc.newwanip: on (IP address: 172.18.20.242) (interface: WAN[wan]) (real interface: em0).
Nov 25 09:58:52     kernel: em0: link state changed to DOWN
Nov 25 09:58:52     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup stop em0''
Nov 25 09:58:52     check_reload_status: Linkup starting em0
Nov 25 09:58:52     check_reload_status: Reloading filter
Nov 25 09:58:53     php-fpm[9437]: /rc.linkup: Hotplug event detected for WAN(wan) but ignoring since interface is configured with static IP (172.18.20.242 )
Nov 25 09:58:53     php-fpm[9437]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:58:53     php-fpm[9437]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:58:55     kernel: em0: link state changed to UP
Nov 25 09:58:55     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em0''
Nov 25 09:58:55     check_reload_status: Linkup starting em0
Nov 25 09:58:56     php-fpm[9437]: /rc.linkup: Hotplug event detected for WAN(wan) but ignoring since interface is configured with static IP (172.18.20.242 )
Nov 25 09:58:56     check_reload_status: rc.newwanip starting em0
Nov 25 09:58:57     php-fpm[9437]: /rc.newwanip: rc.newwanip: Info: starting on em0.
Nov 25 09:58:57     php-fpm[9437]: /rc.newwanip: rc.newwanip: on (IP address: 172.18.20.242) (interface: WAN[wan]) (real interface: em0).
Nov 25 09:58:57     kernel: em0: link state changed to DOWN
Nov 25 09:58:57     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup stop em0''
Nov 25 09:58:57     check_reload_status: Linkup starting em0
Nov 25 09:58:57     check_reload_status: Reloading filter
Nov 25 09:58:58     php-fpm[9437]: /rc.linkup: Hotplug event detected for WAN(wan) but ignoring since interface is configured with static IP (172.18.20.242 )
Nov 25 09:58:58     php-fpm[9437]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:58:58     php-fpm[9437]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:59:00     kernel: em0: link state changed to UP
Nov 25 09:59:00     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em0''
Nov 25 09:59:00     check_reload_status: Linkup starting em0
Nov 25 09:59:00     kernel: em1: promiscuous mode disabled
Nov 25 09:59:00     kernel: bridge0: link state changed to DOWN
Nov 25 09:59:00     kernel: em0: promiscuous mode disabled
Nov 25 09:59:01     php-fpm[64658]: /rc.linkup: Hotplug event detected for WAN(wan) but ignoring since interface is configured with static IP (172.18.20.242 )
Nov 25 09:59:01     check_reload_status: rc.newwanip starting em0
Nov 25 09:59:01     check_reload_status: Syncing firewall
Nov 25 09:59:02     php-fpm[64658]: /rc.newwanip: rc.newwanip: Info: starting on em0.
Nov 25 09:59:02     php-fpm[64658]: /rc.newwanip: rc.newwanip: on (IP address: 172.18.20.242) (interface: WAN[wan]) (real interface: em0).
Nov 25 09:59:02     check_reload_status: Reloading filter
Nov 25 09:59:03     php-fpm[64658]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 09:59:03     php-fpm[64658]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 10:00:14     check_reload_status: updating dyndns firebox
Nov 25 10:00:14     check_reload_status: Restarting ipsec tunnels
Nov 25 10:00:14     check_reload_status: Restarting OpenVPN tunnels/interfaces
Nov 25 10:00:14     check_reload_status: Reloading filter
Nov 25 10:00:15     php-fpm[64658]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 10:00:15     php-fpm[64658]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).

            Triggering snowflakes one by one..
            Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              Yesterdays build bridging was broken so I couldn't test this but using todays build I'm not seeing this. I'm using an XTM5, identical hardware to yours so I'd suggest something else is happening.
              I'm bridging several em NICs as LAN though so not quite the same setup as you.

              Steve

              1 Reply Last reply Reply Quote 0
              • chpalmerC
                chpalmer
                last edited by

                Thanks Steve!  :)

                Im downloading the latest snap to it right now and will re-test.

                This is a 4GB CF card install.  I need to get a drive installed in this thing instead with all the writes Im doing.

                Triggering snowflakes one by one..
                Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  Edited while you posted.  ::)
                  Since you have bridged WAN the situation is different. The issue before IIRC was interfaces were being reloaded that didn't need to be. A bridged interface, that has no IP, or a static IP interface were not supposed to be reset but got included acciudentally. The WAN interface however may be different. How exactly do you have the bridge setup?

                  Also I see there's a new snapshot. I'm running: built on Tue Nov 25 01:23:50 CST 2014

                  Steve

                  1 Reply Last reply Reply Quote 0
                  • stephenw10S
                    stephenw10 Netgate Administrator
                    last edited by

                    @chpalmer:

                    I need to get a drive installed in this thing instead with all the writes Im doing.

                    In case you weren't being sarcastic… it's nothing to worry about. Each time you flash the card it's only 1 write to each bit. Would be a lot faster to a HD though. Updating to CF takes ages.  ;)

                    Steve

                    1 Reply Last reply Reply Quote 0
                    • chpalmerC
                      chpalmer
                      last edited by

                      Yea- mostly sarcasm but looking for more speed is the reason…  ;)

                      Latest built on Tue Nov 25 11:18:23 CST 2014

                      I have WAN assigned to EM0    (Static Address with a /29)
                      I have OPT1 and named it SERVER EM1  (set to none)
                      I have a bridge with both WAN and Server as the interfaces

                      Right now I have this desktop with the third host address of the /29 static connected to the "Server" port.

                      WAN is connected to a LAN port on another router with no DHCP and /29.

                      Triggering snowflakes one by one..
                      Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                      1 Reply Last reply Reply Quote 0
                      • E
                        eri--
                        last edited by

                        Do you see any linkup events on your system logs related to this interface?

                        1 Reply Last reply Reply Quote 0
                        • chpalmerC
                          chpalmer
                          last edited by

                          @ermal:

                          Do you see any linkup events on your system logs related to this interface?

                          I just removed Siproxd before I tried to connect again. These are the logs I get-

                          
Nov 25 15:17:29     kernel: em1: link state changed to UP
Nov 25 15:17:29     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em1''
Nov 25 15:17:30     php-fpm[63464]: /rc.linkup: Hotplug event detected for SERVER(opt1) but ignoring since interface is configured with static IP ( )
Nov 25 15:17:30     check_reload_status: rc.newwanip starting em1
Nov 25 15:17:31     php-fpm[63464]: /rc.newwanip: rc.newwanip: Info: starting on em1.
Nov 25 15:17:31     php-fpm[63464]: /rc.newwanip: rc.newwanip: on (IP address: ) (interface: SERVER[opt1]) (real interface: em1).
Nov 25 15:17:31     kernel: em1: link state changed to DOWN
Nov 25 15:17:31     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup stop em1''
Nov 25 15:17:31     php-fpm[63464]: /rc.newwanip: IP has changed, killing states on former IP 0.0.0.0.
Nov 25 15:17:31     php-fpm[63464]: /rc.newwanip: Resyncing OpenVPN instances for interface SERVER.
Nov 25 15:17:31     php-fpm[63464]: /rc.newwanip: Creating rrd update script
Nov 25 15:17:31     check_reload_status: Linkup starting em1
Nov 25 15:17:32     php-fpm[26989]: /rc.linkup: Hotplug event detected for SERVER(opt1) but ignoring since interface is configured with static IP ( )
Nov 25 15:17:33     kernel: em1: link state changed to UP
Nov 25 15:17:33     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em1''
Nov 25 15:17:33     check_reload_status: Linkup starting em1
Nov 25 15:17:33     php-fpm[63464]: /rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> - Restarting packages.
Nov 25 15:17:33     check_reload_status: Starting packages
Nov 25 15:17:33     check_reload_status: Reloading filter
Nov 25 15:17:34     php-fpm[26989]: /rc.linkup: Hotplug event detected for SERVER(opt1) but ignoring since interface is configured with static IP ( )
Nov 25 15:17:34     check_reload_status: rc.newwanip starting em1
Nov 25 15:17:34     kernel: em1: link state changed to DOWN
Nov 25 15:17:34     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup stop em1''
Nov 25 15:17:34     check_reload_status: Linkup starting em1
Nov 25 15:17:34     php-fpm[26989]: /rc.start_packages: Restarting/Starting all packages.
Nov 25 15:17:34     php-fpm[26989]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 15:17:34     php-fpm[26989]: /rc.filter_configure_sync: Could not find IPv6 gateway for interface(wan).
Nov 25 15:17:35     php-fpm[26989]: /rc.newwanip: rc.newwanip: Info: starting on em1.
Nov 25 15:17:35     php-fpm[26989]: /rc.newwanip: rc.newwanip: on (IP address: ) (interface: SERVER[opt1]) (real interface: em1).
Nov 25 15:17:35     php-fpm[26989]: /rc.newwanip: IP has changed, killing states on former IP 0.0.0.0.
Nov 25 15:17:35     php-fpm[26989]: /rc.newwanip: Resyncing OpenVPN instances for interface SERVER.
Nov 25 15:17:35     php-fpm[26989]: /rc.newwanip: Creating rrd update script
Nov 25 15:17:35     php-fpm[36180]: /rc.linkup: Hotplug event detected for SERVER(opt1) but ignoring since interface is configured with static IP ( )
Nov 25 15:17:37     php-fpm[26989]: /rc.newwanip: pfSense package system has detected an IP change or dynamic WAN reconnection - 0.0.0.0 -> - Restarting packages.
Nov 25 15:17:37     check_reload_status: Starting packages
Nov 25 15:17:37     check_reload_status: Reloading filter

                          Triggering snowflakes one by one..
                          Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                          1 Reply Last reply Reply Quote 0
                          • chpalmerC
                            chpalmer
                            last edited by

                            Just installed the latest snap.    built on Tue Nov 25 16:45:15 CST 2014

                            Looks like your revision fixed it Ermal..

                            Nov 25 16:26:31    syslogd: kernel boot file is /boot/kernel/kernel
                            Nov 25 16:26:36    kernel: em1: link state changed to UP
                            Nov 25 16:26:36    devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em1''
                            Nov 25 16:26:37    php-fpm[59471]: /rc.linkup: Linkup detected on disabled interface…Ignoring

                            Triggering snowflakes one by one..
                            Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                            1 Reply Last reply Reply Quote 0
                            • E
                              eri--
                              last edited by

                              So your interface is assigned but disabled hence its not being readded on the bridge.
                              Is this analysis correct?

                              1 Reply Last reply Reply Quote 0
                              • chpalmerC
                                chpalmer
                                last edited by

                                Assigned and enabled but with none as the configuration type.

                                Triggering snowflakes one by one..
                                Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                1 Reply Last reply Reply Quote 0
                                • E
                                  eri--
                                  last edited by

                                  Heh fixed, sorry for the disruption.
                                  Try next snapshot.

                                  Normally the interface will be added to the bridge during newwanip event triggering.

                                  1 Reply Last reply Reply Quote 0
                                  • chpalmerC
                                    chpalmer
                                    last edited by

                                    Loading the new snap right now.  :)

                                    2.2-BETA (amd64)
                                    built on Tue Nov 25 16:45:15 CST 2014    seemed to fix it though…

                                    Triggering snowflakes one by one..
                                    Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      I had never really thought about bridging the WAN side until now. Just thinking out loud here…
                                      Would there be any advantage, or disadvantage, to adding both physical interfaces to the bridge and assigning the bridge itself as the WAN? The same way it's often done LAN side.

                                      Steve

                                      1 Reply Last reply Reply Quote 0
                                      • chpalmerC
                                        chpalmer
                                        last edited by

                                        @stephenw10:

                                        I had never really thought about bridging the WAN side until now. Just thinking out loud here…
                                        Would there be any advantage, or disadvantage, to adding both physical interfaces to the bridge and assigning the bridge itself as the WAN? The same way it's often done LAN side.

                                        Steve

                                        That is my first choice as well.  With my primary box (2.1.x) Ive tried and cannot get the box to receive an address from my ISP via DHCP when I assign WAN to the bridge.  Possibly something Im doing wrong or missing..??

                                        I have a couple of DHCP available and a Static address that Ive purchased from them. I only use one DHCP but should be able to register two macs with the cable modem for DHCP before I have to re-boot yet I do reboot it while trying..  I hand the static to the server directly and control access with firewall rules.

                                        With my test box Im trying to reproduce this in a lab setting.  :)

                                        Triggering snowflakes one by one..
                                        Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                        1 Reply Last reply Reply Quote 0
                                        • chpalmerC
                                          chpalmer
                                          last edited by

                                          @chpalmer:

                                          Loading the new snap right now.  :)

                                          2.2-BETA (amd64)
                                          built on Tue Nov 25 16:45:15 CST 2014    seemed to fix it though…

                                          Still good.

                                          Below-  physically unplug and reconnect event.

                                          
Nov 26 08:43:57     syslogd: kernel boot file is /boot/kernel/kernel
Nov 26 08:44:04     kernel: em1: link state changed to DOWN
Nov 26 08:44:04     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup stop em1''
Nov 26 08:44:08     kernel: em1: link state changed to UP
Nov 26 08:44:08     devd: Executing '/usr/local/sbin/pfSctl -c 'interface linkup start em1''
Nov 26 08:44:08     check_reload_status: Linkup starting em1

                                          Triggering snowflakes one by one..
                                          Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                                          1 Reply Last reply Reply Quote 0
                                          • E
                                            eri--
                                            last edited by

                                            Can you be more clear here!

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.