Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    LAGG (LACP) - UniFi Switch (16XG)

    Scheduled Pinned Locked Moved L2/Switching/VLANs
    lagglacpunifi
    43 Posts 4 Posters 14.3k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • chpalmerC
      chpalmer
      last edited by chpalmer

      Im looking at your 1st picture at the top of the thread here.

      That looks strange to me. Both ports should have an HW: address I believe. And they should be different.

      Triggering snowflakes one by one..
      Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

      1 Reply Last reply Reply Quote 0
      • DerelictD
        Derelict LAYER 8 Netgate
        last edited by

        Two ports in LACP have the same MAC address. It's perfectly normal.

        [2.4.4-RELEASE][root@fw]/root: ifconfig -v lagg0
        lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
                options=6500bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
                ether 00:08:a2:0a:59:3f
                inet6 fe80::208:a2ff:fe0a:593f%lagg0 prefixlen 64 scopeid 0xb 
                nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
                media: Ethernet autoselect
                status: active
                groups: lagg 
                laggproto lacp lagghash l2,l3,l4
                lagg options:
                        flags=10<LACP_STRICT>
                        flowid_shift: 16
                lagg statistics:
                        active ports: 2
                        flapping: 0
                lag id: [(8000,00-08-A2-0A-59-3F,016B,0000,0000),
                         (0001,CC-4E-24-53-94-00,4E21,0000,0000)]
                laggport: igb4 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
                        [(8000,00-08-A2-0A-59-3F,016B,8000,0005),
                         (0001,CC-4E-24-53-94-00,4E21,0001,0023)]
                laggport: igb5 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
                        [(8000,00-08-A2-0A-59-3F,016B,8000,0006),
                         (0001,CC-4E-24-53-94-00,4E21,0001,0024)]
        [2.4.4-RELEASE][root@fw]/root: ifconfig -v igb4
        igb4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
                options=6500bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
                ether 00:08:a2:0a:59:3f
                hwaddr 00:08:a2:0a:59:3f
                nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
                media: Ethernet autoselect (1000baseT <full-duplex>)
                status: active
        [2.4.4-RELEASE][root@fw]/root: ifconfig -v igb5
        igb5: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
                options=6500bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
                ether 00:08:a2:0a:59:3f
                hwaddr 00:08:a2:0a:59:40
                nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
                media: Ethernet autoselect (1000baseT <full-duplex>)
                status: active
        

        Chattanooga, Tennessee, USA
        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
        Do Not Chat For Help! NO_WAN_EGRESS(TM)

        1 Reply Last reply Reply Quote 0
        • chpalmerC
          chpalmer
          last edited by

          0_1547779829396_LAGG.jpg

          The 2e address in my picture here is the MAC I spoofed on my WAN page.

          Triggering snowflakes one by one..
          Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

          1 Reply Last reply Reply Quote 0
          • DerelictD
            Derelict LAYER 8 Netgate
            last edited by

            OK?

            Is that em0 or em1?

            What does ifconfig -v show for em0 and em1?

            Chattanooga, Tennessee, USA
            A comprehensive network diagram is worth 10,000 words and 15 conference calls.
            DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
            Do Not Chat For Help! NO_WAN_EGRESS(TM)

            chpalmerC 1 Reply Last reply Reply Quote 0
            • kklouzalK
              kklouzal
              last edited by

              I was able to get Dynamic 802.3ad LACP working between the switch and a windows 10 machine with no problems at all. The only log entries I can find related to this issue are these here:

              cxgbe0: Interface stopped DISTRIBUTING, possible flapping
              cxgbe1: Interface stopped DISTRIBUTING, possible flapping

              1 Reply Last reply Reply Quote 0
              • DerelictD
                Derelict LAYER 8 Netgate
                last edited by Derelict

                And what does the switch say?

                I can get LACP running between my Brocade, Cisco, and D-Link switches with no problems at all. If your experience points to pfSense, mine points to your switch.

                Chattanooga, Tennessee, USA
                A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                Do Not Chat For Help! NO_WAN_EGRESS(TM)

                1 Reply Last reply Reply Quote 0
                • kklouzalK
                  kklouzal
                  last edited by

                  I'm not trying to play a whose at fault game here, just trying to pin down the issue so it can be corrected.

                  Only option left to try is a different NIC and see if that changes things. There could be something physically wrong with the card or with the FreeBSD driver being used, it's an older T4 Chelsio adapter. I'll try one of the built in Intel adapters and report back.

                  1 Reply Last reply Reply Quote 0
                  • chpalmerC
                    chpalmer @Derelict
                    last edited by

                    @derelict

                    It says the same thing that the picture shows em0 ends with 26 em1 ends with 27 my spoofed MAC is 2e

                    em0:
                    flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
                    options=219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC>
                    ether 00:90:7f:88:b4:2e
                    hwaddr 00:90:7f:88:b4:26
                    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
                    media: Ethernet autoselect (1000baseT <full-duplex>)
                    status: active

                    em1:
                    flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
                    options=219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC>
                    ether 00:90:7f:88:b4:2e
                    hwaddr 00:90:7f:88:b4:27
                    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
                    media: Ethernet autoselect (1000baseT <full-duplex>)
                    status: active

                    Triggering snowflakes one by one..
                    Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                    DerelictD 1 Reply Last reply Reply Quote 0
                    • kklouzalK
                      kklouzal
                      last edited by

                      So after using two of the integrated Intel ports to setup the LAG everything is working fine and in bridge mode too. It was super easy and straightforward, just aggregate the ports on the UniFi 16XG and setup the LAG interface on PfSense as LACP, add to bridge, done.

                      So this leaves us with the conclusion something is broken with the Chelsio card when attempting to configure a LAG. I have no way of knowing if it's the physical card at fault or if there is a driver issue here. I'd like to say this is a driver issue as there have been no troubles with this card thus far. It's also an older T4 adapter, most people will be using T5's and T6's which may not have any issues.

                      Can anyone else verify their T4 card works with LACP? I'd like to get another users confirmation before spending $500 on a new adapter.

                      1 Reply Last reply Reply Quote 0
                      • DerelictD
                        Derelict LAYER 8 Netgate @chpalmer
                        last edited by

                        @chpalmer What interface is assigned to WAN and has the spoofed MAC address set?

                        Chattanooga, Tennessee, USA
                        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                        Do Not Chat For Help! NO_WAN_EGRESS(TM)

                        1 Reply Last reply Reply Quote 0
                        • chpalmerC
                          chpalmer
                          last edited by

                          em0 and em1 are assigned to a LAGG LACP

                          LAGG is assigned as WAN.

                          I have an MB8600 cable modem on the other end of the LAGG.

                          Triggering snowflakes one by one..
                          Intel(R) Core(TM) i5-4590T CPU @ 2.00GHz on an M400 WG box.

                          1 Reply Last reply Reply Quote 0
                          • DerelictD
                            Derelict LAYER 8 Netgate
                            last edited by

                            OK then the MAC address should be spoofed. The MAC address on the LAGG should also be the spoofed MAC. That is exactly what would be expected.

                            Chattanooga, Tennessee, USA
                            A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                            DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                            Do Not Chat For Help! NO_WAN_EGRESS(TM)

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.