Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Trunking VLANs on interfaces

    Scheduled Pinned Locked Moved General pfSense Questions
    48 Posts 6 Posters 7.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DerelictD
      Derelict LAYER 8 Netgate
      last edited by

      Trunk your vlans between the switches with switch ports, not router interfaces.

      Using the router will require you to bridge those interfaces which will make for a lousy router and an even lousier switch.

      Chattanooga, Tennessee, USA
      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
      Do Not Chat For Help! NO_WAN_EGRESS(TM)

      1 Reply Last reply Reply Quote 0
      • B
        BlankMan
        last edited by

        How come I'm not seeing the image I included in my OP? I refreshed the page a number of times but I don't see it….

        I appreciate the idea of naming the VLANs differently and will consider doing that in the future but this is being added to an extensive existing network and don't want to rename them everywhere at this time.

        I'm getting away from trunking VLANs on interfaces, that's what I had.

        VLAN10, 20, & 30 correspond to subnets 192,168.10.0 192,168.20.0 & 192,168.30.0 respectively which correspond to em2, 3, & 4 respectively.

        Interfaces em2, 3, & 4 will each connect to their own Cisco switch and fan out from there. The only reason for having VLAN10 on em3 & 4 is that the Cisco switches IP addresses are on VLAN10 subnet 10 which is the switches default VLAN and is needed to be able to manage the switches. VLAN20 is on em2 temporarily, once I get this all reconfig'd it will be removed.

        Right now em2, 3, & 4 are all connected to the same switch and trunk to other switches, as I stated that will be going away when each interface, VLAN, subnet is connected to it's own switch.

        I attempted to turn the 3 interfaces on the switch into trunks with 10/20, 10/20, 10/30 but thing went south. I could not connect out the WAN so I set the interfaces on the switch back to Access each on it's corresponding VLAN.

        But, it turned out pfSense's named had stopped running and since it is set up as a DNS server not forwarder or resolver that was my connection problem. And, it turned out that named stopped running because I added a config to OpenVPN and that Save kills named. I have verified it does that and is reproducible. I have a weird issue with named i.e. two named daemons running that I mentioned in another post (haven't checked back yet) that needs to be resolved and may have something to do with the named daemon going away.

        So I will try this again but it occurred to me that having all 3 VLANs going to the same switch at the moment i.e. VLAN10 showing up on 3 of the switches interfaces may not be kosher. So I may not be able to test this until it's completely rewired.

        Dare to think and do outside the conventional box…

        1 Reply Last reply Reply Quote 0
        • B
          BlankMan
          last edited by

          Now my image in the OP is back. Weird…

          Dare to think and do outside the conventional box…

          1 Reply Last reply Reply Quote 0
          • DerelictD
            Derelict LAYER 8 Netgate
            last edited by

            I have no idea what you are trying to accomplish. I would not use the same VLAN tag to multiple switches that were not the same layer 2 network but that's probably just me.

            Chattanooga, Tennessee, USA
            A comprehensive network diagram is worth 10,000 words and 15 conference calls.
            DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
            Do Not Chat For Help! NO_WAN_EGRESS(TM)

            1 Reply Last reply Reply Quote 0
            • B
              BlankMan
              last edited by

              Derelict: The pfSense router has 3 wired LAN subnets 192.168,10.0, 192.168, 20.0, & 192.168,30.0, on em2, 3, & 4, those 3 subnets coincide with VLAN10, 20, & 30.

              Each router interface em2, 3, & 4 goes to a its own switch and each of those 3 switches fan out to other switches and those switches have devices connected/wired to them.

              What I'm trying to do is very simple, kept each subnet/VLAN physically isolated from the others, i.e. no trunking.

              Except as I stated I have to provide VLAN10 to all the switches because each switch IP address is on the 192.168.10.0 subnet and I need this so that I can get to the switch to use its GUI to manage it. You can only use/manage the switch using its GUI on its default/native VLAN which happens to be VLAN10. That's Cisco's restriction not mine.

              Dare to think and do outside the conventional box…

              1 Reply Last reply Reply Quote 0
              • DerelictD
                Derelict LAYER 8 Netgate
                last edited by

                If you need vlan 10 to all the switches then trunk VLAN 10 between the switches, not on pfSense.

                Chattanooga, Tennessee, USA
                A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                Do Not Chat For Help! NO_WAN_EGRESS(TM)

                1 Reply Last reply Reply Quote 0
                • johnpozJ
                  johnpoz LAYER 8 Global Moderator
                  last edited by

                  ^ exactly!! You would not put the same vlan tag on multiple interfaces on a router..  If its different layer 2 networks, then use different tag IDs.

                  An intelligent man is sometimes forced to be drunk to spend time with his fools
                  If you get confused: Listen to the Music Play
                  Please don't Chat/PM me for help, unless mod related
                  SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                  1 Reply Last reply Reply Quote 0
                  • B
                    BlankMan
                    last edited by

                    Derelict: Yeah that was my initial plan but, since pfSense can to trunking I want to do it that way.

                    johnpoz: What? Why? On switches, on their interfaces, you trunk VLAN10 & VLAN 20 on port 1, trunk VLAN20 & VLAN30 on port 2, trunk VLAN30 & VLAN10 on port 3, etc. As needed. Why do you say you don't do that on a router? Without a bonafide reason why, like it's against 802 dot something just saying you don't do that has no merit, sorry…

                    Dare to think and do outside the conventional box…

                    1 Reply Last reply Reply Quote 0
                    • DerelictD
                      Derelict LAYER 8 Netgate
                      last edited by

                      Derelict: Yeah that was my initial plan but, since pfSense can to trunking I want to do it that way.

                      OK then good luck.

                      Chattanooga, Tennessee, USA
                      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                      Do Not Chat For Help! NO_WAN_EGRESS(TM)

                      1 Reply Last reply Reply Quote 0
                      • johnpozJ
                        johnpoz LAYER 8 Global Moderator
                        last edited by

                        Because when you call a vlan say 10… That means its the same layer 2 across your switching environment.  Yeah I trunk that vlan to any port where its an uplink to a switch that expands my layer 2 onto that switch.

                        Your router interfaces are not the same layer 2.. No mater if you want to call it vlan 10 or 20 or whatever its still a different layer 2.  Makes zero sense to tag what is different layer 2 with the same tag that all connect to your layer 3 routing device.

                        You can put multiple vlans on a physical interface in pfsense.. You just do not put the same ID on different interfaces - its a BORKED config...

                        An intelligent man is sometimes forced to be drunk to spend time with his fools
                        If you get confused: Listen to the Music Play
                        Please don't Chat/PM me for help, unless mod related
                        SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                        1 Reply Last reply Reply Quote 0
                        • B
                          BlankMan
                          last edited by

                          About ready to try this. Got the three main switches that connect to the routers three interfaces configured and ready to go. With the option of connecting the VLAN10 switch to the the VLAN20 & VLAN30 switches if it doesn't work.

                          I've been in IT for approaching 40 years, back when Ethernet was a big thigh coaxial cable that you tapped, physically, to branch off of. Got a lot of networking experience. I now work at a very large sprawling University with satellite buildings all around town networked in.

                          As such I sought the expertise of our Network Architect regarding putting multiple VLANs on router interfaces. What he said was that it's not widely done but there's no reason/restriction not to do it. Like if real estate is tight, i.e. interface ports. He said you typically put "a" VLAN on "a" interface even when those VLANs/interfaces connect to the same switch. For performance. No other reason.

                          Since my VLAN10 network is used so minimally it's not going to impact the performance on the other VLANs it's piggybacked on. If this works…

                          So I don't know where the "You would not put the same vlan tag on multiple interfaces on a router" comes from...

                          Dare to think and do outside the conventional box…

                          1 Reply Last reply Reply Quote 0
                          • johnpozJ
                            johnpoz LAYER 8 Global Moderator
                            last edited by

                            "You would not put the same vlan tag on multiple interfaces on a router"

                            Because its a different freaking layer 2… What part do you not get here??

                            If you use the same ID on different interfaces that are tied to different networks how do you know which one is which?  Lets just name all the dogs "dog" when you say dog dig this cool trick today... Which one did you mean?

                            The vlan ID is nothing more than a label to call out a different layer 2.

                            I have eth0 and eth1, and I put vlan 10 on both of them.. it makes zero sense to do that...  They are not the same layer 2... So what is the point of using 10 on both them.. Why not use something that makes a bit more sense for the ID>  Like the 3rd octet in the address space used... This is very common practice..

                            "GUI on its default/native VLAN which happens to be VLAN10. That's Cisco's restriction not mine."

                            Huh??  There is no such restriction from cisco..  What switches are these..  Post up link from cisco or the manual from your switch were it says that..

                            An intelligent man is sometimes forced to be drunk to spend time with his fools
                            If you get confused: Listen to the Music Play
                            Please don't Chat/PM me for help, unless mod related
                            SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                            1 Reply Last reply Reply Quote 0
                            • DerelictD
                              Derelict LAYER 8 Netgate
                              last edited by

                              I now work at a very large sprawling University with satellite buildings all around town networked in.

                              Sounds like you should be talking about VLANS over LACP to a stack of switches then, not tagging VLAN 10 on multiple interfaces to multiple isolated switches expecting the same "VLAN10" to be reachable on all of them.

                              I tapped thicknet too. This is all light-years better than that.

                              Chattanooga, Tennessee, USA
                              A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                              DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                              Do Not Chat For Help! NO_WAN_EGRESS(TM)

                              1 Reply Last reply Reply Quote 0
                              • B
                                BlankMan
                                last edited by

                                johnpoz: Settle down. I did not see your May 2 post. When I posted this morning I did not see this thread had a second page, the last post I saw was Derelict's good luck.

                                Look at any Cisco SG200 or SG300 manual. Here is Cisco's port definition: https://supportforums.cisco.com/t5/small-business-switches/general-vs-trunk-mode/td-p/2281870

                                General mode allows multiple untagged vlans and also multiple tagged vlans to exist on the same switch interface.
                                Trunk mode allows ONE untagged vlan and multiple Tagged vlans to exist on the same switch interface.
                                Access mode allows only one untagged vlan to exist on a switch interface.

                                So using Trunk mode the ports that the router interfaces will connect to on the switches have VLAN10 on them untagged along with either VLAN20 tagged or VLAN30 tagged. I've been doing this with one untagged and even 2 or 3 tagged VLANs for years.

                                Basically every Trunk mode interface I use has VLAN10 untagged and the rest on it tagged so as to be able to manage the switches down-line. The switches are configured, for uniformity, that they can only be managed from the default VLAN which is VLAN10.

                                In Cisco's world using General mode you can put as many VLANs as you want on the interface along with a mixture of them being tagged and untagged. Although I don't know why you would want to do that but if I'm understanding you correctly you think that cannot be done at all.

                                Not wanting a borked configuration, I sketched out what I'm doing, actually what I have been doing for years with VLANs between switches minus the router and showed it to our Network Architect. He said there is nothing wrong with what I am doing now with the router. Along with the caveat it isn't normally done, separate ports would be used. But when ports are at a premium it's perfectly acceptable to do.

                                He also said it may not be best practices but did not say it was borked. I don't put much weight in best practices. Someone does something and writes a paper and calls it best practices. It may be for some, but not necessarily for all.

                                Derelict: I do have some bonded interfaces were I am using LACP but VLAN10 once again is low traffic. It can go days or weeks not even used if what is on it is not used or even powered up. And here again if I had the real estate to bind then the argument could be made to give the VLAN it's own interface…

                                If this doesn't work with pfSense then I won't have a choice, but until that is known this is Plan A. You can bet I'll let ya'll know... :-) Failure is how one learns...

                                Dare to think and do outside the conventional box…

                                1 Reply Last reply Reply Quote 0
                                • DerelictD
                                  Derelict LAYER 8 Netgate
                                  last edited by

                                  You can lead a horse to water.

                                  Chattanooga, Tennessee, USA
                                  A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                                  DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                                  Do Not Chat For Help! NO_WAN_EGRESS(TM)

                                  1 Reply Last reply Reply Quote 0
                                  • jahonixJ
                                    jahonix
                                    last edited by

                                    @BlankMan:

                                    … VLAN10 ... low traffic ... days or weeks not even used ... or even powered up.

                                    Didn't you say that your VLAN10 always is the management interface of your switches? Do you power down switches  when there's no traffic?

                                    Problem with the interfaces and VLANs in FreeBSD is the naming convention.
                                    You have, say, eth0, eth1 and eth2. When you create a VLAN10 on each of them they are NOT all the same VLAN10. They will be eth0_vlan10, eth1_vlan10 and eth2_vlan10. You could as well name them vlan_10, vlan_0A and vlan_X (John, Paul and George would make Ringo jealous).
                                    Now that you have created separate interfaces you have to bridge them somewhere, right?
                                    A software router is the worst place for that.
                                    Now imagine doing that with 10G/40G/100G switches - bridging those in software isn't even doable yet (will be with TNSR and SCLR, though) but doing it on the switch is a piece of cake.

                                    Got the picture and why some of the hero users here really dislike the idea?

                                    1 Reply Last reply Reply Quote 0
                                    • B
                                      BlankMan
                                      last edited by

                                      Chris I understand what you're saying. However, on the other hand I have a Network Architect who I've know and worked with for over 15 years saying it's ok to do and it will work.

                                      Also you are correct, I could name it anything, name means nothing, it's the number that is associated with the name that is important.

                                      Take a look at the output from ifconfig below. First are the 3 physical interfaces, em2, 3, & 4. Below that are the virtual interfaces for each VLAN on each interface. Note there is a em2.10, and em3.10 and em4.10. Yes they are all different in name.

                                      Look at the attributes for each of those .10 virtual interfaces, take note of the "vlan:" parameter, the VLAN tag, each is "10".

                                      The way it was explained to me the ARP process will find the destination due to the VLAN being on the interface.

                                      Unless you're saying that vlan number 10 on em2 is different then vlan number 10 on em3 etc. If that is the case then what is the sense of having vlans at all in pfSense if they don't traverse physical interfaces?

                                      em2: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=5209b <rxcsum,txcsum,vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,vlan_hwfilter,vlan_hwtso>ether 00:e0:67:05:ab:08
                                          hwaddr 00:e0:67:05:ab:08
                                          inet6 fe80::2e0:67ff:fe05:ab08%em2 prefixlen 64 scopeid 0x3
                                          inet 192.168.10.1 netmask 0xffffff00 broadcast 192.168.10.255
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                      em3: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=5209b <rxcsum,txcsum,vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,vlan_hwfilter,vlan_hwtso>ether 00:e0:67:05:ab:09
                                          hwaddr 00:e0:67:05:ab:09
                                          inet6 fe80::2e0:67ff:fe05:ab09%em3 prefixlen 64 scopeid 0x4
                                          inet 192.168.20.1 netmask 0xffffff00 broadcast 192.168.20.255
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                      em4: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=5209b <rxcsum,txcsum,vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,vlan_hwfilter,vlan_hwtso>ether 00:e0:67:05:ab:0a
                                          hwaddr 00:e0:67:05:ab:0a
                                          inet6 fe80::2e0:67ff:fe05:ab0a%em4 prefixlen 64 scopeid 0x5
                                          inet 192.168.30.1 netmask 0xffffff00 broadcast 192.168.30.255
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active

                                      em2.10: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=3 <rxcsum,txcsum>ether 00:e0:67:05:ab:08
                                          inet6 fe80::2e0:67ff:fe05:ab08%em2.10 prefixlen 64 scopeid 0xb
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                          vlan: 10 vlanpcp: 0 parent interface: em2
                                          groups: vlan
                                      em2.20: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=3 <rxcsum,txcsum>ether 00:e0:67:05:ab:08
                                          inet6 fe80::2e0:67ff:fe05:ab08%em2.20 prefixlen 64 scopeid 0xc
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                          vlan: 20 vlanpcp: 0 parent interface: em2
                                          groups: vlan
                                      em3.10: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=3 <rxcsum,txcsum>ether 00:e0:67:05:ab:09
                                          inet6 fe80::2e0:67ff:fe05:ab09%em3.10 prefixlen 64 scopeid 0xd
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                          vlan: 10 vlanpcp: 0 parent interface: em3
                                          groups: vlan
                                      em3.20: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=3 <rxcsum,txcsum>ether 00:e0:67:05:ab:09
                                          inet6 fe80::2e0:67ff:fe05:ab09%em3.20 prefixlen 64 scopeid 0xe
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                          vlan: 20 vlanpcp: 0 parent interface: em3
                                          groups: vlan
                                      em4.10: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=3 <rxcsum,txcsum>ether 00:e0:67:05:ab:0a
                                          inet6 fe80::2e0:67ff:fe05:ab0a%em4.10 prefixlen 64 scopeid 0xf
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                          vlan: 10 vlanpcp: 0 parent interface: em4
                                          groups: vlan
                                      em4.30: flags=8843 <up,broadcast,running,simplex,multicast>metric 0 mtu 1500
                                          options=3 <rxcsum,txcsum>ether 00:e0:67:05:ab:0a
                                          inet6 fe80::2e0:67ff:fe05:ab0a%em4.30 prefixlen 64 scopeid 0x10
                                          nd6 options=21 <performnud,auto_linklocal>media: Ethernet autoselect (1000baseT <full-duplex>)
                                          status: active
                                          vlan: 30 vlanpcp: 0 parent interface: em4
                                          groups: vlan</full-duplex></performnud,auto_linklocal></rxcsum,txcsum></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum,vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,vlan_hwfilter,vlan_hwtso></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum,vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,vlan_hwfilter,vlan_hwtso></up,broadcast,running,simplex,multicast></full-duplex></performnud,auto_linklocal></rxcsum,txcsum,vlan_mtu,vlan_hwtagging,vlan_hwcsum,wol_magic,vlan_hwfilter,vlan_hwtso></up,broadcast,running,simplex,multicast>

                                      Dare to think and do outside the conventional box…

                                      1 Reply Last reply Reply Quote 0
                                      • DerelictD
                                        Derelict LAYER 8 Netgate
                                        last edited by

                                        Unless you're saying that vlan number 10 on em2 is different then vlan number 10 on em3 etc. If that is the case then what is the sense of having vlans at all in pfSense if they don't traverse physical interfaces?

                                        You have absolutely no clue what you are talking about.

                                        Those will be different broadcast domains.

                                        Look up that term. Learn something.

                                        This has nothing to do with pfSense. All VLAN tagged interfaces on router ports behave the same way. You might look up the ISO model.

                                        pfSense is NOT a switch. Those interfaces are NOT switch ports. No router interfaces are. That has been the point everyone has been trying to get you to understand this whole time.

                                        Chattanooga, Tennessee, USA
                                        A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                                        DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                                        Do Not Chat For Help! NO_WAN_EGRESS(TM)

                                        1 Reply Last reply Reply Quote 0
                                        • jahonixJ
                                          jahonix
                                          last edited by

                                          ^ what Derelict said.

                                          @BlankMan:

                                          Unless you're saying that vlan number 10 on em2 is different then vlan number 10 on em3 etc. If that is the case then what is the sense of having vlans at all in pfSense if they don't traverse physical interfaces?

                                          That's what we're trying to tell you. They ARE different interfaces. John, Paul and George.
                                          I don't care what an old man tells you to be fine in his world. I know that here it's not.

                                          And for the use of VLANs in pfSense - you didn't really ask what they are there for except for bridging, did you?
                                          They are there for a good reason and I'm looking forward to your explanation after thinking about it.

                                          1 Reply Last reply Reply Quote 0
                                          • B
                                            BlankMan
                                            last edited by

                                            I have no idea to what old man you are refering. You are assuming without facts in evidence.

                                            But,

                                            To quote LT Pete "Maverick" Mitchell: Crash and Burn.

                                            Ya'll can say I told ya so but I ain't giv'n up yet.

                                            Too many times I was told it can't be done only to do it.

                                            But I'm not holding my breath on this one.

                                            I think I see an error in my ways so after I correct that there will be another rodeo…

                                            Dare to think and do outside the conventional box…

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.