Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Very Poor Performance on VLAN Routing

    Scheduled Pinned Locked Moved L2/Switching/VLANs
    62 Posts 6 Posters 7.6k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • bingo600B
      bingo600 @KDB9000
      last edited by

      @kdb9000

      The "server usually" shows what port it listens on

      iperf3 -s
      -----------------------------------------------------------
      Server listening on 5201
      -----------------------------------------------------------
      
      

      If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

      pfSense+ 23.05.1 (ZFS)

      QOTOM-Q355G4 Quad Lan.
      CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
      LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

      1 Reply Last reply Reply Quote 0
      • K
        KDB9000 @johnpoz
        last edited by

        @johnpoz said in Very Poor Performance on VLAN Routing:

        @kdb9000 said in Very Poor Performance on VLAN Routing:

        I don't see it listening on port 5201

        Then its not running..

        You see this?

        ash-4.3# iperf3 -s
        -----------------------------------------------------------
        Server listening on 5201
        -----------------------------------------------------------
        

        It said running in the GUI. I asked if I needed to run it from the Synology, but you just said to see the post above mine.

        1 Reply Last reply Reply Quote 0
        • bingo600B
          bingo600
          last edited by

          Is there an echo in here 😊

          If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

          pfSense+ 23.05.1 (ZFS)

          QOTOM-Q355G4 Quad Lan.
          CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
          LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

          johnpozJ 1 Reply Last reply Reply Quote 0
          • johnpozJ
            johnpoz LAYER 8 Global Moderator @bingo600
            last edited by johnpoz

            hehee - Yeah something getting missed. I clearly gave instructions in my post

            seemypost.png

            And I also uploaded the lastest 3.9 version for windows.. not sure why you would be running some old 3.1 version ;) Are you on linux - if so I Know they have later than 3.1 available

            An intelligent man is sometimes forced to be drunk to spend time with his fools
            If you get confused: Listen to the Music Play
            Please don't Chat/PM me for help, unless mod related
            SG-4860 24.11 | Lab VMs 2.8, 24.11

            K 1 Reply Last reply Reply Quote 0
            • bingo600B
              bingo600 @johnpoz
              last edited by

              @KDB9000
              @johnpoz said in Very Poor Performance on VLAN Routing:

              @bingo600 said in Very Poor Performance on VLAN Routing:

              DS1817+ Intel Atom C2538 Quad Core 4 Yes Avoton DDR3 2/8 GB

              http://www.jadahl.com/iperf-arp-scan/DSM_6.2/iperf_avoton-6.2_3.7-1.spk

              Install that spk, then ssh to your nas, then just run iperf3 -s

              Then hit your nas IP from linux or windows client also running iperf.. I compile iperf3 for windows myself..

              There was a slight hint in the post

              If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

              pfSense+ 23.05.1 (ZFS)

              QOTOM-Q355G4 Quad Lan.
              CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
              LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

              1 Reply Last reply Reply Quote 0
              • johnpozJ
                johnpoz LAYER 8 Global Moderator
                last edited by

                oh if your on say 18 of ubuntu, yeah that looks like only 3.1.3.. 21 currently has 3.9

                but shouldn't matter 3.1 to 3.7 would be ok, same port used.

                An intelligent man is sometimes forced to be drunk to spend time with his fools
                If you get confused: Listen to the Music Play
                Please don't Chat/PM me for help, unless mod related
                SG-4860 24.11 | Lab VMs 2.8, 24.11

                1 Reply Last reply Reply Quote 0
                • K
                  KDB9000 @johnpoz
                  last edited by

                  @johnpoz said in Very Poor Performance on VLAN Routing:

                  hehee - Yeah something getting missed. I clearly gave instructions in my post

                  seemypost.png

                  And I also uploaded the lastest 3.9 version for windows.. not sure why you would be running some old 3.1 version ;) Are you on linux - if so I Know they have later than 3.1 available

                  @bingo600 said in Very Poor Performance on VLAN Routing:

                  @KDB9000
                  @johnpoz said in Very Poor Performance on VLAN Routing:

                  @bingo600 said in Very Poor Performance on VLAN Routing:

                  DS1817+ Intel Atom C2538 Quad Core 4 Yes Avoton DDR3 2/8 GB

                  http://www.jadahl.com/iperf-arp-scan/DSM_6.2/iperf_avoton-6.2_3.7-1.spk

                  Install that spk, then ssh to your nas, then just run iperf3 -s

                  Then hit your nas IP from linux or windows client also running iperf.. I compile iperf3 for windows myself..

                  There was a slight hint in the post

                  Actually, nothing was missed. That part does not show on my side.

                  777c7527-d3b3-4970-adca-53b24b192350-image.png

                  K 1 Reply Last reply Reply Quote 0
                  • K
                    KDB9000 @KDB9000
                    last edited by KDB9000

                    The system has been auto updating the posts as they come in. I am guessing you edited it after the initial post and the system did not update it. When I refresh the whole thread, it now shows up (the screen shot was before I refresh the whole thread).

                    If you look at my post after yours with the Quote, it still shows the initial post quote that I responded to (which doesn't have the included instructions).

                    bingo600B 1 Reply Last reply Reply Quote 0
                    • bingo600B
                      bingo600 @KDB9000
                      last edited by

                      @kdb9000
                      Don't waste time on "instructions" 😊

                      We WANNA see the iperf3 results

                      If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

                      pfSense+ 23.05.1 (ZFS)

                      QOTOM-Q355G4 Quad Lan.
                      CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
                      LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

                      1 Reply Last reply Reply Quote 0
                      • K
                        KDB9000 @johnpoz
                        last edited by

                        @johnpoz @bingo600

                        System A > Synology (Same Network)

                        >iperf3.exe -c 192.168.10.246
                        Connecting to host 192.168.10.246, port 5201
                        [  4] local 192.168.10.60 port 58904 connected to 192.168.10.246 port 5201
                        [ ID] Interval           Transfer     Bandwidth
                        [  4]   0.00-1.00   sec  74.8 MBytes   627 Mbits/sec
                        [  4]   1.00-2.00   sec  74.8 MBytes   627 Mbits/sec
                        [  4]   2.00-3.00   sec  77.8 MBytes   652 Mbits/sec
                        [  4]   3.00-4.00   sec  78.1 MBytes   655 Mbits/sec
                        [  4]   4.00-5.00   sec  63.5 MBytes   533 Mbits/sec
                        [  4]   5.00-6.00   sec  73.6 MBytes   618 Mbits/sec
                        [  4]   6.00-7.00   sec  74.2 MBytes   623 Mbits/sec
                        [  4]   7.00-8.00   sec  76.2 MBytes   640 Mbits/sec
                        [  4]   8.00-9.00   sec  74.4 MBytes   623 Mbits/sec
                        [  4]   9.00-10.00  sec  75.9 MBytes   637 Mbits/sec
                        - - - - - - - - - - - - - - - - - - - - - - - - -
                        [ ID] Interval           Transfer     Bandwidth
                        [  4]   0.00-10.00  sec   743 MBytes   623 Mbits/sec                  sender
                        [  4]   0.00-10.00  sec   743 MBytes   623 Mbits/sec                  receiver
                        
                        iperf Done.
                        

                        System B > Synology (passing through pfSense)

                        >iperf3.exe -c 192.168.10.246
                        Connecting to host 192.168.10.246, port 5201
                        [  4] local 192.168.13.235 port 49405 connected to 192.168.10.246 port 5201
                        [ ID] Interval           Transfer     Bandwidth
                        [  4]   0.00-1.00   sec  78.0 MBytes   654 Mbits/sec
                        [  4]   1.00-2.00   sec  78.2 MBytes   656 Mbits/sec
                        [  4]   2.00-3.00   sec  78.0 MBytes   655 Mbits/sec
                        [  4]   3.00-4.00   sec  78.1 MBytes   655 Mbits/sec
                        [  4]   4.00-5.00   sec  78.1 MBytes   655 Mbits/sec
                        [  4]   5.00-6.00   sec  77.8 MBytes   652 Mbits/sec
                        [  4]   6.00-7.00   sec  77.9 MBytes   654 Mbits/sec
                        [  4]   7.00-8.00   sec  78.1 MBytes   655 Mbits/sec
                        [  4]   8.00-9.00   sec  78.2 MBytes   656 Mbits/sec
                        [  4]   9.00-10.00  sec  78.2 MBytes   656 Mbits/sec
                        - - - - - - - - - - - - - - - - - - - - - - - - -
                        [ ID] Interval           Transfer     Bandwidth
                        [  4]   0.00-10.00  sec   781 MBytes   655 Mbits/sec                  sender
                        [  4]   0.00-10.00  sec   781 MBytes   655 Mbits/sec                  receiver
                        
                        iperf Done.
                        

                        Drivers on all of the systems are up to date and the correct drives. The Synology is on the latest (and I do mean latest, I had to manually upload it from Synology) version of software. While the iperf seems to indicate there isn't a network issue, it doesn't explain why I have such a difference in speed in Layer 3 to Layer 2 (more then just SMB).
                        Before I moved the Synology to the same network as System A I would get the following (I don't have actual numbers, so it is from memory at this point) when running a backup:

                        System A (Main VLAN) > pfSense > Synology (Server VLAN) with speeds in the KB range and failure to complete
                        System A (Main VLAN) > Synology (Main VLAN) with speeds in the MB range and completed without an issue

                        When this test was done, I had two VLANs setup on the Synology (one on the Server VLAN and one on the Main VLAN). The backup is setup in the job to go to the Server VLAN IP. I told it to do a standalone backup (which is a full) to the Main VLAN IP of the Synology and got better results without failure of the backup. I also had issues uploading things to the Synology using OwnCloud when it was on the Server VLAN IP (no issues when it was on the Main VLAN IP, and this isn't SMB at this point). And those files were KB in size when it gave me issues. After the move to the Main VLAN, it didn't have an issue with those same files.

                        bingo600B 1 Reply Last reply Reply Quote 0
                        • bingo600B
                          bingo600 @KDB9000
                          last edited by bingo600

                          @kdb9000

                          Funny that you have better performance on B->S via Vlan , than A->S via L2.
                          Is your A machine weaker ?

                          Edit: You don't have Jumboframes enabled in one end do you ?

                          /Bingo

                          If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

                          pfSense+ 23.05.1 (ZFS)

                          QOTOM-Q355G4 Quad Lan.
                          CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
                          LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

                          K 1 Reply Last reply Reply Quote 0
                          • K
                            KDB9000 @bingo600
                            last edited by KDB9000

                            @bingo600 said in Very Poor Performance on VLAN Routing:

                            @kdb9000

                            Funny that you have better performance on B->S via Vlan , than A->S via L2.
                            Is your A machine weaker ?

                            /Bingo

                            System A is my main computer, which has a lot of stuff open and running on it (lots of chrome tabs, email, couple instances of Discord, SSH sessions, Skype, etc...). System B is my Gaming rig which has a couple chrome tabs and Discord running for the most part.

                            bingo600B 1 Reply Last reply Reply Quote 0
                            • bingo600B
                              bingo600 @KDB9000
                              last edited by

                              @kdb9000

                              Just for completeness , try to run iperf the other way.

                              NAS as client , to A/B as server

                              If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

                              pfSense+ 23.05.1 (ZFS)

                              QOTOM-Q355G4 Quad Lan.
                              CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
                              LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

                              K 1 Reply Last reply Reply Quote 0
                              • K
                                KDB9000 @bingo600
                                last edited by

                                @bingo600 said in Very Poor Performance on VLAN Routing:

                                @kdb9000

                                Just for completeness , try to run iperf the other way.

                                NAS as client , to A/B as server

                                Synology > System A

                                $ iperf3 -c 192.168.10.60
                                Connecting to host 192.168.10.60, port 5201
                                [  5] local 192.168.10.246 port 33627 connected to 192.168.10.60 port 5201
                                [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                [  5]   0.00-1.00   sec  38.0 MBytes   318 Mbits/sec    0   94.1 KBytes
                                [  5]   1.00-2.00   sec  40.9 MBytes   343 Mbits/sec    0   94.1 KBytes
                                [  5]   2.00-3.00   sec  39.0 MBytes   327 Mbits/sec    0   94.1 KBytes
                                [  5]   3.00-4.00   sec  39.9 MBytes   335 Mbits/sec    0   94.1 KBytes
                                [  5]   4.00-5.00   sec  37.7 MBytes   316 Mbits/sec    0   94.1 KBytes
                                [  5]   5.00-6.00   sec  38.5 MBytes   323 Mbits/sec    0   94.1 KBytes
                                [  5]   6.00-7.00   sec  35.7 MBytes   300 Mbits/sec    0   94.1 KBytes
                                [  5]   7.00-8.00   sec  38.8 MBytes   326 Mbits/sec    0   94.1 KBytes
                                [  5]   8.00-9.00   sec  41.5 MBytes   348 Mbits/sec    0   94.1 KBytes
                                [  5]   9.00-10.00  sec  41.5 MBytes   348 Mbits/sec    0   94.1 KBytes
                                - - - - - - - - - - - - - - - - - - - - - - - - -
                                [ ID] Interval           Transfer     Bitrate         Retr
                                [  5]   0.00-10.00  sec   392 MBytes   329 Mbits/sec    0             sender
                                [  5]   0.00-10.00  sec   391 MBytes   328 Mbits/sec                  receiver
                                
                                iperf Done.
                                

                                Synology > System B

                                $ iperf3 -c 192.168.13.235
                                Connecting to host 192.168.13.235, port 5201
                                [  5] local 192.168.10.246 port 52908 connected to 192.168.13.235 port 5201
                                [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                [  5]   0.00-1.00   sec  81.8 MBytes   686 Mbits/sec    0    271 KBytes
                                [  5]   1.00-2.00   sec  82.1 MBytes   689 Mbits/sec    0    271 KBytes
                                [  5]   2.00-3.00   sec  82.2 MBytes   690 Mbits/sec    0    271 KBytes
                                [  5]   3.00-4.00   sec  82.4 MBytes   691 Mbits/sec    0    271 KBytes
                                [  5]   4.00-5.00   sec  82.5 MBytes   692 Mbits/sec    0    271 KBytes
                                [  5]   5.00-6.00   sec  82.2 MBytes   690 Mbits/sec    0    271 KBytes
                                [  5]   6.00-7.00   sec  82.4 MBytes   691 Mbits/sec    0    271 KBytes
                                [  5]   7.00-8.00   sec  82.5 MBytes   692 Mbits/sec    0    271 KBytes
                                [  5]   8.00-9.00   sec  82.5 MBytes   692 Mbits/sec    0    271 KBytes
                                [  5]   9.00-10.00  sec  82.4 MBytes   691 Mbits/sec    0    271 KBytes
                                - - - - - - - - - - - - - - - - - - - - - - - - -
                                [ ID] Interval           Transfer     Bitrate         Retr
                                [  5]   0.00-10.00  sec   823 MBytes   690 Mbits/sec    0             sender
                                [  5]   0.00-10.00  sec   823 MBytes   690 Mbits/sec                  receiver
                                
                                iperf Done.
                                

                                I did also get this once on the Synology going to System B:

                                $ iperf3 -c 192.168.13.235
                                iperf3: error - unable to receive control message: Connection reset by peer
                                
                                bingo600B 1 Reply Last reply Reply Quote 0
                                • bingo600B
                                  bingo600 @KDB9000
                                  last edited by

                                  @kdb9000

                                  Again the L2 xfer is slower , this time by a huge margin.
                                  But still performing much better than your reported APP throughput.

                                  You don't run Teamed network cards , w. shared mac ?

                                  ISTR something like this a looong time ago on Cisco switches, when two HP servers was "teamed" and used the same MAC addr.

                                  The Cisco went crazy as it saw the same mac on two ports , and was flushing the TCAM as crazy.

                                  If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

                                  pfSense+ 23.05.1 (ZFS)

                                  QOTOM-Q355G4 Quad Lan.
                                  CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
                                  LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

                                  K 1 Reply Last reply Reply Quote 0
                                  • bingo600B
                                    bingo600
                                    last edited by

                                    Well time to get some ZZzzzz - EU TZ
                                    Good debug session

                                    But a bit strange you're not even close to 930Mb/s , even on L2.
                                    What netcards are in the NAS ?

                                    Take care

                                    /Bingo

                                    If you find my answer useful - Please give the post a šŸ‘ - "thumbs up"

                                    pfSense+ 23.05.1 (ZFS)

                                    QOTOM-Q355G4 Quad Lan.
                                    CPUĀ  : Core i5 5250U, Ram : 8GB Kingston DDR3LV 1600
                                    LANĀ  : 4 x Intel 211, DiskĀ  : 240G SAMSUNG MZ7L3240HCHQ SSD

                                    K 1 Reply Last reply Reply Quote 0
                                    • K
                                      KDB9000 @bingo600
                                      last edited by

                                      @bingo600 said in Very Poor Performance on VLAN Routing:

                                      @kdb9000

                                      Again the L2 xfer is slower , this time by a huge margin.
                                      But still performing much better than your reported APP throughput.

                                      You don't run Teamed network cards , w. shared mac ?

                                      ISTR something like this a looong time ago on Cisco switches, when two HP servers was "teamed" and used the same MAC addr.

                                      The Cisco went crazy as it saw the same mac on two ports , and was flushing the TCAM as crazy.

                                      The Synology has all 4 NICs bonded with LACP. The switch that the 4 connects are hooked up to are setup as an Aggregate on the switch side (which also uses LACP). I can see that happening if they did Teamed on the HP only without setting up the switch side (I have a coupler servers at work that use Teamed connections and they go into Port Channel groups on the switch).

                                      I have experience with LACP, and if it isn't configured correctly it won't work at all (ran into issues with Port Channels and the Active/Passive setup).

                                      1 Reply Last reply Reply Quote 0
                                      • K
                                        KDB9000 @bingo600
                                        last edited by

                                        @bingo600 said in Very Poor Performance on VLAN Routing:

                                        Well time to get some ZZzzzz - EU TZ
                                        Good debug session

                                        But a bit strange you're not even close to 930Mb/s , even on L2.
                                        What netcards are in the NAS ?

                                        Take care

                                        /Bingo

                                        What ever the built in ones are. The system doesn't really say.

                                        PippinP 1 Reply Last reply Reply Quote 0
                                        • PippinP
                                          Pippin @KDB9000
                                          last edited by

                                          The 5 different Synology models I opened up all had Etron Tech nic's.

                                          I gloomily came to the ironic conclusion that if you take a highly intelligent person and give them the best possible, elite education, then you will most likely wind up with an academic who is completely impervious to reality.
                                          Halton Arp

                                          1 Reply Last reply Reply Quote 0
                                          • First post
                                            Last post
                                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.