Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Slow Iperf3 Results

    Scheduled Pinned Locked Moved General pfSense Questions
    11 Posts 3 Posters 529 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • S
      stevencavanagh
      last edited by

      Hi,

      Thought I had bottomed this some time ago by removing traffic shaper, anyway here goes............

      Just recently decided for some unknown reason to try an Iperf3 test from my laptop to both my Synology NAS, which is on a separate VLAN and the results are below:-

      First NAS - 1G link

      4a2a472c-86de-42ca-8972-95dbc9bd4474-image.png

      Second NAS - 10G link

      75c29ca2-8944-4e01-853a-bad2174335ff-image.png

      To a PC on the same VLAN

      c9a86a8f-08a4-48c3-a5d3-6830fe0a974e-image.png

      Cannot get my head around it as it was all working at 112MB (max) so not sure what is going on. There are no limiters but Limiter info shows:-

      dd095cee-3597-473e-b5f4-0f2e2e9e2d50-image.png

      Not sure if this makes any difference but cannot seem to delete it!

      Any thoughts of where to go from here??

      Steve

      johnpozJ 1 Reply Last reply Reply Quote 0
      • johnpozJ
        johnpoz LAYER 8 Global Moderator @stevencavanagh
        last edited by

        @stevencavanagh said in Slow Iperf3 Results:

        To a PC on the same VLAN

        and how would anything on pfsense have to do with client on network talking to another device on the same network.. Pfsense would have nothing to do with that conversation.. Unless devices were on opposite sides of bridge that is on pfsense.

        An intelligent man is sometimes forced to be drunk to spend time with his fools
        If you get confused: Listen to the Music Play
        Please don't Chat/PM me for help, unless mod related
        SG-4860 24.11 | Lab VMs 2.8, 24.11

        S 1 Reply Last reply Reply Quote 0
        • S
          stevencavanagh @johnpoz
          last edited by

          @johnpoz

          Yes, cracking up slowly, bad day at work. It would just go the switch and back down. Think last time I did this the laptop was set up for the guest VLAN!

          However, as both are on the same LAN and would connect to the same switch, can't understand why

          johnpozJ 1 Reply Last reply Reply Quote 0
          • johnpozJ
            johnpoz LAYER 8 Global Moderator @stevencavanagh
            last edited by

            @stevencavanagh something is for sure not right there.. Those are horrible, even for wireless ;)

            Wired gig should be low to mid 900s for sure - and pretty rock solid stable..

            You might want to try with -R to see if better in other direction.

            here is gig to my nas from my pc

            $ iperf3.exe -c 192.168.9.10
            Connecting to host 192.168.9.10, port 5201
            [  5] local 192.168.9.100 port 32772 connected to 192.168.9.10 port 5201
            [ ID] Interval           Transfer     Bitrate
            [  5]   0.00-1.00   sec   115 MBytes   964 Mbits/sec
            [  5]   1.00-2.00   sec   113 MBytes   949 Mbits/sec
            [  5]   2.00-3.01   sec   114 MBytes   949 Mbits/sec
            [  5]   3.01-4.00   sec   112 MBytes   948 Mbits/sec
            [  5]   4.00-5.00   sec   114 MBytes   949 Mbits/sec
            [  5]   5.00-6.01   sec   114 MBytes   949 Mbits/sec
            [  5]   6.01-7.01   sec   112 MBytes   949 Mbits/sec
            [  5]   7.01-8.00   sec   113 MBytes   950 Mbits/sec
            [  5]   8.00-9.01   sec   114 MBytes   949 Mbits/sec
            [  5]   9.01-10.02  sec   114 MBytes   949 Mbits/sec
            - - - - - - - - - - - - - - - - - - - - - - - - -
            [ ID] Interval           Transfer     Bitrate
            [  5]   0.00-10.02  sec  1.11 GBytes   951 Mbits/sec                  sender
            [  5]   0.00-10.03  sec  1.11 GBytes   949 Mbits/sec                  receiver
            
            iperf Done.
            

            Here is with -R

            $ iperf3.exe -c 192.168.9.10 -R
            Connecting to host 192.168.9.10, port 5201
            Reverse mode, remote host 192.168.9.10 is sending
            [  5] local 192.168.9.100 port 32792 connected to 192.168.9.10 port 5201
            [ ID] Interval           Transfer     Bitrate
            [  5]   0.00-1.01   sec   113 MBytes   936 Mbits/sec
            [  5]   1.01-2.01   sec   113 MBytes   950 Mbits/sec
            [  5]   2.01-3.01   sec   113 MBytes   949 Mbits/sec
            [  5]   3.01-4.01   sec   114 MBytes   948 Mbits/sec
            [  5]   4.01-5.01   sec   112 MBytes   949 Mbits/sec
            [  5]   5.01-6.01   sec   112 MBytes   943 Mbits/sec
            [  5]   6.01-7.01   sec   114 MBytes   950 Mbits/sec
            [  5]   7.01-8.01   sec   112 MBytes   948 Mbits/sec
            [  5]   8.01-9.00   sec   112 MBytes   944 Mbits/sec
            [  5]   9.00-10.01  sec   114 MBytes   944 Mbits/sec
            - - - - - - - - - - - - - - - - - - - - - - - - -
            [ ID] Interval           Transfer     Bitrate         Retr
            [  5]   0.00-10.01  sec  1.11 GBytes   948 Mbits/sec  164            sender
            [  5]   0.00-10.01  sec  1.10 GBytes   946 Mbits/sec                  receiver
            
            iperf Done.
            

            On side note 3.1.3 is pretty old version 3.18 of iperf is current. I compile it myself and have it available for download if your interested.. Could post up a link, but here is also a good place to get windows versions

            https://github.com/ar51an/iperf3-win-builds

            An intelligent man is sometimes forced to be drunk to spend time with his fools
            If you get confused: Listen to the Music Play
            Please don't Chat/PM me for help, unless mod related
            SG-4860 24.11 | Lab VMs 2.8, 24.11

            S 1 Reply Last reply Reply Quote 0
            • S
              stevencavanagh @johnpoz
              last edited by

              @johnpoz
              I used to get similar results to yourself once I removed the limiter 6 months ago. I have tweaked how my edge switches are connected to the core switch since I have now got Pfsense connected to it via SFP+ but I have checked and the edge switches connect direct to the core and I cannot see any loops etc.

              All the network appears to work, just slowly but everything is uplinked on 10G so a bit confused!

              If you have a link for the latest Iperf, that would be great.

              PS. Did notice thatcwhen I was logged into the switch dashboard monitoring the traffic as Iperf was running, the switch kept losing connection and reconnecting hence I wondered if I had a network loop.

              johnpozJ 1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                The server end would normally show the retransmit count. And on a connection like that I'd expect to see a large number of them!

                But, yes, that must be something between the hosts and switch and not pfSense.

                S 1 Reply Last reply Reply Quote 0
                • S
                  stevencavanagh @stephenw10
                  last edited by

                  @stephenw10

                  I will take a look at the server end and see what is going on

                  S 1 Reply Last reply Reply Quote 0
                  • S
                    stevencavanagh @stevencavanagh
                    last edited by

                    @stevencavanagh

                    Now I am confused, went to have a look at the server end to see the number of retries and it is all zero! Running Iperf again and got the result below from one of the servers (across a VLAN).......

                    dcf8db07-01fa-4149-b60f-d92dc245ac5f-image.png

                    All other Iperf results I showed earlier show the same i.e. as it should be.

                    After I had this issue I went up to the network just to check for any obvious network loops and did not find any but did find that the 2 cat 6 cables (LAGG) from the spare Pfsense PC (switched off) was still connected to the switch in question even though the connection is now SFP+ 10G but can't imagine that would make a difference but I disconnected them anyway.

                    Would that have made a difference?

                    Also looked at Pfsense and it showed the WAN down with 100% packet loss but I still had internet!! Iperf results were good.

                    Rebooted Pfsense and WAN showing healthy and all Iperf results good. Only change is disconnecting the unused two cat 6 cables from the old LAGG connection from switch to the spare (powered off) Pfsense PC.

                    Steve

                    1 Reply Last reply Reply Quote 0
                    • johnpozJ
                      johnpoz LAYER 8 Global Moderator @stevencavanagh
                      last edited by

                      @stevencavanagh said in Slow Iperf3 Results:

                      If you have a link for the latest Iperf, that would be great.

                      You can get it here directly

                      https://github.com/ar51an/iperf3-win-builds/releases/download/3.18/iperf-3.18-win64.zip

                      An intelligent man is sometimes forced to be drunk to spend time with his fools
                      If you get confused: Listen to the Music Play
                      Please don't Chat/PM me for help, unless mod related
                      SG-4860 24.11 | Lab VMs 2.8, 24.11

                      1 Reply Last reply Reply Quote 1
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Could have been some sort of loop then. Or maybe some asymmetry.

                        If it was a loop/flood you'd see it in the traffic graphs from the time. If it was going through pfSense at least.

                        S 1 Reply Last reply Reply Quote 0
                        • S
                          stevencavanagh @stephenw10
                          last edited by

                          @stephenw10 said in Slow Iperf3 Results:

                          Could have been some sort of loop then. Or maybe some asymmetry.

                          If it was a loop/flood you'd see it in the traffic graphs from the time. If it was going through pfSense at least.

                          Must have been a loop, just flooded the 1G connection and monitored on the switch and it didn't once loose connection and had to reconnect. Very strange.

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.