Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    iperf3 testing 500/40 connection: 33mpbs

    Scheduled Pinned Locked Moved General pfSense Questions
    39 Posts 5 Posters 5.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnpozJ
      johnpoz LAYER 8 Global Moderator @Cabledude
      last edited by

      @cabledude said in iperf3 testing 500/40 connection: 33mpbs:

      Is openVPN even a viable solution at all if I would like to achieve several 100 mbps throughput?
      Thanks

      Sure it is.. Keep in mind that the outside tunnel is normally UDP, where there is not acks, etc. so the tcp traffic inside window size can be adjusted.

      There is also the MTU of the tunnel that can be adjust, etc.

      the only factor that is within our control is the window size

      This is true when your talking about BDP sure..

      only I will be stressing it for speed.

      Not sure exactly what that means - what speed are you trying to achive, and why?

      Is openVPN even a viable solution at all if I would like to achieve several 100 mbps throughput?

      Yeah it is.. This is becoming dated but you might want to look at
      https://community.openvpn.net/openvpn/wiki/Gigabit_Networks_Linux

      Here is is really a pretty much stock openvpn connection running on a very low cost VPS I have out in LV.. Look at the latency.. And still can achieve almost 200mbps through it.. My upload is limited to 50, and looking I currently have 2 clients streaming off my plex server.. So

      speedtest.jpg

      here is plex running

      plex.jpg

      Which could put a real stress on my upload. So I wouldn't look to much at that, I only have 50 up max.. And this time of night its rare to see that..

      I wasn't try to push you away from openvpn, was just trying to point out when doing such tests that quite often there can be variables at play that typical users might not be aware of that can effect results, etc.

      An intelligent man is sometimes forced to be drunk to spend time with his fools
      If you get confused: Listen to the Music Play
      Please don't Chat/PM me for help, unless mod related
      SG-4860 24.11 | Lab VMs 2.8, 24.11

      C 1 Reply Last reply Reply Quote 0
      • C
        Cabledude @johnpoz
        last edited by Cabledude

        @johnpoz Thank you, that helps somewhat. And I mean that in a very positive way as I consider myself a newbie here. Only a year ago I was quite unaware of networking, except that I knew how to set up a router in bridge mode and configure my own firewall (started with UniFi USG, now SG-1100).
        I am really struggling with this VPN stuff as I feel I need to learn so much in order to be able to do even some simple tricks. It took me quite some hours of learning how to set up OpenVPN on pfSense (with FreeRADIUS to authenticate) and connect to my network from my Macbook while off site. I managed to do this, with mostly default settings. It's like learning how to sail: one can be up and going in a few days but learning the fine details can take years.

        Anyway sorry for the long post this has become.

        I absolutely don't understand how you manage 200mbps with 70ms latency:

        b48d20a4-c89f-4fbb-a8a0-f061032faae1-image.jpeg
        So you would need a massive window size to accomplish this. Or am I seeing this the wrong way? Could you shed some light or share your secret?

        Thanks,
        Pete

        Pete
        Home: SG-2100 + UniFi + Synology. SG-1100 retired
        Parents: SG-1100 + UniFi + Synology
        Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

        johnpozJ 1 Reply Last reply Reply Quote 0
        • johnpozJ
          johnpoz LAYER 8 Global Moderator @Cabledude
          last edited by johnpoz

          @cabledude keep in mind doing multiple streams - the other option to doing large window sizes ;) for overcoming latency..

          Game is on - so don't have a chance currently... But I will repeat the test in morning and check the window size being used.

          Just wanted to show that openvpn can quite easy handle over 100mbps..

          An intelligent man is sometimes forced to be drunk to spend time with his fools
          If you get confused: Listen to the Music Play
          Please don't Chat/PM me for help, unless mod related
          SG-4860 24.11 | Lab VMs 2.8, 24.11

          C 1 Reply Last reply Reply Quote 1
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            As a side note I enable fastIO and set send/recv buffers to 512K on pretty much any server I configure these days. Unless it's a TCP tunnel but if you're doing that speed will be low anyway.

            Steve

            1 Reply Last reply Reply Quote 1
            • C
              Cabledude @johnpoz
              last edited by Cabledude

              @johnpoz @stephenw10 : If I put up a VPN connection on two SG-1100 units, one at each node, I can probably max out that hardware.

              I just had an insight: replacing the hardware at only one end node (e.g. swapping one of the SG-1100's for a beefy SG-6100) will probably make zero difference as the other end will be the bottleneck. Correct?

              Thanks,
              Pete

              Pete
              Home: SG-2100 + UniFi + Synology. SG-1100 retired
              Parents: SG-1100 + UniFi + Synology
              Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

              1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                Probably, though there is a difference between encode and decode loading you may find it helps in one direction.

                Steve

                C 1 Reply Last reply Reply Quote 0
                • B
                  Boethius @Cabledude
                  last edited by

                  This post is deleted!
                  1 Reply Last reply Reply Quote 0
                  • C
                    Cabledude @stephenw10
                    last edited by

                    @stephenw10 The key assumption is that the firewall CPU is the bottleneck, correct? So you are suggesting there might be an asynchronous CPU load for server side vs client side? That sounds interesting.
                    The next question then is: at which end would I place the most powerful device?

                    No wait - I should be able to figure this out myself by testing the same connection again and then watch the CPU load at both ends and look for differences. Would this be a good approach?

                    Pete
                    Home: SG-2100 + UniFi + Synology. SG-1100 retired
                    Parents: SG-1100 + UniFi + Synology
                    Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

                    1 Reply Last reply Reply Quote 0
                    • stephenw10S
                      stephenw10 Netgate Administrator
                      last edited by

                      Yes, I would do that. It's not a huge difference but if you're only upgrading one side you might as well do it to the side seeing the heaviest load.

                      Steve

                      C 1 Reply Last reply Reply Quote 0
                      • C
                        Cabledude @stephenw10
                        last edited by

                        @stephenw10 Just one more question to make this effort more than just academic: How would I create multiple simultaneous VPN connections? If I'd create several VPN server instances in the OpenVPN settings, I can only assume I'd have to choose a different tunnel subnet for each, and how would they together constitute one "wide" connection with permissions to the same VLAN(s)? How would the system balance routing packets through the individual tunnels? Or am I seeing this all the wrong way?

                        Thanks, Pete

                        Pete
                        Home: SG-2100 + UniFi + Synology. SG-1100 retired
                        Parents: SG-1100 + UniFi + Synology
                        Testing: SG-1100 w/ 120GB SSD via ext USB (eMMC dead). Works great

                        1 Reply Last reply Reply Quote 0
                        • stephenw10S
                          stephenw10 Netgate Administrator
                          last edited by stephenw10

                          It's possible to do that. You have to use policy routing with a load-balanced gateway group setup with both remote side IPs as gateways.

                          However that only works for multiple connections between the sites. For a single file transfer for example it will only use one tunnel.

                          Steve

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.