Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PC Engines apu2 experiences

    Scheduled Pinned Locked Moved Hardware
    711 Posts 73 Posters 777.1k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K
      kimble @fireodo
      last edited by

      @fireodo said in PC Engines apu2 experiences:

      PS. If someone likes to test too, here is the driver.apuled12.ko

      On v4.11.0.2:

      apuled0: <APU4> at iomem 0xfed81610-0xfed8161b,0xfed81664-0xfed81667 on isa0
      apuled0: Unable to allocate memory region 0
      device_attach: apuled0 attach returned 6
      

      If that's any help...

      fireodoF 1 Reply Last reply Reply Quote 0
      • fireodoF
        fireodo @kimble
        last edited by

        @kimble said in PC Engines apu2 experiences:

        On v4.11.0.2:

        As I wrote in my post before - it don't work on APUs with Bios 4.10 and above!

        apuled0: <APU4> at iomem 0xfed81610-0xfed8161b,0xfed81664-0xfed81667 on isa0
        apuled0: Unable to allocate memory region 0
        device_attach: apuled0 attach returned 6

        
        If that's any help...
        

        Regards and fine Weekend,
        fireodo

        Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
        SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
        pfsense 2.8.0 CE
        Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

        1 Reply Last reply Reply Quote 0
        • T
          tele_01
          last edited by

          I've updated an APU2C4 from 2.4.5p1 to 2.5. After adjusting some setup to new OpenVPN Client options it was working fine with my uploaded backup data from 2.4.5p1. Also Squid and pfBlockerNG Devil are working well. A real impact is the VPN speed - even if I've used the same settings as my VPN provider taught for version 2.5. I'm using OpenVPN with NordVPN and after updating the d/l speed is the half. Under 2.4.5p1 I've had about 96Mbit/s now at about 50Mbit/s. I've tried different options also under "Allow Compression" in the VPN Client settings but no change achieved so far, also with a different server. If this will is not getting better I'll go back to 2.4.5p1.

          By the way, the processor load was not above 90% via SSH with 2.5. On 2.4.5p1 I experienced sometimes more than 100Mbit/s in d/l (provider hosts max 120mbit) the processor load was at about 94%. I use Coreboot 4.0.7 because a lot of other rom's were not stable. I'll give 4.9.0.2 another try.

          T 1 Reply Last reply Reply Quote 0
          • S
            saltandpepper
            last edited by

            2.5 seems to have an impact on the performace. I didnt measure VPN traffic yet but on the WAN-LAN troughput i noticed a decrease around 200mbit (or 1/3).

            B 1 Reply Last reply Reply Quote 1
            • T
              tele_01 @tele_01
              last edited by

              @tele_01 To my initial post here - I've updated APU2C4 BIOS to the 4.9.0.2 rom and its stable for now. I've could achieve about 57 Mbit/s at 92% processor load via VPN which is a loss against 2.4.5p1. This is a huge difference in throughput per load under OpenVPN....going back to previous version 2.4.5p1.

              1 Reply Last reply Reply Quote 0
              • B
                bofh_1337 @saltandpepper
                last edited by

                @saltandpepper I experienced the same. Got a 400/50 but cannot archive more than 330-340 Mbit. 2.4.5 did not have any impact.

                B 1 Reply Last reply Reply Quote 0
                • B
                  bigsy @bofh_1337
                  last edited by

                  @bofh_1337 TekLager also report a reduction in routing from 750 Mbit/s (pfS 2.4.5) to 590 Mbit/s (pfS 2.5.0) on a single connection.

                  1 Reply Last reply Reply Quote 0
                  • T
                    tman222
                    last edited by tman222

                    There have been some changes on how FreeBSD 12 (on which pfSense 2.5.0 is based) handles the NIC driver interfacing with the OS kernel, which may be contributing to these performance changes. I wrote a little bit more about this here:

                    https://forum.netgate.com/topic/160932/pfsense-community-edition-ce-2-5-0-and-pfsense-plus-21-02-now-available/27

                    If you had some hardware tunables set for your Intel igb interfaces, it's probably worth reviewing them. They may need to bet set through iflib now, on in some cases may no longer be supported. Hope this helps.

                    1 Reply Last reply Reply Quote 1
                    • QinnQ
                      Qinn
                      last edited by Qinn

                      I read that they advice to not tweak anything for pfS 2.5.0, what they failed to (or I missed it) mention, is what the settings should be now?

                      Can anyone paste the settings for :

                      Web panel -> System -> Advanced -> Networking

                      Web panel -> System -> Advanced -> SystemTunables

                      net.inet6.ip6.redirect=0
                      net.inet.ip.redirect=0

                      and what should /boot/loader.conf.local be?

                      Hardeware: Intel(R) Celeron(R) J4125 CPU @ 2.00GHz 102 GB mSATA SSD (ZFS)
                      Firmware: Latest-stable-pfSense CE (amd64)
                      Packages: pfBlockerNG devel-beta (beta tester) - Avahi - Notes - Ntopng - PIMD/udpbroadcastrelay - Service Watchdog - System Patches

                      G 1 Reply Last reply Reply Quote 0
                      • G
                        GertJanT @Qinn
                        last edited by

                        @qinn Same here.
                        https://teklager.se/en/knowledge-base/apu2-1-gigabit-throughput-pfsense/
                        Here also all tweaks are mentioned but not clue what the new default should be.

                        QinnQ 1 Reply Last reply Reply Quote 0
                        • QinnQ
                          Qinn @GertJanT
                          last edited by Qinn

                          @gertjant It did a install on VM and found these, please remember this is not the same Hardware as the APU2. It would be nice if some can confirm this (btw I can remember that /boot/loader.conf.local had to be created and was not there in default pfSense, seems my VM install confirms this)

                          local.conf.local.png

                          System-Advanced-System Tunables.png

                          System-Advanced--Networking.png

                          Hardeware: Intel(R) Celeron(R) J4125 CPU @ 2.00GHz 102 GB mSATA SSD (ZFS)
                          Firmware: Latest-stable-pfSense CE (amd64)
                          Packages: pfBlockerNG devel-beta (beta tester) - Avahi - Notes - Ntopng - PIMD/udpbroadcastrelay - Service Watchdog - System Patches

                          K T 2 Replies Last reply Reply Quote 1
                          • K
                            kevindd992002 @Qinn
                            last edited by

                            @qinn said in PC Engines apu2 experiences:

                            @gertjant It did a install on VM and found these, please remember this is not the same Hardware as the APU2. It would be nice if some can confirm this (btw I can remember that /boot/loader.conf.local had to be created and was not there in default pfSense, seems my VM install confirms this)

                            local.conf.local.png

                            System-Advanced-System Tunables.png

                            System-Advanced--Networking.png

                            Thank you for doing this. I was planning on reverting the changes to their defaults as well but I forgot what the defaults were. After reading your post, I deleted /boot/loader.conf.local and reverted the ICMP redirects to 1.

                            The ICMP redirects issue is fixed as confirmed by @jimp here a few hours ago. So need for those tweaks.

                            1 Reply Last reply Reply Quote 0
                            • T
                              tman222 @Qinn
                              last edited by

                              I don't have a an APU2 to test, but I might try setting / modifying the following tunables in 2.5.0 to start see if performance improves:

                              hw.em.rx_process_limit="-1"
                              dev.igb.X.iflib.override_nrxds="2048"
                              dev.igb.X.iflib.override_ntxds="2048"
                              

                              where X is the interface number, i.e. 0, 1, 2....N. If 2048 is too low, one could also try 4096 for override_nrxds and override_ntxds to see if performance improves.

                              Hope this helps.

                              References:
                              https://www.freebsd.org/cgi/man.cgi?query=em&apropos=0&sektion=4&manpath=FreeBSD+12.2-RELEASE+and+Ports&arch=default&format=html
                              https://www.freebsd.org/cgi/man.cgi?query=iflib&apropos=0&sektion=4&manpath=FreeBSD+12.2-RELEASE+and+Ports&arch=default&format=html
                              https://forums.freebsd.org/threads/freebsd-12-sysctl-system-parameters.78806/

                              T 1 Reply Last reply Reply Quote 1
                              • T
                                tele_01 @tman222
                                last edited by tele_01

                                @tman222

                                Thank you tman222. When I put these changes into the executable prompt of the pfS or via SSH, is a reboot required?

                                T 1 Reply Last reply Reply Quote 0
                                • T
                                  tman222 @tele_01
                                  last edited by tman222

                                  @tele_01 said in PC Engines apu2 experiences:

                                  @tman222

                                  Thank you tman222. I've seen your username also in a German FreeBSD forum. When I put these changes into the executable prompt of the pfS or via SSH, is a reboot required?

                                  I would put them in your loader.conf.local file and then reboot. Once system has rebooted, login via ssh and confirm via the sysctl command that the tunables are properly set and then test.

                                  T 1 Reply Last reply Reply Quote 1
                                  • T
                                    tele_01 @tman222
                                    last edited by

                                    @tman222 said in PC Engines apu2 experiences:

                                    sysctl

                                    I did what you have recommended and could achieve the confirmation about tuneables via sysctl -f loader.conf.local file after reboot. I've tried both values whereas 2048 had a slightly better value with 58Mbit/s. Resuming by keeping also an eye on processor load, with pfS 2.4.5p1 the throughput was more than 40% higher (96Mbit/s) at the same processor load with approx 94%. I'm expecting the processing power of the AMD GX-412TC within the APU2C4 design is at its end supporting FreeBSD12.2 or higher, the NIC's and their integration are fine for me.

                                    T 1 Reply Last reply Reply Quote 0
                                    • T
                                      tman222 @tele_01
                                      last edited by

                                      @tele_01 said in PC Engines apu2 experiences:

                                      @tman222 said in PC Engines apu2 experiences:

                                      sysctl

                                      I did what you have recommended and could achieve the confirmation about tuneables via sysctl -f loader.conf.local file after reboot. I've tried both values whereas 2048 had a slightly better value with 58Mbit/s. Resuming by keeping also an eye on processor load, with pfS 2.4.5p1 the throughput was more than 40% higher (96Mbit/s) at the same processor load with approx 94%. I'm expecting the processing power of the AMD GX-412TC within the APU2C4 design is at its end supporting FreeBSD12.2 or higher, the NIC's and their integration are fine for me.

                                      @tele_01 - thanks for following up. Since the hw.igb.rx_process_limit and hw.igb.tx_process_limit tunables were removed in FreeBSD 12+, I was hoping that the hw.em.rx_process_limit tunable might be a replacement for both em and igb based cards (since those drivers were combined). But perhaps not. Interestingly enough, in my case I'm actually seeing somewhat of a throughput increase from 2.4.5p1 to 2.5.0, albeit with a more powerful system (Intel Xeon D-1518 based).

                                      T 1 Reply Last reply Reply Quote 1
                                      • T
                                        tele_01 @tman222
                                        last edited by

                                        @tman222 You are welcome - I was also interested. I went back to pfS 2.4.5p1 and I'm on 101Mbit/s throughput again with OpenVPN.

                                        1 Reply Last reply Reply Quote 0
                                        • P
                                          picov @saltandpepper
                                          last edited by

                                          @saltandpepper

                                          RAW DATA COMPARISION ON APU2 (apu2d4) BIOS v4.13.0.3 mainline

                                          • psSense 2.5.0
                                          • OPNSense 21.1.1
                                          • IPFire 2.25 - Core Update 153

                                          Two devices connected directly on WANs (same hardware, same software, same cables, same firmware, default installation tuning options)

                                          WAN to WAN

                                          • psSense 2.5.0
                                          [2.5.0-RELEASE][root@pfSense.localdomain]/root: iperf3 -c 192.168.1.1
                                          Connecting to host 192.168.1.1, port 5201
                                          [  5] local 192.168.1.2 port 23459 connected to 192.168.1.1 port 5201
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  32.2 MBytes   270 Mbits/sec    0    143 KBytes       
                                          [  5]   1.00-2.00   sec  29.1 MBytes   244 Mbits/sec    0    143 KBytes       
                                          [  5]   2.00-3.00   sec  32.5 MBytes   272 Mbits/sec    0    144 KBytes       
                                          [  5]   3.00-4.00   sec  29.1 MBytes   244 Mbits/sec    0    160 KBytes       
                                          [  5]   4.00-5.00   sec  32.2 MBytes   270 Mbits/sec    0    161 KBytes       
                                          [  5]   5.00-6.00   sec  32.3 MBytes   271 Mbits/sec    0    161 KBytes       
                                          [  5]   6.00-7.00   sec  32.4 MBytes   271 Mbits/sec    0    161 KBytes       
                                          [  5]   7.00-8.00   sec  28.2 MBytes   237 Mbits/sec    0    161 KBytes       
                                          [  5]   8.00-9.00   sec  32.3 MBytes   271 Mbits/sec    0    161 KBytes       
                                          [  5]   9.00-10.00  sec  32.4 MBytes   271 Mbits/sec    0    161 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec   313 MBytes   262 Mbits/sec    0             sender
                                          [  5]   0.00-10.26  sec   313 MBytes   256 Mbits/sec                  receiver
                                          
                                          [2.5.0-RELEASE][root@pfSense.localdomain]/root: iperf3 -c 192.168.1.1 -P 10
                                          
                                          I've lost detailed data for 10 connections, sorry, but I remember about 760 Mbits/sec in total
                                          
                                          • OPNSense 21.1.1
                                          root@OPNsense:~ # iperf3 -c 192.168.1.1 -p 22628
                                          Connecting to host 192.168.1.1, port 22628
                                          [  5] local 192.168.1.2 port 38078 connected to 192.168.1.1 port 22628
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  31.8 MBytes   266 Mbits/sec    0   96.2 KBytes       
                                          [  5]   1.00-2.00   sec  31.4 MBytes   263 Mbits/sec    0   96.2 KBytes       
                                          [  5]   2.00-3.00   sec  31.5 MBytes   264 Mbits/sec    0   96.2 KBytes       
                                          [  5]   3.00-4.00   sec  31.2 MBytes   262 Mbits/sec    0   96.2 KBytes       
                                          [  5]   4.00-5.00   sec  31.5 MBytes   265 Mbits/sec    0   96.2 KBytes       
                                          [  5]   5.00-6.00   sec  31.6 MBytes   265 Mbits/sec    0   96.2 KBytes       
                                          [  5]   6.00-7.00   sec  31.6 MBytes   265 Mbits/sec    0   96.2 KBytes       
                                          [  5]   7.00-8.00   sec  31.6 MBytes   265 Mbits/sec    0    113 KBytes       
                                          [  5]   8.00-9.00   sec  31.3 MBytes   263 Mbits/sec    0    113 KBytes       
                                          [  5]   9.00-10.00  sec  31.3 MBytes   263 Mbits/sec    0    113 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec   315 MBytes   264 Mbits/sec    0             sender
                                          [  5]   0.00-10.07  sec   315 MBytes   262 Mbits/sec                  receiver
                                          
                                          
                                          root@OPNsense:~ # iperf3 -c 192.168.1.1 -p 22628 -P 10
                                          ^C- - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [SUM]   0.00-0.00   sec  0.00 Bytes  0.00 bits/sec    0             sender
                                          [SUM]   0.00-0.00   sec  0.00 Bytes  0.00 bits/sec                  receiver
                                          iperf3: interrupt - the client has terminated
                                          root@OPNsense:~ # iperf3 -c 192.168.1.1 -p 38044 -P 10
                                          Connecting to host 192.168.1.1, port 38044
                                          [  5] local 192.168.1.2 port 17792 connected to 192.168.1.1 port 38044
                                          [  7] local 192.168.1.2 port 32377 connected to 192.168.1.1 port 38044
                                          [  9] local 192.168.1.2 port 8971 connected to 192.168.1.1 port 38044
                                          [ 11] local 192.168.1.2 port 47517 connected to 192.168.1.1 port 38044
                                          [ 13] local 192.168.1.2 port 37570 connected to 192.168.1.1 port 38044
                                          [ 15] local 192.168.1.2 port 63767 connected to 192.168.1.1 port 38044
                                          [ 17] local 192.168.1.2 port 23932 connected to 192.168.1.1 port 38044
                                          [ 19] local 192.168.1.2 port 34884 connected to 192.168.1.1 port 38044
                                          [ 21] local 192.168.1.2 port 64675 connected to 192.168.1.1 port 38044
                                          [ 23] local 192.168.1.2 port 14313 connected to 192.168.1.1 port 38044
                                          ...
                                          ...
                                          ...      
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.01  sec  69.0 MBytes  57.8 Mbits/sec    0             sender
                                          [  5]   0.00-10.11  sec  69.0 MBytes  57.3 Mbits/sec                  receiver
                                          [  7]   0.00-10.01  sec  65.1 MBytes  54.5 Mbits/sec    0             sender
                                          [  7]   0.00-10.11  sec  65.1 MBytes  54.0 Mbits/sec                  receiver
                                          [  9]   0.00-10.01  sec   101 MBytes  85.0 Mbits/sec    0             sender
                                          [  9]   0.00-10.11  sec   101 MBytes  84.2 Mbits/sec                  receiver
                                          [ 11]   0.00-10.01  sec  65.2 MBytes  54.6 Mbits/sec    0             sender
                                          [ 11]   0.00-10.11  sec  65.2 MBytes  54.1 Mbits/sec                  receiver
                                          [ 13]   0.00-10.01  sec  91.5 MBytes  76.7 Mbits/sec    0             sender
                                          [ 13]   0.00-10.11  sec  91.5 MBytes  76.0 Mbits/sec                  receiver
                                          [ 15]   0.00-10.01  sec  65.3 MBytes  54.7 Mbits/sec    0             sender
                                          [ 15]   0.00-10.11  sec  65.3 MBytes  54.2 Mbits/sec                  receiver
                                          [ 17]   0.00-10.01  sec  85.8 MBytes  71.9 Mbits/sec    0             sender
                                          [ 17]   0.00-10.11  sec  85.8 MBytes  71.2 Mbits/sec                  receiver
                                          [ 19]   0.00-10.01  sec  78.1 MBytes  65.4 Mbits/sec    0             sender
                                          [ 19]   0.00-10.11  sec  78.1 MBytes  64.8 Mbits/sec                  receiver
                                          [ 21]   0.00-10.01  sec  71.0 MBytes  59.4 Mbits/sec    0             sender
                                          [ 21]   0.00-10.11  sec  71.0 MBytes  58.9 Mbits/sec                  receiver
                                          [ 23]   0.00-10.01  sec  49.4 MBytes  41.4 Mbits/sec    0             sender
                                          [ 23]   0.00-10.11  sec  49.3 MBytes  41.0 Mbits/sec                  receiver
                                          [SUM]   0.00-10.01  sec   742 MBytes   622 Mbits/sec    0             sender
                                          [SUM]   0.00-10.11  sec   742 MBytes   616 Mbits/sec                  receiver
                                          
                                          
                                          • IPFire 2.25 - Core Update 153
                                          [root@ipfire ~]# iperf3 -c 192.168.1.1
                                          Connecting to host 192.168.1.1, port 5201
                                          [  5] local 192.168.1.2 port 39252 connected to 192.168.1.1 port 5201
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec   114 MBytes   957 Mbits/sec    0    402 KBytes       
                                          [  5]   1.00-2.00   sec   112 MBytes   939 Mbits/sec    0    402 KBytes       
                                          [  5]   2.00-3.00   sec   112 MBytes   942 Mbits/sec    0    419 KBytes       
                                          [  5]   3.00-4.00   sec   112 MBytes   942 Mbits/sec    0    440 KBytes       
                                          [  5]   4.00-5.00   sec   112 MBytes   944 Mbits/sec    0    440 KBytes       
                                          [  5]   5.00-6.00   sec   112 MBytes   941 Mbits/sec    0    440 KBytes       
                                          [  5]   6.00-7.00   sec   112 MBytes   942 Mbits/sec    0    440 KBytes       
                                          [  5]   7.00-8.00   sec   112 MBytes   942 Mbits/sec    0    440 KBytes       
                                          [  5]   8.00-9.00   sec   112 MBytes   943 Mbits/sec    0    440 KBytes       
                                          [  5]   9.00-10.00  sec   111 MBytes   932 Mbits/sec    0    440 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec    0             sender
                                          [  5]   0.00-10.03  sec  1.10 GBytes   938 Mbits/sec                  receiver
                                          
                                          
                                          
                                          [root@ipfire ~]# iperf3 -c 192.168.1.1 -P 10
                                          Connecting to host 192.168.1.1, port 5201
                                          [  5] local 192.168.1.2 port 39256 connected to 192.168.1.1 port 5201
                                          [  7] local 192.168.1.2 port 39258 connected to 192.168.1.1 port 5201
                                          [  9] local 192.168.1.2 port 39260 connected to 192.168.1.1 port 5201
                                          [ 11] local 192.168.1.2 port 39262 connected to 192.168.1.1 port 5201
                                          [ 13] local 192.168.1.2 port 39264 connected to 192.168.1.1 port 5201
                                          [ 15] local 192.168.1.2 port 39266 connected to 192.168.1.1 port 5201
                                          [ 17] local 192.168.1.2 port 39268 connected to 192.168.1.1 port 5201
                                          [ 19] local 192.168.1.2 port 39270 connected to 192.168.1.1 port 5201
                                          [ 21] local 192.168.1.2 port 39272 connected to 192.168.1.1 port 5201
                                          [ 23] local 192.168.1.2 port 39274 connected to 192.168.1.1 port
                                          ...
                                          ...
                                          ...
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec   115 MBytes  96.7 Mbits/sec    0             sender
                                          [  5]   0.00-10.01  sec   114 MBytes  95.8 Mbits/sec                  receiver
                                          [  7]   0.00-10.00  sec   110 MBytes  91.9 Mbits/sec    0             sender
                                          [  7]   0.00-10.01  sec   109 MBytes  91.3 Mbits/sec                  receiver
                                          [  9]   0.00-10.00  sec   110 MBytes  92.1 Mbits/sec    0             sender
                                          [  9]   0.00-10.01  sec   109 MBytes  91.3 Mbits/sec                  receiver
                                          [ 11]   0.00-10.00  sec   116 MBytes  97.2 Mbits/sec    0             sender
                                          [ 11]   0.00-10.01  sec   114 MBytes  95.9 Mbits/sec                  receiver
                                          [ 13]   0.00-10.00  sec   115 MBytes  96.7 Mbits/sec    0             sender
                                          [ 13]   0.00-10.01  sec   114 MBytes  95.9 Mbits/sec                  receiver
                                          [ 15]   0.00-10.00  sec   115 MBytes  96.5 Mbits/sec    0             sender
                                          [ 15]   0.00-10.01  sec   114 MBytes  95.8 Mbits/sec                  receiver
                                          [ 17]   0.00-10.00  sec   115 MBytes  96.7 Mbits/sec    0             sender
                                          [ 17]   0.00-10.01  sec   114 MBytes  95.9 Mbits/sec                  receiver
                                          [ 19]   0.00-10.00  sec   115 MBytes  96.4 Mbits/sec    0             sender
                                          [ 19]   0.00-10.01  sec   114 MBytes  95.6 Mbits/sec                  receiver
                                          [ 21]   0.00-10.00  sec   110 MBytes  92.0 Mbits/sec    0             sender
                                          [ 21]   0.00-10.01  sec   109 MBytes  91.2 Mbits/sec                  receiver
                                          [ 23]   0.00-10.00  sec   110 MBytes  92.6 Mbits/sec    0             sender
                                          [ 23]   0.00-10.01  sec   110 MBytes  91.9 Mbits/sec                  receiver
                                          [SUM]   0.00-10.00  sec  1.10 GBytes   949 Mbits/sec    0             sender
                                          [SUM]   0.00-10.01  sec  1.10 GBytes   940 Mbits/sec                  receiver
                                          
                                          

                                          OpenVPN (LAN2 to LAN1) AES128-CBC SHA1

                                          • psSense 2.5.0
                                          Connecting to host 192.168.101.1, port 5201
                                          [  5] local 10.10.11.2 port 36519 connected to 192.168.101.1 port 5201
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  5.28 MBytes  44.3 Mbits/sec    0   63.0 KBytes       
                                          [  5]   1.00-2.00   sec  5.25 MBytes  44.1 Mbits/sec    0   63.0 KBytes       
                                          [  5]   2.00-3.00   sec  5.27 MBytes  44.2 Mbits/sec    0   63.0 KBytes       
                                          [  5]   3.00-4.00   sec  5.10 MBytes  42.8 Mbits/sec    0   63.0 KBytes       
                                          [  5]   4.00-5.00   sec  5.00 MBytes  42.0 Mbits/sec    0   63.0 KBytes       
                                          [  5]   5.00-6.00   sec  5.18 MBytes  43.4 Mbits/sec    0   63.0 KBytes       
                                          [  5]   6.00-7.00   sec  5.25 MBytes  44.1 Mbits/sec    0   63.0 KBytes       
                                          [  5]   7.00-8.00   sec  5.15 MBytes  43.2 Mbits/sec    0   63.0 KBytes       
                                          [  5]   8.00-9.00   sec  5.24 MBytes  43.9 Mbits/sec    0   63.0 KBytes       
                                          [  5]   9.00-10.00  sec  5.23 MBytes  43.9 Mbits/sec    0   63.0 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  52.0 MBytes  43.6 Mbits/sec    0             sender
                                          [  5]   0.00-10.25  sec  51.9 MBytes  42.5 Mbits/sec                  receiver
                                          
                                          • OPNSense 21.1.1
                                          Connecting to host 192.168.101.1, port 24683
                                          [  5] local 10.10.11.2 port 39164 connected to 192.168.101.1 port 24683
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  4.88 MBytes  41.0 Mbits/sec    0   64.4 KBytes       
                                          [  5]   1.00-2.00   sec  4.80 MBytes  40.2 Mbits/sec    0   64.4 KBytes       
                                          [  5]   2.00-3.00   sec  4.81 MBytes  40.4 Mbits/sec    0   65.7 KBytes       
                                          [  5]   3.00-4.00   sec  4.74 MBytes  39.8 Mbits/sec    0   65.7 KBytes       
                                          [  5]   4.00-5.00   sec  4.80 MBytes  40.2 Mbits/sec    0   65.7 KBytes       
                                          [  5]   5.00-6.00   sec  4.76 MBytes  39.9 Mbits/sec    0   65.7 KBytes       
                                          [  5]   6.00-7.00   sec  4.77 MBytes  40.0 Mbits/sec    0   65.7 KBytes       
                                          [  5]   7.00-8.00   sec  4.80 MBytes  40.3 Mbits/sec    0   65.7 KBytes       
                                          [  5]   8.00-9.00   sec  4.76 MBytes  40.0 Mbits/sec    0   65.7 KBytes       
                                          [  5]   9.00-10.00  sec  4.75 MBytes  39.8 Mbits/sec    0   65.7 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  47.9 MBytes  40.2 Mbits/sec    0             sender
                                          [  5]   0.00-10.10  sec  47.8 MBytes  39.8 Mbits/sec                  receiver
                                          
                                          • IPFire 2.25 - Core Update 153
                                          Connecting to host 192.168.101.1, port 5201
                                          [  5] local 10.10.11.2 port 38256 connected to 192.168.101.1 port 5201
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  7.33 MBytes  61.5 Mbits/sec   29    134 KBytes       
                                          [  5]   1.00-2.00   sec  7.46 MBytes  62.6 Mbits/sec    0    163 KBytes       
                                          [  5]   2.00-3.00   sec  7.34 MBytes  61.5 Mbits/sec    0    190 KBytes       
                                          [  5]   3.00-4.00   sec  6.97 MBytes  58.5 Mbits/sec    0    213 KBytes       
                                          [  5]   4.00-5.00   sec  7.76 MBytes  65.1 Mbits/sec    5    176 KBytes       
                                          [  5]   5.00-6.00   sec  7.46 MBytes  62.6 Mbits/sec    0    199 KBytes       
                                          [  5]   6.00-7.00   sec  7.52 MBytes  63.1 Mbits/sec    0    223 KBytes       
                                          [  5]   7.00-8.00   sec  7.58 MBytes  63.6 Mbits/sec    2    183 KBytes       
                                          [  5]   8.00-9.00   sec  7.58 MBytes  63.6 Mbits/sec    0    206 KBytes       
                                          [  5]   9.00-10.00  sec  7.70 MBytes  64.6 Mbits/sec    0    226 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  74.7 MBytes  62.7 Mbits/sec   36             sender
                                          [  5]   0.00-10.05  sec  74.3 MBytes  62.0 Mbits/sec                  receiver
                                          

                                          OpenVPN (LAN2 to LAN1) AES128-GCM

                                          • psSense 2.5.0
                                          Connecting to host 192.168.105.1, port 5201
                                          [  5] local 10.10.15.2 port 24242 connected to 192.168.105.1 port 5201
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  6.26 MBytes  52.5 Mbits/sec    0   63.9 KBytes       
                                          [  5]   1.00-2.00   sec  6.14 MBytes  51.5 Mbits/sec    0   63.9 KBytes       
                                          [  5]   2.00-3.00   sec  6.16 MBytes  51.7 Mbits/sec    0   63.9 KBytes       
                                          [  5]   3.00-4.00   sec  5.97 MBytes  50.1 Mbits/sec    0   63.9 KBytes       
                                          [  5]   4.00-5.00   sec  6.28 MBytes  52.7 Mbits/sec    0   63.9 KBytes       
                                          [  5]   5.00-6.00   sec  6.12 MBytes  51.3 Mbits/sec    0   63.9 KBytes       
                                          [  5]   6.00-7.00   sec  6.15 MBytes  51.6 Mbits/sec    0   63.9 KBytes       
                                          [  5]   7.00-8.00   sec  6.02 MBytes  50.5 Mbits/sec    0   63.9 KBytes       
                                          [  5]   8.00-9.00   sec  6.24 MBytes  52.3 Mbits/sec    0   65.2 KBytes       
                                          [  5]   9.00-10.00  sec  6.24 MBytes  52.4 Mbits/sec    0   65.2 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  61.6 MBytes  51.7 Mbits/sec    0             sender
                                          [  5]   0.00-10.30  sec  61.6 MBytes  50.1 Mbits/sec                  receiver
                                          
                                          • OPNSense 21.1.1
                                          Connecting to host 192.168.101.1, port 24683
                                          [  5] local 10.10.11.2 port 39164 connected to 192.168.101.1 port 24683
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  4.88 MBytes  41.0 Mbits/sec    0   64.4 KBytes       
                                          [  5]   1.00-2.00   sec  4.80 MBytes  40.2 Mbits/sec    0   64.4 KBytes       
                                          [  5]   2.00-3.00   sec  4.81 MBytes  40.4 Mbits/sec    0   65.7 KBytes       
                                          [  5]   3.00-4.00   sec  4.74 MBytes  39.8 Mbits/sec    0   65.7 KBytes       
                                          [  5]   4.00-5.00   sec  4.80 MBytes  40.2 Mbits/sec    0   65.7 KBytes       
                                          [  5]   5.00-6.00   sec  4.76 MBytes  39.9 Mbits/sec    0   65.7 KBytes       
                                          [  5]   6.00-7.00   sec  4.77 MBytes  40.0 Mbits/sec    0   65.7 KBytes       
                                          [  5]   7.00-8.00   sec  4.80 MBytes  40.3 Mbits/sec    0   65.7 KBytes       
                                          [  5]   8.00-9.00   sec  4.76 MBytes  40.0 Mbits/sec    0   65.7 KBytes       
                                          [  5]   9.00-10.00  sec  4.75 MBytes  39.8 Mbits/sec    0   65.7 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  47.9 MBytes  40.2 Mbits/sec    0             sender
                                          [  5]   0.00-10.10  sec  47.8 MBytes  39.8 Mbits/sec                  receiver
                                          
                                          • IPFire 2.25 - Core Update 153
                                          Connecting to host 192.168.101.1, port 5201
                                          [  5] local 10.10.11.2 port 38388 connected to 192.168.101.1 port 5201
                                          [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                          [  5]   0.00-1.00   sec  8.19 MBytes  68.7 Mbits/sec   14    149 KBytes       
                                          [  5]   1.00-2.00   sec  8.55 MBytes  71.8 Mbits/sec    2    131 KBytes       
                                          [  5]   2.00-3.00   sec  9.11 MBytes  76.4 Mbits/sec    0    169 KBytes       
                                          [  5]   3.00-4.00   sec  9.05 MBytes  75.9 Mbits/sec    1    147 KBytes       
                                          [  5]   4.00-5.00   sec  9.05 MBytes  75.9 Mbits/sec    0    182 KBytes       
                                          [  5]   5.00-6.00   sec  8.86 MBytes  74.3 Mbits/sec   18    140 KBytes       
                                          [  5]   6.00-7.00   sec  8.68 MBytes  72.8 Mbits/sec    8   84.0 KBytes       
                                          [  5]   7.00-8.00   sec  8.31 MBytes  69.7 Mbits/sec    0    132 KBytes       
                                          [  5]   8.00-9.00   sec  8.92 MBytes  74.9 Mbits/sec   28    121 KBytes       
                                          [  5]   9.00-10.00  sec  8.62 MBytes  72.3 Mbits/sec    0    160 KBytes       
                                          - - - - - - - - - - - - - - - - - - - - - - - - -
                                          [ ID] Interval           Transfer     Bitrate         Retr
                                          [  5]   0.00-10.00  sec  87.3 MBytes  73.3 Mbits/sec   71             sender
                                          [  5]   0.00-10.05  sec  86.7 MBytes  72.4 Mbits/sec                  receiver
                                          
                                          
                                          

                                          During next days I'm planning to test the same scenario with recommended v4.11.0.3 mainline BIOS.

                                          1 Reply Last reply Reply Quote 1
                                          • P
                                            picov
                                            last edited by

                                            RAW DATA FOR APU2 (apu2d4 - 3 Intel I210 ethernet) BIOS v4.11.0.3 mainline

                                            WAN to WAN

                                            • psSense 2.5.0
                                            Connecting to host 192.168.1.1, port 5201
                                            [  5] local 192.168.1.2 port 50193 connected to 192.168.1.1 port 5201
                                            [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                            [  5]   0.00-1.00   sec  34.7 MBytes   291 Mbits/sec    0    113 KBytes       
                                            [  5]   1.00-2.00   sec  33.4 MBytes   280 Mbits/sec    0    113 KBytes       
                                            [  5]   2.00-3.00   sec  33.4 MBytes   280 Mbits/sec    0    113 KBytes       
                                            [  5]   3.00-4.00   sec  24.9 MBytes   209 Mbits/sec    1   1.41 KBytes       
                                            [  5]   4.00-5.00   sec  19.3 MBytes   162 Mbits/sec    1   1.41 KBytes       
                                            [  5]   5.00-6.00   sec  32.7 MBytes   275 Mbits/sec    0    129 KBytes       
                                            [  5]   6.00-7.00   sec  17.8 MBytes   149 Mbits/sec    0    127 KBytes       
                                            [  5]   7.00-8.00   sec  33.5 MBytes   281 Mbits/sec    0    129 KBytes       
                                            [  5]   8.00-9.00   sec  33.4 MBytes   280 Mbits/sec    0    129 KBytes       
                                            [  5]   9.00-10.00  sec  33.2 MBytes   278 Mbits/sec    0    129 KBytes       
                                            - - - - - - - - - - - - - - - - - - - - - - - - -
                                            [ ID] Interval           Transfer     Bitrate         Retr
                                            [  5]   0.00-10.00  sec   296 MBytes   249 Mbits/sec    2             sender
                                            [  5]   0.00-10.02  sec   296 MBytes   248 Mbits/sec                  receiver
                                            
                                            [2.5.0-RELEASE][root@pfSense.localdomain]/root: iperf3 -c 192.168.1.1 -P 10
                                            Connecting to host 192.168.1.1, port 5201
                                            [  5] local 192.168.1.2 port 65370 connected to 192.168.1.1 port 5201
                                            [  7] local 192.168.1.2 port 53598 connected to 192.168.1.1 port 5201
                                            [  9] local 192.168.1.2 port 6033 connected to 192.168.1.1 port 5201
                                            [ 11] local 192.168.1.2 port 33247 connected to 192.168.1.1 port 5201
                                            [ 13] local 192.168.1.2 port 30494 connected to 192.168.1.1 port 5201
                                            [ 15] local 192.168.1.2 port 41591 connected to 192.168.1.1 port 5201
                                            [ 17] local 192.168.1.2 port 36782 connected to 192.168.1.1 port 5201
                                            [ 19] local 192.168.1.2 port 10612 connected to 192.168.1.1 port 5201
                                            [ 21] local 192.168.1.2 port 16764 connected to 192.168.1.1 port 5201
                                            [ 23] local 192.168.1.2 port 53734 connected to 192.168.1.1 port 5201
                                            ...
                                            ...
                                            ...
                                            - - - - - - - - - - - - - - - - - - - - - - - - -
                                            [ ID] Interval           Transfer     Bitrate         Retr
                                            [  5]   0.00-10.00  sec   107 MBytes  89.8 Mbits/sec    0             sender
                                            [  5]   0.00-10.03  sec   107 MBytes  89.5 Mbits/sec                  receiver
                                            [  7]   0.00-10.00  sec  92.1 MBytes  77.3 Mbits/sec    0             sender
                                            [  7]   0.00-10.03  sec  92.1 MBytes  77.0 Mbits/sec                  receiver
                                            [  9]   0.00-10.00  sec   110 MBytes  92.5 Mbits/sec    0             sender
                                            [  9]   0.00-10.03  sec   110 MBytes  92.2 Mbits/sec                  receiver
                                            [ 11]   0.00-10.00  sec  79.7 MBytes  66.8 Mbits/sec    0             sender
                                            [ 11]   0.00-10.03  sec  79.6 MBytes  66.6 Mbits/sec                  receiver
                                            [ 13]   0.00-10.00  sec  96.0 MBytes  80.5 Mbits/sec    0             sender
                                            [ 13]   0.00-10.03  sec  95.9 MBytes  80.2 Mbits/sec                  receiver
                                            [ 15]   0.00-10.00  sec  78.9 MBytes  66.1 Mbits/sec    0             sender
                                            [ 15]   0.00-10.03  sec  78.9 MBytes  65.9 Mbits/sec                  receiver
                                            [ 17]   0.00-10.00  sec  97.8 MBytes  82.0 Mbits/sec    0             sender
                                            [ 17]   0.00-10.03  sec  97.7 MBytes  81.7 Mbits/sec                  receiver
                                            [ 19]   0.00-10.00  sec  73.8 MBytes  61.9 Mbits/sec    0             sender
                                            [ 19]   0.00-10.03  sec  73.8 MBytes  61.7 Mbits/sec                  receiver
                                            [ 21]   0.00-10.00  sec  94.0 MBytes  78.8 Mbits/sec    0             sender
                                            [ 21]   0.00-10.03  sec  94.0 MBytes  78.6 Mbits/sec                  receiver
                                            [ 23]   0.00-10.00  sec  94.5 MBytes  79.3 Mbits/sec    0             sender
                                            [ 23]   0.00-10.03  sec  94.4 MBytes  79.0 Mbits/sec                  receiver
                                            [SUM]   0.00-10.00  sec   924 MBytes   775 Mbits/sec    0             sender
                                            [SUM]   0.00-10.03  sec   924 MBytes   772 Mbits/sec                  receiver
                                            
                                            iperf Done.
                                            

                                            OpenVPN (LAN2 to LAN1) AES128-CBC SHA1

                                            • psSense 2.5.0
                                            [2.5.0-RELEASE][root@pfSense.localdomain]/root: iperf3 -c 192.168.101.1 
                                            Connecting to host 192.168.101.1, port 5201
                                            [  5] local 10.10.11.2 port 1521 connected to 192.168.101.1 port 5201
                                            [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                            [  5]   0.00-1.00   sec  6.08 MBytes  51.0 Mbits/sec    0   63.5 KBytes       
                                            [  5]   1.00-2.00   sec  6.00 MBytes  50.3 Mbits/sec    0   63.5 KBytes       
                                            [  5]   2.00-3.00   sec  5.97 MBytes  50.1 Mbits/sec    0   63.5 KBytes       
                                            [  5]   3.00-4.00   sec  5.97 MBytes  50.1 Mbits/sec    0   63.5 KBytes       
                                            [  5]   4.00-5.00   sec  5.98 MBytes  50.2 Mbits/sec    0   63.5 KBytes       
                                            [  5]   5.00-6.00   sec  5.97 MBytes  50.1 Mbits/sec    0   63.5 KBytes       
                                            [  5]   6.00-7.00   sec  5.94 MBytes  49.8 Mbits/sec    0   63.5 KBytes       
                                            [  5]   7.00-8.00   sec  6.02 MBytes  50.5 Mbits/sec    0   63.5 KBytes       
                                            [  5]   8.00-9.00   sec  5.98 MBytes  50.2 Mbits/sec    0   63.5 KBytes       
                                            [  5]   9.00-10.00  sec  6.03 MBytes  50.6 Mbits/sec    0   63.5 KBytes       
                                            - - - - - - - - - - - - - - - - - - - - - - - - -
                                            [ ID] Interval           Transfer     Bitrate         Retr
                                            [  5]   0.00-10.00  sec  59.9 MBytes  50.3 Mbits/sec    0             sender
                                            [  5]   0.00-10.04  sec  59.9 MBytes  50.1 Mbits/sec                  receiver
                                            

                                            OpenVPN (LAN2 to LAN1) AES256-CBC SHA256

                                            • psSense 2.5.0
                                            [2.5.0-RELEASE][root@pfSense.localdomain]/root: iperf3 -c 192.168.103.1
                                            Connecting to host 192.168.103.1, port 5201
                                            [  5] local 10.10.13.2 port 34867 connected to 192.168.103.1 port 5201
                                            [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                            [  5]   0.00-1.00   sec  5.35 MBytes  44.9 Mbits/sec    0   63.8 KBytes       
                                            [  5]   1.00-2.00   sec  5.27 MBytes  44.2 Mbits/sec    0   63.8 KBytes       
                                            [  5]   2.00-3.00   sec  5.21 MBytes  43.7 Mbits/sec    0   63.8 KBytes       
                                            [  5]   3.00-4.00   sec  5.19 MBytes  43.5 Mbits/sec    0   63.8 KBytes       
                                            [  5]   4.00-5.00   sec  5.20 MBytes  43.6 Mbits/sec    0   63.8 KBytes       
                                            [  5]   5.00-6.00   sec  5.15 MBytes  43.2 Mbits/sec    0   63.8 KBytes       
                                            [  5]   6.00-7.00   sec  5.15 MBytes  43.2 Mbits/sec    0   63.8 KBytes       
                                            [  5]   7.00-8.00   sec  5.17 MBytes  43.4 Mbits/sec    0   63.8 KBytes       
                                            [  5]   8.00-9.00   sec  5.14 MBytes  43.1 Mbits/sec    0   63.8 KBytes       
                                            [  5]   9.00-10.00  sec  5.04 MBytes  42.2 Mbits/sec    0   63.8 KBytes       
                                            - - - - - - - - - - - - - - - - - - - - - - - - -
                                            [ ID] Interval           Transfer     Bitrate         Retr
                                            [  5]   0.00-10.00  sec  51.9 MBytes  43.5 Mbits/sec    0             sender
                                            [  5]   0.00-10.17  sec  51.8 MBytes  42.7 Mbits/sec                  receiver
                                            

                                            OpenVPN (LAN2 to LAN1) AES128-GCM

                                            • psSense 2.5.0
                                            [2.5.0-RELEASE][root@pfSense.localdomain]/root: iperf3 -c 192.168.105.1
                                            Connecting to host 192.168.105.1, port 5201
                                            [  5] local 10.10.15.2 port 25682 connected to 192.168.105.1 port 5201
                                            [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
                                            [  5]   0.00-1.00   sec  6.37 MBytes  53.4 Mbits/sec    0   63.2 KBytes       
                                            [  5]   1.00-2.00   sec  6.30 MBytes  52.9 Mbits/sec    0   63.2 KBytes       
                                            [  5]   2.00-3.00   sec  6.30 MBytes  52.8 Mbits/sec    0   63.2 KBytes       
                                            [  5]   3.00-4.00   sec  6.15 MBytes  51.6 Mbits/sec    0   63.2 KBytes       
                                            [  5]   4.00-5.00   sec  6.20 MBytes  52.0 Mbits/sec    0   63.2 KBytes       
                                            [  5]   5.00-6.00   sec  6.09 MBytes  51.1 Mbits/sec    0   63.2 KBytes       
                                            [  5]   6.00-7.00   sec  6.07 MBytes  50.9 Mbits/sec    0   63.2 KBytes       
                                            [  5]   7.00-8.00   sec  6.27 MBytes  52.6 Mbits/sec    0   63.2 KBytes       
                                            [  5]   8.00-9.00   sec  6.19 MBytes  51.9 Mbits/sec    0   63.2 KBytes       
                                            [  5]   9.00-10.00  sec  6.27 MBytes  52.6 Mbits/sec    0   63.2 KBytes       
                                            - - - - - - - - - - - - - - - - - - - - - - - - -
                                            [ ID] Interval           Transfer     Bitrate         Retr
                                            [  5]   0.00-10.00  sec  62.2 MBytes  52.2 Mbits/sec    0             sender
                                            [  5]   0.00-10.04  sec  62.2 MBytes  51.9 Mbits/sec                  receiver
                                            
                                            1 Reply Last reply Reply Quote 1
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.