Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    PC Engines apu2 experiences

    Scheduled Pinned Locked Moved Hardware
    711 Posts 73 Posters 773.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DaddyGoD
      DaddyGo
      last edited by

      Of the above two providers, it uses one CBC and the other GCM, due to the finite performance of the APU board, no significant difference is seen.

      I know he doesn't say it helps ;-) (NCP)

      IPsec requires a little more care to set up, there are several good descriptions as I have seen in the forum in the past.

      What I can tell you for sure is that I know APU boards very well, and we love them very much.
      Only as long as the Chihuahua is a good lap dog, he is a very bad Caucasian bear killer. :-)

      Cats bury it so they can't see it!
      (You know what I mean if you have a cat)

      K 1 Reply Last reply Reply Quote 0
      • K
        kevindd992002 @DaddyGo
        last edited by

        @DaddyGo said in PC Engines apu2 experiences:

        Of the above two providers, it uses one CBC and the other GCM, due to the finite performance of the APU board, no significant difference is seen.

        I know he doesn't say it helps ;-) (NCP)

        IPsec requires a little more care to set up, there are several good descriptions as I have seen in the forum in the past.

        What I can tell you for sure is that I know APU boards very well, and we love them very much.
        Only as long as the Chihuahua is a good lap dog, he is a very bad Caucasian bear killer. :-)

        My bad then :)

        Yeah, there's too many variables with IPsec and I hate that FreeBSD doesn't support reply-to's but hey if it's faster then I'm all for making it work. This is just for home user between two sites anyway.

        1 Reply Last reply Reply Quote 0
        • DaddyGoD
          DaddyGo
          last edited by

          Yeeeppp, then they will....do
          The guys at Netgate love IPsec (let’s say I understand), but they also support OpenVPN very well.
          We’ll see what the future holds, just thinking about TNSR and IPsec, hmmmm

          Cats bury it so they can't see it!
          (You know what I mean if you have a cat)

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            Indeed. Enabling NCP merely allows the two ends to negotiate a cipher and even then they both have to have ciphers set that match.
            I don't have an APU2 to test with but IIRC the updated CPU is aes-ni capable. That should be measurably faster using AES-GCM over AES-CBC+SHA1/256.

            Alternatively if the restriction is at the server end it should use less CPU to pass the same bandwidth.

            Steve

            DaddyGoD 1 Reply Last reply Reply Quote 0
            • DaddyGoD
              DaddyGo @stephenw10
              last edited by

              @stephenw10

              Yes, you remember correctly MOBO has aes-ni ability, based on AMD Embedded G series GX-412TC CPU,
              low power consumption (12W) like SOHO router category, 4 CPU core (1400 Core Performance Boost (CPB) /1000/1000/1000), 4GB DDR3-1333 with ECC and 4x Intel i211 characterizes the device (APU4).
              In light of the above, the MOBO can't do more with OpenVPN either, unfortunately. (cca. 50 - 60 Mbps)

              We tried it with a completely clean pfSense installation, only an OpenVPN connection was installed and we used an ISP 1000/1000 with a business subscription with a fixed IP without filters on FTTB.

              Absolutely true:
              Alternatively if the restriction is at the server end it should use less CPU to pass the same bandwidth.

              In the tests mentioned, our own OpenVPN server was in a data center rented in BIX (4x10Gig) and the APU was at the end of the FTTB (1Gig).

              This should not scare anyone from using APU boards, which is a great good little tool for external colleagues, smaller sites endpoints.

              Cats bury it so they can't see it!
              (You know what I mean if you have a cat)

              1 Reply Last reply Reply Quote 0
              • S
                saltandpepper @dugeem
                last edited by saltandpepper

                Hi

                Currently im running in APU2. Till 2 weeks ago I was able to get 1gibt trough my Box. 1Gbit is on the edge but it worked. Around 2 weeks ago I startet to play with traffic shapping. Unfortunatly since then I was not able to revert back to a setup that gets nearly close to my previous performance.

                To check if the issue us on my side or my ISP i changed the router, which gave me my Gbit back.

                Since im quite sertain that the issue is in my network i startet to test with iperf. No matter how much connection i open i only get around 400mbit trough. If only one connection is, 20 or 100. Around 400 - 420mbit is the limit. Previous i got 940mbit as expected with iperf. I already startet to test my switches, but I get 940mbit to the last switch.
                After i tested all my equitment, I reinstalled Pfsense and did my confing manualy. Still 400mbit, in up and download. The settings that i use are the same as mentioned by dugeem.

                @dugeem said in PC Engines apu2 experiences:

                My current APU2 performance tweak summary:

                1. Upgrade BIOS to enable CPB (mainline v4.9.0.2 or later, legacy v4.0.25 or later)
                2. Disable ICMP Redirects to enable tryforward routing path (under System / Advanced / System Tunables set net.inet.ip.redirect & net.inet6.ip6.redirect to 0)
                3. Add hw.igb.rx_process_limit=-1 to /boot/loader.conf.local

                There may well be other tweaks but for our power efficient APU2 routers these tweaks should serve most well. And when my home internet evolves to 500Mb/s I'll worry some more ☺

                The only thing that i have not done yet is a bios rollback to 4.11.04
                Still 400mbit

                Maybe someone has an idea whats currently is wrong with my setup.

                Cheers

                1 Reply Last reply Reply Quote 0
                • fireodoF
                  fireodo
                  last edited by

                  Update APU2 Bios from v4.11.0.6 to v4.12.0.1 on 2 boxes - until now without issues.

                  Regards,
                  fireodo

                  Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                  SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                  pfsense 2.7.2 CE
                  Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                  QinnQ 1 Reply Last reply Reply Quote 1
                  • QinnQ
                    Qinn @fireodo
                    last edited by

                    @fireodo Will try tomorrow, thanks for reporting!

                    Hardeware: Intel(R) Celeron(R) J4125 CPU @ 2.00GHz 102 GB mSATA SSD (ZFS)
                    Firmware: Latest-stable-pfSense CE (amd64)
                    Packages: pfBlockerNG devel-beta (beta tester) - Avahi - Notes - Ntopng - PIMD/udpbroadcastrelay - Service Watchdog - System Patches

                    1 Reply Last reply Reply Quote 0
                    • F
                      FLOK
                      last edited by

                      Hi folks,

                      since yesterday i have fiber at home with 300MBits Up and down.
                      But i cant get a real good performance....okay....its really poor.
                      So i made an Bios upgrade on my APU2D4 from 4.07 to 4.12.01.
                      pfsense.png

                      Then created the /boot/loader.conf.local file an inserted (with nano):
                      hw.igb.rx_process_limit="-1 ".

                      TSO and LRO are disabled.
                      Reboot...

                      But still a poor performance: Iperf3 to an public Server ~30MBits/s.
                      Here a my tunables (are they all necessary ??)
                      Tunables.jpg

                      Any hints ?

                      QinnQ 1 Reply Last reply Reply Quote 0
                      • QinnQ
                        Qinn @FLOK
                        last edited by

                        @FLOK I hope this might helps...

                        A reboot after an bios update is not enough, it is recommended to shutdown the APU2 and make it powerless, this can be done gracefully using the GUI and go to Diagnostics -> Halt system and wait for the lights on the APU2 to go down, than remove the powerplug and wait for 30 sec and put it back in, hope it helps.

                        Hardeware: Intel(R) Celeron(R) J4125 CPU @ 2.00GHz 102 GB mSATA SSD (ZFS)
                        Firmware: Latest-stable-pfSense CE (amd64)
                        Packages: pfBlockerNG devel-beta (beta tester) - Avahi - Notes - Ntopng - PIMD/udpbroadcastrelay - Service Watchdog - System Patches

                        F 1 Reply Last reply Reply Quote 0
                        • F
                          FLOK @Qinn
                          last edited by

                          @Qinn
                          Okay. Will try tomorrow...

                          1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            But 30Mbps is very poor for a 300Mbps connection. It should not require any special tuning to get 300Mbps, the APU1 can pass that.
                            It seems like you have a more fundamental problem in play somewhere.

                            Steve

                            QinnQ 1 Reply Last reply Reply Quote 0
                            • QinnQ
                              Qinn @stephenw10
                              last edited by

                              Not that it explains te very low speed (about 10% of the attainable), but why do you use 7 DNS servers?

                              Hardeware: Intel(R) Celeron(R) J4125 CPU @ 2.00GHz 102 GB mSATA SSD (ZFS)
                              Firmware: Latest-stable-pfSense CE (amd64)
                              Packages: pfBlockerNG devel-beta (beta tester) - Avahi - Notes - Ntopng - PIMD/udpbroadcastrelay - Service Watchdog - System Patches

                              1 Reply Last reply Reply Quote 1
                              • DaddyGoD
                                DaddyGo
                                last edited by DaddyGo

                                with these tun / mod., they work stably up to 500Mbps (ISP!!!)

                                ab9c490e-a360-4580-883e-2b073bafaa59-image.png

                                fe99f9e9-f8df-4494-aff7-09149020231c-image.png

                                /boot/loader.conf.local

                                2cbc09ed-70e3-488e-849e-d6970a3c15ad-image.png

                                ++++ edit: APU Core Performance Boost
                                https://github.com/pcengines/apu2-documentation/blob/master/docs/apu_CPU_boost.md

                                Cats bury it so they can't see it!
                                (You know what I mean if you have a cat)

                                F 1 Reply Last reply Reply Quote 0
                                • F
                                  FLOK @DaddyGo
                                  last edited by

                                  @DaddyGo
                                  Are there more tunables, or is this your complete list ?

                                  1 Reply Last reply Reply Quote 0
                                  • DaddyGoD
                                    DaddyGo
                                    last edited by DaddyGo

                                    that's all for the APU tun

                                    since Coreboot development is very unstable, I have stopped here for now: v4.10.0.1 /perhaps v4.10.0.4

                                    +++the 30 Mbps is still very suspicious of this...., I think there is another problem too
                                    we use it with 500/200 FTTH in several places without any issue
                                    (true, this is the end of APU)

                                    Cats bury it so they can't see it!
                                    (You know what I mean if you have a cat)

                                    1 Reply Last reply Reply Quote 0
                                    • VeldkornetV
                                      Veldkornet
                                      last edited by Veldkornet

                                      What’s the hardware offload settings like?

                                      Web panel -> System -> Advanced -> Networking -> Scroll to the bottom.

                                      Make sure that all 3 first checkboxes under "Network Interfaces" are unchecked.

                                      Hardware Checksum Offloading
                                      Hardware TCP Segmentation Offloading
                                      Hardware Large Receive Offloading

                                      a716a34f-ec58-41d9-9ed5-cb103d3e89ca-image.png

                                      https://teklager.se/media/filer_public_thumbnails/filer_public/45/9a/459a5e96-ec62-4090-9b1c-55dcf60166e9/pfsense_1gbit_apu2_config_panel.png__2280x1024_q85_subsampling-2.png

                                      1 Reply Last reply Reply Quote 0
                                      • S
                                        saltandpepper @dugeem
                                        last edited by saltandpepper

                                        Offloading is used to execute functions of the router using the hardware directly, instead of a process of software functions.
                                        The post of @dugeem has some information about the performance impact of those functions and the tweaks from teklager.

                                        @dugeem said in PC Engines apu2 experiences:

                                        @kevindd992002

                                        Unfortunately some of the advice in the link is incorrect.

                                        Firstly TSO & LRO should always be disabled on routers. Netgate recommend this (hence pfSense defaults) as do others. BSDRP have even tested this and found routing performance drop negligible from enabling TSO & LRO (see link below).

                                        In terms of loader.conf.local suggestions:

                                        • hw.igb.rx_process_limit=-1 is a standard tweak for Intel igb NICs. Performance boost on APU2 though is only ~1%.
                                        • hw.igb.tx_process_limit already defaults to -1 so no need to change this.
                                        • hw.igb.num_queues=1 is not for APU2 as stated. Default 0 allows driver to allocate maximum queues across CPU cores (i210AT has 4 queues; i211AT has 2 queues)
                                        • kern.ipc.nmbclusters=1000000 is unnecessary - default on APU2 with 4GB RAM is ~250000 (mbuf is 2kB - so this represents maximum 12% of RAM). Possibly for high bandwidth routers 500000 mbufs would be prudent. However use the command netstat -m to verify mbuf use prior to changing.
                                        • net.pf.states_hashsize=2097152 is ridculous for an APU2. If you need to be tweaking this then you'll likely need better hardware.
                                        • hw.igb.rxd=4096 & hw.igb.txd=4096. Increasing NIC descriptors on APU2 will actually decrease performance by 20%. And likely worsens buffer bloat. Default of 1024 is fine.
                                        • net.inet.tcp.* sysctl tuning is for end clients (ie not routers).

                                        Reference performance data for some of the above: https://bsdrp.net/documentation/technical_docs/performance#nic_drivers_tuning

                                        Even longer version: https://people.freebsd.org/~olivier/talks/2018_AsiaBSDCon_Tuning_FreeBSD_for_routing_and_firewalling-Paper.pdf

                                        The only caveat is that these BSDRP performance numbers were compiled in 2018 before the AMD CPB was enabled in APU2 BIOS - so performance should now exceed this.

                                        My current APU2 performance tweak summary:

                                        1. Upgrade BIOS to enable CPB (mainline v4.9.0.2 or later, legacy v4.0.25 or later)
                                        2. Disable ICMP Redirects to enable tryforward routing path (under System / Advanced / System Tunables set net.inet.ip.redirect & net.inet6.ip6.redirect to 0)
                                        3. Add hw.igb.rx_process_limit=-1 to /boot/loader.conf.local

                                        There may well be other tweaks but for our power efficient APU2 routers these tweaks should serve most well. And when my home internet evolves to 500Mb/s I'll worry some more ☺

                                        1 Reply Last reply Reply Quote 1
                                        • K
                                          kevindd992002
                                          last edited by

                                          How's BIOS v4.12.0.1 doing for the one's who tested already?

                                          fireodoF 1 Reply Last reply Reply Quote 0
                                          • fireodoF
                                            fireodo @kevindd992002
                                            last edited by fireodo

                                            @kevindd992002 said in PC Engines apu2 experiences:

                                            How's BIOS v4.12.0.1 doing for the one's who tested already?

                                            Until now I cannot find any issue ...

                                            Kettop Mi4300YL CPU: i5-4300Y @ 1.60GHz RAM: 8GB Ethernet Ports: 4
                                            SSD: SanDisk pSSD-S2 16GB (ZFS) WiFi: WLE200NX
                                            pfsense 2.7.2 CE
                                            Packages: Apcupsd Cron Iftop Iperf LCDproc Nmap pfBlockerNG RRD_Summary Shellcmd Snort Speedtest System_Patches.

                                            K 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.