Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Drastic speed reduction in 2.4.0 vs 2.3.4?

    Scheduled Pinned Locked Moved 2.4 Development Snapshots
    18 Posts 7 Posters 4.0k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      doktornotor Banned
      last edited by

      @peppersass:

      Third, I tried turning off BSD Hardware Acceleration in 2.3.4 and it made no difference to the VPN speed.

      That was not the point of the linked bug. On the contrary, the point was exactly the opposite - to have both AES-NI and cryptodev loaded. Testing this with 2.3.4 is not relevant here.

      1 Reply Last reply Reply Quote 0
      • D
        digitalgimpus
        last edited by

        I've noticed something pretty similar to this on my Qotom.

        I think there's something in 2.4 that's impacting performance of RealTek NIC's significantly.  Previously I didn't have a problem hitting a few hundred Mbits/s… given my uplink more than ok... With 2.4:

        $ iperf -c gateway -w 256k
------------------------------------------------------------
Client connecting to gateway, TCP port 5001
TCP window size:  416 KByte (WARNING: requested  256 KByte)
------------------------------------------------------------
[  3] local 10.10.1.42 port 44840 connected with 10.10.1.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec   107 MBytes  89.4 Mbits/sec

        Can't seem to get these above 90 Mbits/sec.

        It's indeed detected as gigabit:

        
re0@pci0:1:0:0:	class=0x020000 card=0x012310ec chip=0x816810ec rev=0x06 hdr=0x00
    vendor     = 'Realtek Semiconductor Co., Ltd.'
    device     = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet
re1@pci0:2:0:0:	class=0x020000 card=0x012310ec chip=0x816810ec rev=0x06 hdr=0x00
    vendor     = 'Realtek Semiconductor Co., Ltd.'
    device     = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet

        The interface is definitely "1000baseT <full-duplex>".

        Very strange… I'm running out of things to look at.</full-duplex>

        1 Reply Last reply Reply Quote 0
        • JeGrJ
          JeGr LAYER 8 Moderator
          last edited by

          @doktornotor

          Why would one want both loaded, aesni and cryptodev? The ticket from your link (https://redmine.pfsense.org/issues/7810) has those numbers at the bottom, right? Isn't the benching of both loaded the worst by almost factor 3.5 or am I misreading something entirely? Just asking because the ticket title and you stating the same makes no sense to me when looking at those speed tests?

          Thanks,
          Jens

          Don't forget to upvote 👍 those who kindly offered their time and brainpower to help you!

          If you're interested, I'm available to discuss details of German-speaking paid support (for companies) if needed.

          1 Reply Last reply Reply Quote 0
          • H
            heper
            last edited by

            @JeGr:

            @doktornotor

            Why would one want both loaded, aesni and cryptodev? The ticket from your link (https://redmine.pfsense.org/issues/7810) has those numbers at the bottom, right? Isn't the benching of both loaded the worst by almost factor 3.5 or am I misreading something entirely? Just asking because the ticket title and you stating the same makes no sense to me when looking at those speed tests?

            Thanks,
            Jens

            look at the times next to the numbers …. its confusing, but loading both is significantly fasters, specially if size increases

            1 Reply Last reply Reply Quote 0
            • D
              doktornotor Banned
              last edited by

              ^^^ That. Yeah, you are misreading entirely.

              1 Reply Last reply Reply Quote 0
              • P
                peppersass
                last edited by

                Again, I'm seeing significantly reduced transfer speeds (20%+) and RTT/RTTsd times (2x-3x)  on the WAN with no VPN. But speed really goes to hell over the VPN.

                My NICs are Realtek 8168/8111. Googling came up with posts about connection and speed issues with these NICs under various OSs that are solved by updating the driver. How do I find out what Realtek driver versions are incorporated into freeBSD for pfSense 2.3.4 and 2.4.0RC? If a driver update is required for 2.0.4RC, is this something I can do or will it have to be incorporated into 2.4.0RC by the developers?

                FWIW, Realtek lists their latest freeBSD driver for the 8168/8111 as 1.94 released 9/15/2017. But it says it's for freeBSD 7.x and 8.0. I believe pfSense 2.3.4 is using freeBSD 10.3.

                Of course, it may not be the driver, but how the NICs are being initialized. I've seen some posts where people have tried different parameters to resolve connection and speed issues. But I wouldn't know where to begin with that. Is it possible to find out what initialization commands are being issued by 2.3.4 and 2.4.0RC, respectively? If there's a difference, is it possible to send commands to the NICs with shell commands?

                1 Reply Last reply Reply Quote 0
                • JeGrJ
                  JeGr LAYER 8 Moderator
                  last edited by

                  @heper:

                  look at the times next to the numbers …. its confusing, but loading both is significantly fasters, specially if size increases

                  My bad, my ill brain didn't take a look at the timings in the last one. Thanks!

                  Don't forget to upvote 👍 those who kindly offered their time and brainpower to help you!

                  If you're interested, I'm available to discuss details of German-speaking paid support (for companies) if needed.

                  1 Reply Last reply Reply Quote 0
                  • H
                    hescominsoon
                    last edited by

                    @digitalgimpus:

                    I've noticed something pretty similar to this on my Qotom.

                    I think there's something in 2.4 that's impacting performance of RealTek NIC's significantly.  Previously I didn't have a problem hitting a few hundred Mbits/s… given my uplink more than ok... With 2.4:

                    $ iperf -c gateway -w 256k
------------------------------------------------------------
Client connecting to gateway, TCP port 5001
TCP window size:  416 KByte (WARNING: requested  256 KByte)
------------------------------------------------------------
[  3] local 10.10.1.42 port 44840 connected with 10.10.1.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec   107 MBytes  89.4 Mbits/sec

                    Can't seem to get these above 90 Mbits/sec.

                    It's indeed detected as gigabit:

                    
re0@pci0:1:0:0:	class=0x020000 card=0x012310ec chip=0x816810ec rev=0x06 hdr=0x00
    vendor     = 'Realtek Semiconductor Co., Ltd.'
    device     = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet
re1@pci0:2:0:0:	class=0x020000 card=0x012310ec chip=0x816810ec rev=0x06 hdr=0x00
    vendor     = 'Realtek Semiconductor Co., Ltd.'
    device     = 'RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet

                    The interface is definitely "1000baseT <full-duplex>".

                    Very strange… I'm running out of things to look at.</full-duplex>

                    Considering realtek is a software nic written in the winmodem model a slowdown isn't surprising.  If you can get some Intel I-series nics or broadcoms and try again.  If the slowdown is still present then I would worry about there being a general code issue.  Even then the new codebase might be cpu hungry until it gets evened out..but usually these kinds of networking slowdowns are due to "win-nics".

                    1 Reply Last reply Reply Quote 0
                    • P
                      peppersass
                      last edited by

                      @hescominsoon:

                      Considering realtek is a software nic written in the winmodem model a slowdown isn't surprising.  If you can get some Intel I-series nics or broadcoms and try again.  If the slowdown is still present then I would worry about there being a general code issue.  Even then the new codebase might be cpu hungry until it gets evened out..but usually these kinds of networking slowdowns are due to "win-nics".

                      Alas, my Realtek NICs are on the motherboard of a Zoltac ZBOX C1327, which isn't expandable.  :(

                      1 Reply Last reply Reply Quote 0
                      • P
                        peppersass
                        last edited by

                        FWIW, I switched from the Zotac C1327 to a Protectli E3845 Vault with Intel NICs and there's no problem with speed under 2.4.2. I think it's likely an issue with the Realtek driver used in the latest version of FreeBSD, though it could also have something to do with a crypto or BIOS incompatibility.

                        1 Reply Last reply Reply Quote 0
                        • First post
                          Last post
                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.