Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    10Gbe Tuning?

    Scheduled Pinned Locked Moved Hardware
    83 Posts 19 Posters 40.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • N
      nikkon
      last edited by

      on my actual setup - J1900 + ssd + 8gb ram and 2xIntel i210T
      For PPPoE i got verry low speed. Around 346.96 Mbit/s. connection is 1000 Mbit/s.I'm not expecting to get 1000 but @least 50%
      dev.igb.0.%desc: Intel(R) PRO/1000 Network Connection version - 2.4.0

      pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

      Happy PfSense user :)

      1 Reply Last reply Reply Quote 0
      • stephenw10S
        stephenw10 Netgate Administrator
        last edited by

        What CPU usage are you seeing?

        Steve

        1 Reply Last reply Reply Quote 0
        • N
          nikkon
          last edited by

          @stephenw10:

          What CPU usage are you seeing?

          Steve

          not more than 60% and that's a spyke

          pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

          Happy PfSense user :)

          1 Reply Last reply Reply Quote 0
          • stephenw10S
            stephenw10 Netgate Administrator
            last edited by

            How does that divide across the cores? I imagine you have one core at 100%

            Steve

            1 Reply Last reply Reply Quote 0
            • N
              nikkon
              last edited by

              one core is reaching 100% yeah…rest of them are low in load.

              pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

              Happy PfSense user :)

              1 Reply Last reply Reply Quote 0
              • ?
                Guest
                last edited by

                one core is reaching 100% yeah…rest of them are low in load.

                Are you able to adjust this over the PowerD function perhaps?

                1 Reply Last reply Reply Quote 0
                • N
                  nikkon
                  last edited by

                  According to what I have found on the forum this is meant to be  "adaptive"
                  Found that we can change the parameters by editing /etc/inc/system.Inc
                  Or în gui via system - advanced - miscellaneous.

                  pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                  Happy PfSense user :)

                  1 Reply Last reply Reply Quote 0
                  • ?
                    Guest
                    last edited by

                    Or în gui via system - advanced - miscellaneous.

                    Yes this I was meaning, by an Alix APU we where seeing the throughout gaining
                    from ~450 MBit/s to 650 - 750 MBit/s only by activating or changing the PowerD options.

                    1 Reply Last reply Reply Quote 0
                    • N
                      nikkon
                      last edited by

                      Sounds pretty nice !

                      pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                      Happy PfSense user :)

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Nikkon, this fits your use case: https://redmine.pfsense.org/issues/4821

                        Steve

                        1 Reply Last reply Reply Quote 0
                        • N
                          nikkon
                          last edited by

                          Thx Steve  ;)

                          pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                          Happy PfSense user :)

                          1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            It explains the low throughput in one direction but there's no solution to it as yet. Havne't tried the suggested patch but we are at least aware of it now.

                            Steve

                            1 Reply Last reply Reply Quote 0
                            • N
                              nikkon
                              last edited by

                              Waiting for it ;)
                              Thx for the update.

                              pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                              Happy PfSense user :)

                              1 Reply Last reply Reply Quote 0
                              • N
                                nikkon
                                last edited by

                                as an update on all my systems with igb i got
                                sysctl -a | grep '.igb..*x_pack'
                                dev.igb.0.queue0.tx_packets: 38931223
                                dev.igb.0.queue0.rx_packets: 42548203
                                dev.igb.1.queue0.tx_packets: 39439021
                                dev.igb.1.queue0.rx_packets: 36697705

                                pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                                Happy PfSense user :)

                                1 Reply Last reply Reply Quote 0
                                • ?
                                  Guest
                                  last edited by

                                  I found another thread pointed to this circumstance where this would be really nice explained.
                                  mbufs tunable
                                  Also have a dedicated view on the named pfSense versions please.

                                  1 Reply Last reply Reply Quote 0
                                  • stephenw10S
                                    stephenw10 Netgate Administrator
                                    last edited by

                                    Nikkon, you only have one queue per NIC in each direction? You have a 4 core CPU I expect to see at least 2 queues. Do you have a tunable set to limit that?

                                    Steve

                                    1 Reply Last reply Reply Quote 0
                                    • N
                                      nikkon
                                      last edited by

                                      dev.igb.0.queue0.no_desc_avail: 0
                                      dev.igb.0.queue0.tx_packets: 7824580
                                      dev.igb.0.queue0.rx_packets: 9484446
                                      dev.igb.0.queue0.rx_bytes: 8615598781
                                      dev.igb.0.queue0.lro_queued: 0
                                      dev.igb.0.queue0.lro_flushed: 0

                                      –-------

                                      dev.igb.1.queue0.no_desc_avail: 0
                                      dev.igb.1.queue0.tx_packets: 9365166
                                      dev.igb.1.queue0.rx_packets: 7891338
                                      dev.igb.1.queue0.rx_bytes: 5772762364
                                      dev.igb.1.queue0.lro_queued: 0
                                      dev.igb.1.queue0.lro_flushed: 0

                                      I belive i need to add more.
                                      Is there a recommanded value?

                                      pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                                      Happy PfSense user :)

                                      1 Reply Last reply Reply Quote 0
                                      • N
                                        nikkon
                                        last edited by

                                        sysctl -a | grep hw.igb.num_queues
                                        hw.igb.num_queues: 4

                                        same result

                                        pfsense 2.3.4 on Supermicro A1SRi-2758F + 8GB ECC + SSD

                                        Happy PfSense user :)

                                        1 Reply Last reply Reply Quote 0
                                        • D
                                          Downloadski
                                          last edited by

                                          I have seen copy speeds between 2 freebsd10 hosts via dd and mbuffer of 1115 MiB/s and actual file copy with zfs send and receive through mbuffer of 829 MiB (disk system limitation)
                                          Could not get iperf to fill the link..

                                          That is with supermicro X9 mainbords and Xeon 1220 CPU via X520-DA2 nics. No tuning at all.
                                          I tried a lot of tuning of parameters and it did not do much for me. But it might be different for Firewall usage.

                                          see: https://www.youtube.com/watch?v=mfOePFKekQI&feature=youtu.be

                                          1 Reply Last reply Reply Quote 0
                                          • ?
                                            Guest
                                            last edited by

                                            @Downloadski
                                            I my opinion that is something like we talk about ZeroShell, IPCop, IPFire and SmoothWall and someone
                                            is reporting the throughput between two Linux hosts. Can be that I am wrong with this, because pfsense
                                            is based on FreeBSD, but as I read here in the forum there changes where done that it is not really more
                                            matching the ordinary FreeBSD now. Correct me please if I am wrong with this.

                                            1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.