Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    ATT 2G fiber - upload is low

    Scheduled Pinned Locked Moved Hardware
    16 Posts 4 Posters 737 Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A
      akhouston
      last edited by

      I have pfsense+ 23.05 installed on a box wtih intel i225 - so 4 2.5Gb ports.
      Desktop has a 10Gb card - Marvell aqtion if it matters.
      Connecting desktop directly to the modem gives me 1.9Gb down and 2.1Gb up.
      Connecting it through pfSense box results in 1.6Gb down and only 600Mb up.
      That's a huge loss and I am not sure where to look.
      Both WAN and LAN interfaces are set to autoneg and are at 2500Base-T <full-duplex>
      Any idea about what to check would be greatly appreciated.

      A Dobby_D 2 Replies Last reply Reply Quote 0
      • A
        akhouston @akhouston
        last edited by

        @akhouston probably not the right category, my apologies, not sure if I can move it now.

        A 1 Reply Last reply Reply Quote 0
        • A
          akhouston @akhouston
          last edited by

          b9b80905-0b4f-4801-9a25-4507041d1672-image.png

          b313b12a-910f-4bb5-b503-f05c43664a40-image.png

          5601c4c7-b926-4905-bc70-7f807e67e773-image.png

          1 Reply Last reply Reply Quote 0
          • M
            michmoor LAYER 8 Rebel Alliance
            last edited by

            https://docs.netgate.com/pfsense/en/latest/troubleshooting/low-throughput.html

            Firewall: NetGate,Palo Alto-VM,Juniper SRX
            Routing: Juniper, Arista, Cisco
            Switching: Juniper, Arista, Cisco
            Wireless: Unifi, Aruba IAP
            JNCIP,CCNP Enterprise

            A 1 Reply Last reply Reply Quote 0
            • A
              akhouston @michmoor
              last edited by

              @michmoor yeah, I poked around... the thing is definitely not CPU bound. Def something going on with the box but can't put my finger on what it is precisely.

              1 Reply Last reply Reply Quote 0
              • stephenw10S
                stephenw10 Netgate Administrator
                last edited by

                Try setting the loader variable: hw.igc.max_interrupt_rate to something higher like 20000.
                The default is 8000 and you might be hitting that.

                Create the file /boot/loader.conf.local.
                Add to it: hw.igc.max_interrupt_rate=20000
                reboot.

                Steve

                A 2 Replies Last reply Reply Quote 0
                • Dobby_D
                  Dobby_ @akhouston
                  last edited by Dobby_

                  @akhouston said in ATT 2G fiber - upload is low:

                  I have pfsense+ 23.05 installed on a box wtih intel i225 - so 4 2.5Gb ports.

                  Is PPPoE in the "game play" you will be nailed to one queue
                  at the WAN, if not you can use more queues, one CPU core
                  = one queue.
                  On top the same role with the LAN ports too. As an example:
                  Intel i211at are only using 2 queues and Intel i210at is
                  able to use 4 queues.

                  #~. @Dobby

                  Turris Omnia - 4 Ports - 2 GB RAM / TurrisOS 7 Release (Btrfs)
                  PC Engines APU4D4 - 4 Ports - 4 GB RAM / pfSense CE 2.7.2 Release (ZFS)
                  PC Engines APU6B4 - 4 Ports - 4 GB RAM / pfSense+ (Plus) 24.03_1 Release (ZFS)

                  A 1 Reply Last reply Reply Quote 0
                  • A
                    akhouston @stephenw10
                    last edited by

                    @stephenw10 Thanks, I don't think it made a difference.

                    1 Reply Last reply Reply Quote 0
                    • A
                      akhouston @Dobby_
                      last edited by

                      @Dobby_ I am not sure pppoe is applicable to att fiber, but I am not sure either I understand your statement.
                      the box is basically celeron n5105 with i226 NIC and 32GB memory.

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        Your WAN is DHCP you can see the gateway name so it's not that.

                        Check the CPU usage when you're testing. The best way to do that is to run top -HaSP at the command line.

                        A 1 Reply Last reply Reply Quote 0
                        • A
                          akhouston @stephenw10
                          last edited by

                          @stephenw10 Actually this change cut down my download speed from about 1.4-1.5Gb to 600-700Mb. Removed it and the down speed is back to 1.4-1.5

                          1 Reply Last reply Reply Quote 0
                          • A
                            akhouston @stephenw10
                            last edited by

                            @stephenw10 do i just take a snap of that in the Command Line window when running a test? I am watching the cpu usage chart on the dashboard and at the peak up and down test (those blue and orange charts onthe right, it didn't go higher than 30%, hence load average
                            7de68f45-ebf6-466d-8a20-c5cee9ca40e1-image.png

                            A 1 Reply Last reply Reply Quote 0
                            • A
                              akhouston @akhouston
                              last edited by

                              So I ran iperf just to make sure nothing silly is going on. And it appears that pfSense sending is definitely heavier than pfSense receiving... Not sure where to dig from here, any ideas will be appreciated...

                              04f8bebb-c4f7-492c-9124-d59ca896731f-image.png

                              1 Reply Last reply Reply Quote 0
                              • stephenw10S
                                stephenw10 Netgate Administrator
                                last edited by

                                You set that rate limit to 20000 not 2000?
                                I'm surprised doing that could possibly reduce throughput.

                                Yes, run top at the CLI then hit Q to quit leaving the data fixed to copy/paste out of there. Make sure you're not getting hung up on one core at 100%.

                                Steve

                                A 1 Reply Last reply Reply Quote 0
                                • A
                                  akhouston @stephenw10
                                  last edited by

                                  @stephenw10 I found the culprit, evidently the traffic shaper on the interface had a bandwidth limit of 1gbps - don't remember if and when I even set that, but whatever. Reset it and now i'm happy like a clam... Thanks everyone for your help.

                                  a86fcdd8-c75c-43ca-ad0b-04a1896abcc7-image.png

                                  1 Reply Last reply Reply Quote 1
                                  • stephenw10S
                                    stephenw10 Netgate Administrator
                                    last edited by

                                    Ha, that would do it. Nice. 👍

                                    1 Reply Last reply Reply Quote 0
                                    • First post
                                      Last post
                                    Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.