Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Snapshot from Aug 26 16:51:36 EDT 2013 - Slow IPv4 traffic

    Scheduled Pinned Locked Moved General pfSense Questions
    13 Posts 3 Posters 3.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      c0urier
      last edited by

      Did a test with the latest snapshot (2.1-RC1 (amd64) built on Thu Aug 29 16:33:36 EDT 2013):

      Logs say nothing. Don't really know where to look.

      If I revert back to my old backup, everything is back to normal (2.1-RC0 (amd64) built on Wed Jun 12 06:19:17 EDT 2013).

      pfsense: 2.1.5-RELEASE, AMD64
      Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
      [/U

      1 Reply Last reply Reply Quote 0
      • S
        ssheikh
        last edited by

        Sounds like a NIC configuration issue. Have you tried changing the TCP segmentation and large receive offload settings? How about MBUF usage? Speed, Duplex, and MTU settings maybe.

        1 Reply Last reply Reply Quote 0
        • C
          c0urier
          last edited by

          @ssheikh:

          Sounds like a NIC configuration issue. Have you tried changing the TCP segmentation and large receive offload settings? How about MBUF usage? Speed, Duplex, and MTU settings maybe.

          The NIC is a Fujitsu D2735-2 with Intel® chip 82576NS - Never had issues with it on the previous installs and as said when reverting to my backup there is no problems (Has the drivers been updated?). MBUF usage was not alarming. It's only IPv4 traffic affected, IPv6 is still running fast as before. So if it's only IPv4 traffic with issues, would it help changing away from Duplex and lock it at 1000Mbit.

          pfsense: 2.1.5-RELEASE, AMD64
          Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
          [/U

          1 Reply Last reply Reply Quote 0
          • S
            ssheikh
            last edited by

            Depends what the other side is configured as. If the other side is set to Auto negotiate then leave it at auto. If the other side is set to a fixed speed and duplex, then set your speed and duplex to match the other side.

            I have Intel 1000PT NICs and a 100mbps WAN connection. I see the link usage peak in the 90s consistently.

            Perhaps its doing TCP offloading to the NIC for IPv4 which it is not doing for IPv6.

            1 Reply Last reply Reply Quote 0
            • C
              c0urier
              last edited by

              @ssheikh:

              Depends what the other side is configured as. If the other side is set to Auto negotiate then leave it at auto. If the other side is set to a fixed speed and duplex, then set your speed and duplex to match the other side.

              I have Intel 1000PT NICs and a 100mbps WAN connection. I see the link usage peak in the 90s consistently.

              Perhaps its doing TCP offloading to the NIC for IPv4 which it is not doing for IPv6.

              I'll try disabling "TCP segmentation offload" and "large receive offload" tonight, don't want to do it while users are most active. And of course also set a fixed speed.

              But something has to have changed in pfSense from June till August, since this problem does not appear in snapshots in June, but starts from July and forward. Else it does not make much sense to me.

              ssheikh thanks this far! Appreciate your help.

              pfsense: 2.1.5-RELEASE, AMD64
              Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
              [/U

              1 Reply Last reply Reply Quote 0
              • C
                c0urier
                last edited by

                1: Switched from Auto negotiation to fixed speed 1000Mbit Full Duplex.
                MBUF Usage: 38% (9750/25600)
                2.5Mbit down
                1.0Mbit up

                • No visible effect.
                  –------------------------------------

                2: Disable hardware TCP segmentation offload + Restart WAN interface.
                MBUF Usage: 38% (9750/25600)
                3.0Mbit down
                1.0Mbit up

                • No visible effect.

                3: Enable hardware TCP segmentation offload again and Disable hardware large receive offload.
                MBUF Usage: 38% (9750/25600)
                769Mbit down
                8.63 up

                • Some effect, especially on download.

                4: Disable hardware TCP segmentation offload again and Disable hardware large receive offload.
                MBUF Usage: 39% (9926/25600)
                763Mbit down
                8.2 up

                • No remarkable change compared to the above.

                Will revert back to my backup again and do a new test.

                After recovery I tested:
                Enable hardware TCP segmentation offload and Enable hardware large receive offload.
                MBUF Usage: 9638/25600
                727Mbit down
                718Mbit up

                pfsense: 2.1.5-RELEASE, AMD64
                Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
                [/U

                1 Reply Last reply Reply Quote 0
                • M
                  Monsterturbo
                  last edited by

                  Hello,

                  Did you ever get a response? I am having the same issue.

                  1 Reply Last reply Reply Quote 0
                  • C
                    c0urier
                    last edited by

                    Nope no response. But I have reverted back to a previous snapshot.

                    My guess is, it's a driver issue but I am not sure.

                    pfsense: 2.1.5-RELEASE, AMD64
                    Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
                    [/U

                    1 Reply Last reply Reply Quote 0
                    • M
                      Monsterturbo
                      last edited by

                      Hello,

                      Moved wan connection from Intel igb (PCI-E) to em (PCI-X) interface card and speed is now normal with the latest snapshot. Would like to help resolve the issue If someone can tell me what to look for.  I also want to go back to all PCI-E for the interfaces.

                      1 Reply Last reply Reply Quote 0
                      • C
                        c0urier
                        last edited by

                        I hope it will be fixed, I'll test your mod with changing from pci-e to pci-x.

                        pfsense: 2.1.5-RELEASE, AMD64
                        Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
                        [/U

                        1 Reply Last reply Reply Quote 0
                        • C
                          c0urier
                          last edited by

                          I can see the problem still persists in 2.1-Release, and if I disable "Disable hardware large receive offload" the download rate is fine, but the upload is still limited to 7-10Mbit where with previous releases is lies around 700-900Mbit.

                          IPv6 is still fine both download/upload.

                          IPv4:
                          c0urier@mail-proxy:~$ wget -4O /dev/null URL/1000M.zip
                          –2013-09-16 13:18:42--  http://URL/1000M.zip
                          Resolving URL (URL)... 109.124.XXX.XXX
                          Connecting to URL (URL)|109.124.XXX.XXX|:80... connected.
                          HTTP request sent, awaiting response... 200 OK
                          Length: 1048576001 (1000M) [application/zip]
                          Saving to: `/dev/null'

                          0% [                                                                                                                                                                                                    ] 758,752      126K/s  eta 2h 6m

                          IPv6:
                          c0urier@mail-proxy:~$ wget -6O /dev/null URL/1000M.zip
                          –2013-09-16 13:18:52--  http://URL/1000M.zip
                          Resolving URL (URL)... 2001:470:28:XXX:XXX:XXXX:fe25:ca9f
                          Connecting to URL (URL)|2001:470:28:XXX:XXX:XXXX:fe25:ca9f|:80... connected.
                          HTTP request sent, awaiting response... 200 OK
                          Length: 1048576001 (1000M) [application/zip]
                          Saving to: `/dev/null'

                          15% [==============================>                                                                                                                                                                    ] 165,900,293 21.5M/s  eta 32s

                          pfsense: 2.1.5-RELEASE, AMD64
                          Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
                          [/U

                          1 Reply Last reply Reply Quote 0
                          • C
                            c0urier
                            last edited by

                            Okay, I might have found a solution for this.

                            Add:
                            dev.igb.0.enable_lro=0
                            dev.igb.1.enable_lro=0

                            to /etc/sysctl.conf and restart the pfSense. This solved my IPv4 speed problem.

                            pfsense: 2.1.5-RELEASE, AMD64
                            Running on: MB/CPU: ASUS P8H77-I / Core i3-2120T | MEM: 8GB DDR3 | HDD: WD Blue 120GB 2.5" SATA | WAN/LAN: Fujitsu D2735-2 – Intel® chip 82576NS | WLAN: Realtek® 8111F PCIe | Connection: 1000/1000Mbit (Bredband2.com)
                            [/U

                            1 Reply Last reply Reply Quote 0
                            • First post
                              Last post
                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.