Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Double counting of WAN out traffic?

    Scheduled Pinned Locked Moved General pfSense Questions
    36 Posts 7 Posters 3.5k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • johnpozJ
      johnpoz LAYER 8 Global Moderator @SteveITS
      last edited by johnpoz

      @teamits said in Double counting of WAN out traffic?:

      Are you saying the traffic graph is expected to sometimes show 9.6 Mbps even though the connection speed is lower?

      No not with a flat line like that.. But with instantaneous numbers you could for sure see different numbers that what you get for an average..

      That instant number you see in the traffic graph can for sure be misleading to what your actually moving on an average..

      For example - my plex is serving up some data via streams

      upload.png

      you can see its bursty... And dending how you have your graphs set for when they sample, how they smooth you can see different values..

      smooth-notsmooth.png

      That instantaneous value you see in the traffic graph, wouldn't say that is all that exact to be honest if you looking to what the bandwidth move is over /time, etc..

      I am not using any queues or shaping.. And the graphs show exactly what I would expect to see.. Not double that is for sure..

      So what I am saying is I am unable to duplicate your problem no matter what graphs I look at.

      Best testing method would be to generate some very stable traffic flow - iperf for example set with specific bandwidth setting so you could move say 50mbps stable for extended period... Then what does your values show.. Keep in mind best time to test this would be with nothing else on the network that could create traffic.

      edit: More examples of variables.. And instantaneous readings..

      No smoothing, max smoothing - instant values being shown vs what the graph shows.

      variables.png

      I can not really do a stable iperf3 tests right now... because I have lots of stuff going on, and users streaming videos..

      An intelligent man is sometimes forced to be drunk to spend time with his fools
      If you get confused: Listen to the Music Play
      Please don't Chat/PM me for help, unless mod related
      SG-4860 24.11 | Lab VMs 2.8, 24.11

      S S 2 Replies Last reply Reply Quote 0
      • S
        SteveITS Galactic Empire @johnpoz
        last edited by

        I started a 4 GB upload to observe. I understand traffic is a point in time measurement that will vary up and down, but for a max upload it should be reasonably consistent, and not double the connection speed.

        For me the traffic graph WAN Out hovered around 13-15 Mbps (which would be normal), and the Status/Queues/Interface WAN/root queue ranged from 26-30 Mbps as I observed in my thread (double the connection speed). That's consistent with what I saw on all four routers yesterday, I just wasn't looking at the traffic graph specifically.

        So it seems like OP and I have a similar sounding symptom but they are not the same.

        Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
        When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
        Upvote ๐Ÿ‘ helpful posts!

        1 Reply Last reply Reply Quote 0
        • S
          stepanov1975 @SteveITS
          last edited by

          @teamits I have PRIQ so, no root queue :(

          1 Reply Last reply Reply Quote 0
          • S
            stepanov1975 @johnpoz
            last edited by

            @johnpoz Ok. I did a long upload test. Is good enough to see the traffic doubling?
            dcd615e3-ffcc-4918-b70b-c4bcf64522db-image.png

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              This has been hit a number of times in the past so there are a few redmine bugs for it but I don't think there is one open currently for 2.4.5p1.

              There is this for 2.5 where you have VLANs in use:
              https://redmine.pfsense.org/issues/10852

              I am unable to replicate this on 2.4.5p1 here though:
              Screenshot from 2020-10-16 17-04-38.png

              That's on an SG-3100 with direct WAN LAN mvneta interfaces. No VLANs, no PPP, no VPNs.

              It must be something specific to your setup. Can you give us more details about it?

              Steve

              S 1 Reply Last reply Reply Quote 0
              • johnpozJ
                johnpoz LAYER 8 Global Moderator
                last edited by johnpoz

                @stepanov1975 Yeah that is great - no disputing that for sure ;)

                But I'm with @stephenw10 I can not duplicate this on 2.4.5p1.. If you are using some sort of queues or limiters or the like... Can you turn those off, and then duplicate your test above?

                Also I take that is showing Bytes, does it do the same if your set for bits?

                edit: Yeah just not seeing such an issue... Here I got someone streaming off my plex, so its very spikey traffic flow... But you can see they are mirrors, and values match both using the bit scale and the bytes scale

                bitsbytes.png

                on a side not - it would be nice if the graph listed the scale it was using ;)

                An intelligent man is sometimes forced to be drunk to spend time with his fools
                If you get confused: Listen to the Music Play
                Please don't Chat/PM me for help, unless mod related
                SG-4860 24.11 | Lab VMs 2.8, 24.11

                S 1 Reply Last reply Reply Quote 0
                • S
                  SteveITS Galactic Empire @johnpoz
                  last edited by

                  @johnpoz said in Double counting of WAN out traffic?:

                  queues or limiters or the like... Can you turn those off

                  I was just going to post that. https://docs.netgate.com/pfsense/en/latest/trafficshaper/advanced.html#removing-traffic-shaper-settings. If you make a backup you can just restore the backup afterwards to get them back.

                  If I remove the shaper then I can't see the queue status so my issue would "go away." :)

                  His post yesterday with the hand drawn circles is in bits...status/traffic graph I don't think has a choice?

                  Pre-2.7.2/23.09: Only install packages for your version, or risk breaking it. Select your branch in System/Update/Update Settings.
                  When upgrading, allow 10-15 minutes to restart, or more depending on packages and device speed.
                  Upvote ๐Ÿ‘ helpful posts!

                  1 Reply Last reply Reply Quote 0
                  • johnpozJ
                    johnpoz LAYER 8 Global Moderator
                    last edited by

                    Yeah I don't think you can set the scale in the traffic graph section under status, only in the widget..

                    An intelligent man is sometimes forced to be drunk to spend time with his fools
                    If you get confused: Listen to the Music Play
                    Please don't Chat/PM me for help, unless mod related
                    SG-4860 24.11 | Lab VMs 2.8, 24.11

                    1 Reply Last reply Reply Quote 0
                    • S
                      stepanov1975 @stephenw10
                      last edited by

                      @stephenw10 I actually have PPPoE.
                      It is, of cause, expected that you can not reproduce this problem. Most of the bugs appear under the specific non-default conditions. This is because default and commonly used conditions tested before release.

                      1 Reply Last reply Reply Quote 0
                      • K
                        kimble
                        last edited by

                        Bump as I'm also seeing this. Had it in 2.4, still happening in 2.5.
                        Wan is PPPoE. Outbound WAN traffic appears double in the traffic graph and in the value of ifOutOctets by SNMP. (Both compared to the interface on pfSense that the traffic is flowing to, and the traffic graphs generated by my ISP.) Inbound WAN traffic and all the other interfaces are unaffected.

                        (I've been working around this in a script that collects SNMP data by dividing the value by two.)

                        1 Reply Last reply Reply Quote 0
                        • J
                          jschneider
                          last edited by

                          I see the problem as well on 2.5.1.
                          I use PPPoE on VLAN tagged port with traffic shaping.
                          5c0a454f-bfb5-4dca-b4be-b73c5f7f3d13-image.png
                          The WAN interface shows 22M during a speed test, which report 11M.
                          The DSLMODEM interface, where the DSL modem is connected, shows 11M upload at the same time, which is in line with my maximum upload speed as reported by the DSL modem.
                          When I remove the traffic shaping then the doubled upload bandwidth display on WAN goes away.

                          1 Reply Last reply Reply Quote 0
                          • stephenw10S
                            stephenw10 Netgate Administrator
                            last edited by

                            Do you still see that in 2.6?

                            K 1 Reply Last reply Reply Quote 0
                            • K
                              kimble @stephenw10
                              last edited by

                              Yep, still happening for me in 2.6

                              1 Reply Last reply Reply Quote 0
                              • stephenw10S
                                stephenw10 Netgate Administrator
                                last edited by

                                Are you also running traffic shaping on the WAN?

                                K 1 Reply Last reply Reply Quote 0
                                • K
                                  kimble @stephenw10
                                  last edited by

                                  Yes I am.

                                  1 Reply Last reply Reply Quote 0
                                  • stephenw10S
                                    stephenw10 Netgate Administrator
                                    last edited by

                                    So pretty much exactly as described here?: https://redmine.pfsense.org/issues/11759
                                    Except there is no mention of shaping there which is probably why Viktor couldn't replicate it.

                                    Steve

                                    P 1 Reply Last reply Reply Quote 0
                                    • P
                                      pst @stephenw10
                                      last edited by

                                      @stephenw10 I just wanted to highlight this issue is still present in 23.05.1

                                      I also run a traffic shaper on WAN. What's not shown below are the three wireguard interfaces carrying the LAN2 traffic.

                                      622c342c-3a8f-42c3-84e3-5dcce566173c-image.png

                                      1 Reply Last reply Reply Quote 0
                                      • stephenw10S
                                        stephenw10 Netgate Administrator
                                        last edited by

                                        You should add your data point to the open bug report.

                                        P 1 Reply Last reply Reply Quote 0
                                        • P
                                          pst @stephenw10
                                          last edited by

                                          @stephenw10 done

                                          1 Reply Last reply Reply Quote 1
                                          • First post
                                            Last post
                                          Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.