Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    RRD graphs throughput but not totals

    Scheduled Pinned Locked Moved General pfSense Questions
    37 Posts 6 Posters 6.2k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C Offline
      charliem
      last edited by

      @churchi:

      Ok so i did another test. When my Limiter changed at 11:30pm …  No change.

      Not the limiter, but the traffic shaper I think.

      So it looks like the speed limit is being set somewhere. Where do you think that limit will be set?

      How can i go about resetting this to correct values so that the data is not purged/disguarded by the graphing?

      $speedlimit is calculated in the very file you just modified.  If you suspect it could be causing an issue, just set it to 12500000 and try it, though the limits you posted should be OK.

      The alternative is for you to find the rrdtool man pages, and try to analyze the RPN expressions in the "$graphcmd" stanzas in that file (/usr/local/www/status_rrd_graph_img.php).

      With your graphs and the others posted here, it seems that the average is being calculated correctly.  That is: (printed average throughput) * (time span of graph) == (about what you think is the correct total traffic for the period).  Can you confirm that?

      If you really need to generate a periodic throughput summary, I'd suggest you script up an alternative using the pfctl command I listed early in the thread, rather than going through the web interface.

      1 Reply Last reply Reply Quote 0
      • C Offline
        churchi
        last edited by

        Thanks Charlie.

        $speedlimit is calculated in the very file you just modified.  If you suspect it could be causing an issue, just set it to 12500000 and try it, though the limits you posted should be OK.
        Where abouts in the .php file do i manually set the 12500000 to?

        And where is it automatically getting the speedlimit 460800 from? I have not set this anywhere in my pfSense config at all? Seems like a random number for me. Then it is splitting it equally to upstream and down stream.

        Thanks.

        1 Reply Last reply Reply Quote 0
        • C Offline
          churchi
          last edited by

          Hi Charlie,

          i have checked out my other graphs, like the LAN interface and other VLAN interfaces and i can see the same issue. There is a speed limit set somewhere in my config that has affected the RRD reporting on the graphs.

          Here is another example.

          ![pfsense WAN traffic pic -03.png](/public/imported_attachments/1/pfsense WAN traffic pic -03.png)
          ![pfsense WAN traffic pic -03.png_thumb](/public/imported_attachments/1/pfsense WAN traffic pic -03.png_thumb)

          1 Reply Last reply Reply Quote 0
          • C Offline
            charliem
            last edited by

            @churchi:

            Where abouts in the .php file do i manually set the 12500000 to?

            Honestly, if you cannot follow the code in that file then you shouldn't be poking around in it; sorry for the suggestions.

            File a bug.

            1 Reply Last reply Reply Quote 0
            • I Offline
              icemanncsu
              last edited by

              Can someone please open a bug on this… Us fiber users obviously exceed the normal limits on the WAN interface.

              1 Reply Last reply Reply Quote 0
              • H Offline
                Harvy66
                last edited by

                So again, the "period" in-pass is obviously not correct. The claimed 224.78Mb/s over the 8 hour period is about 750GB, not 21.71GB as claimed.

                Question for OP. Have you fried a fresh install? Obviously something is wrong, but you seem to be the only person complaining about this issue. Not to say others don't have it, just that you're the only one in here talking about it.

                1 Reply Last reply Reply Quote 0
                • I Offline
                  icemanncsu
                  last edited by

                  @Harvy66:

                  So again, the "period" in-pass is obviously not correct. The claimed 224.78Mb/s over the 8 hour period is about 750GB, not 21.71GB as claimed.

                  Question for OP. Have you fried a fresh install? Obviously something is wrong, but you seem to be the only person complaining about this issue. Not to say others don't have it, just that you're the only one in here talking about it.

                  I have installed pfSense several times, and this is the case with each install, this one being v2.2.2.

                  1 Reply Last reply Reply Quote 0
                  • T Offline
                    tim.mcmanus
                    last edited by

                    @icemanncsu:

                    Can someone please open a bug on this… Us fiber users obviously exceed the normal limits on the WAN interface.

                    Is it only happening to the WAN graph, or all of them?  My LAN looks like your WAN connection, and I don't have any issues on any of my interfaces.  So I'm curious if it's just this one interface.

                    1 Reply Last reply Reply Quote 0
                    • I Offline
                      icemanncsu
                      last edited by

                      Happens on both interfaces… See below.

                      1 Reply Last reply Reply Quote 0
                      • T Offline
                        tim.mcmanus
                        last edited by

                        When you install, are you restoring your configuration, or are you configuring the settings from scratch?

                        I would suggest a clean install and a manual reconfigure.  I'm guessing that there might be something wonky in your configurations that is causing this.  I cannot recreate the problem.

                        1 Reply Last reply Reply Quote 0
                        • I Offline
                          icemanncsu
                          last edited by

                          Always clean installs, no restoration of previous configs.

                          If its worth noting, I have a static IP on my WAN interface.

                          1 Reply Last reply Reply Quote 0
                          • T Offline
                            tim.mcmanus
                            last edited by

                            I too have a static IP on one WAN interface and another DHCP on the second WAN interface.

                            The only other thing I can think of is a bug in the interface driver supplied by BSD.

                            1 Reply Last reply Reply Quote 0
                            • C Offline
                              charliem
                              last edited by

                              Do you have the traffic shaper enabled?

                              Have you tried the '/sbin/pfctl -vvsI -i <your_interface>' commands suggested early in this thread?  (https://forum.pfsense.org/index.php?topic=89923.msg498803#msg498803)  Try it say in the morning, then 8 hours later and look for rollover.</your_interface>

                              1 Reply Last reply Reply Quote 0
                              • C Offline
                                churchi
                                last edited by

                                I agree its a bug or the way that pfSense calculates the bytes through the interface.

                                Charliem is spot on, its to do with the traffic shaper (well in my case it was). When i had it configured on my WAN interface so i could try and run some sort of QOS egress to the carrier, it was stuffing up the readings. The graph would work perfectly just the text below it would not capture the traffic.

                                The only way i found to fix it was to disable the traffic shaper on that interface and take out the maximum upload speed my service had (i manually set this). it breaks all potential QOS to the carrier, but i never found another solution.

                                Once i took off the WAN bandwidth statement on the traffic shaper interface, the values started to work correctly.

                                its a band aid and breaks my qos, but the only way i found to fix the issue.

                                i think a bug needs to be raised for this, or a better way for pfsense to calculate those figures when there is a bandwidth statement set on the WAN interface.

                                1 Reply Last reply Reply Quote 0
                                • C Offline
                                  charliem
                                  last edited by

                                  @tim.mcmanus:

                                  I cannot recreate the problem.

                                  I can't either, but it's there.  The LAN party traffic graphs posted here: https://forum.pfsense.org/index.php?topic=92938.0 show the problem as well, but nobody noticed it.  That poster (sideout) said his server used broadcom nics for that weekend, and he obviously was using traffic shaping.

                                  1 Reply Last reply Reply Quote 0
                                  • C Offline
                                    churchi
                                    last edited by

                                    I have Intel nic's in my server if that makes any difference. Its a 2 port Intel pci NIC in my server.

                                    1 Reply Last reply Reply Quote 0
                                    • I Offline
                                      icemanncsu
                                      last edited by

                                      @charliem:

                                      Do you have the traffic shaper enabled?

                                      Have you tried the '/sbin/pfctl -vvsI -i <your_interface>' commands suggested early in this thread?  (https://forum.pfsense.org/index.php?topic=89923.msg498803#msg498803)  Try it say in the morning, then 8 hours later and look for rollover.</your_interface>

                                      Here are the results of running that command this morning and later afternoon, complete with RRD screenshots.

                                      MORNING:
                                      em0
                                      Cleared:    Thu May 21 07:56:38 2015
                                      References:  59               
                                      In4/Pass:    [ Packets: 3509324067        Bytes: 590726417355      ]
                                      In4/Block:  [ Packets: 7175562            Bytes: 428424640          ]
                                      Out4/Pass:  [ Packets: 5996776314        Bytes: 8717660571686      ]
                                      Out4/Block:  [ Packets: 665018            Bytes: 554766803          ]
                                      In6/Pass:    [ Packets: 0                  Bytes: 0                  ]
                                      In6/Block:  [ Packets: 0                  Bytes: 0                  ]
                                      Out6/Pass:  [ Packets: 0                  Bytes: 0                  ]
                                      Out6/Block:  [ Packets: 1                  Bytes: 116                ]

                                      LATE AFTERNOON:
                                      em0
                                      Cleared:    Thu May 21 07:56:38 2015
                                      References:  53               
                                      In4/Pass:    [ Packets: 3878566076        Bytes: 848657387658      ]
                                      In4/Block:  [ Packets: 7703174            Bytes: 459527204          ]
                                      Out4/Pass:  [ Packets: 6396854113        Bytes: 9267444219092      ]
                                      Out4/Block:  [ Packets: 713043            Bytes: 595227273          ]
                                      In6/Pass:    [ Packets: 0                  Bytes: 0                  ]
                                      In6/Block:  [ Packets: 0                  Bytes: 0                  ]
                                      Out6/Pass:  [ Packets: 0                  Bytes: 0                  ]
                                      Out6/Block:  [ Packets: 1                  Bytes: 116                ]

                                      MORNING:

                                      LATE AFTERNOON:

                                      1 Reply Last reply Reply Quote 0
                                      • I Offline
                                        icemanncsu
                                        last edited by

                                        so nobody has an idea since i posted the results of the requested command?

                                        1 Reply Last reply Reply Quote 0
                                        • First post
                                          Last post
                                        Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.