RRD Graph - LAN and WAN traffic not matching



  • Hi,

    I have a simple setup.  1 LAN and 1 WAN.

    Today I took a look at the RRD Graph and saw that the in-pass/out-pass "period" total didn't match.

    Am I not understanding how those graph works or is there something wrong?

    At 26mbps for about 3 hours, I should be around ~35GB of data (38GB here with other small downloads) for this period.  Wich match the LAN graph.

    But the Oustide/WAN graph only show 1.61GB !








  • Graphic looks right I think but the total doesn't look right



  • What is your wan setup like? Tunneling or anything?

    Not so related but https://redmine.pfsense.org/issues/2255



  • @bryan.paradis:

    Graphic looks right I think but the total doesn't look right

    Yeah I know.  The graph look right! I don't understand why the total are off…

    @bryan.paradis:

    What is your wan setup like? Tunneling or anything?

    Nothing special.

    Only one WAN with a static IP from my ISP.



  • I did find a couple of errors in the calculation of the text numbers reported below some graphs - the fixes are here: https://github.com/pfsense/pfsense/commit/f9983a874d6acf5fcf08a08606a6d19624af4438
    I am not so sure that it will fix the numbers you are seeing, but might be worth applying the fix.



  • @phil.davis:

    I did find a couple of errors in the calculation of the text numbers reported below some graphs - the fixes are here: https://github.com/pfsense/pfsense/commit/f9983a874d6acf5fcf08a08606a6d19624af4438
    I am not so sure that it will fix the numbers you are seeing, but might be worth applying the fix.

    I applied your modification and deleted my rrd file.  Downloaded 2Gb.  LAN total is ok, WAN total is 67Mb !



  • I think from abstracting a bit that the wan-traffic.rrd must be getting the wrong data for that statistic because the graphs + data are output from the same function for all the graphs.

    Please do this and paste files onto paste bin for us.

    
    rddtool dump /var/db/rrd/wan-traffic.rrd >> wandump.txt
    rddtool dump /var/db/rrd/lan-traffic.rrd >> landump.txt
    
    


  • Paste too big.  Here's the files.

    [Removed]
    [Removed]

    There is about 1.40Gb of download on the LAN graph and 30Mb on the WAN one.

    Thank you.



  • Had a bit more of a look and I can't really come to a conclusion yet. Too busy to dig further. Seems really odd. If you delete your WAN and LAN traffic RD files do you get the same problem again?



  • Yeah, I cleared all RRD files and I stil have the problem :(

    Thanks for your time!



  • Hey!  I just discovered something.

    Last night I erased all the RRD files.  I just looked at them after my last reply and they where ok.  In the last 8 hours, 652Mb download on the WAN, 683Mb on the LAN side.  Not much of a difference.  For the upload, 618 on the WAN, 617 on the LAN.

    I then downloaded a 1Gb file.  The LAN jumped to 1.68Gb in download (~683Mb + 1Gb) but the WAN graph jumped from 652Mb to 627Mb !

    The Upload is fine.  ~30Mb more on each adapter.

    Sooo…  It's seem's that the Period total are Off only on hight speed download.  I'll make some test to see at wich point this append.




  • @mr_sarge:

    Hey!  I just discovered something.

    Last night I erased all the RRD files.  I just looked at them after my last reply and they where ok.  In the last 8 hours, 652Mb download on the WAN, 683Mb on the LAN side.  Not much of a difference.  For the upload, 618 on the WAN, 617 on the LAN.

    I then downloaded a 1Gb file.  The LAN jumped to 1.68Gb in download (~683Mb + 1Gb) but the WAN graph jumped from 652Mb to 627Mb !

    The Upload is fine.  ~30Mb more on each adapter.

    Sooo…  It's seem's that the Period total are Off only on hight speed download.  I'll make some test to see at wich point this append.

    Are you running in a VM?

    post your systemlog.

    Are you using traffic shaping? Queues?



  • Ho! you got it!

    It's the shaper!  I removed it and everything is find!

    I did got a lot a packet loss in the shaper status.

    I'll put it back and check it.

    thanks again!



  • Just made a discovery!

    I had ~3Gb of download on the LAN graph and 0 on the WAN one.

    I flushed my Traffic shaper config and refreshed the RRD Graph page.

    The WAN Graph now show 3Gb of download !!!

    I re-imported my Shaper config and the RRD Graph returned to 0 !

    EDIT:
    I just erased all the shaper config and build a new one manually.  I found that as soon as I put the WAN queue under 15mbps of bandwith, the graph start to output smaller period total.  (1mbps queue = 0Mb for the period).

    EDIT2:
    Rebuilded a shapper from scratch, with the wizard, with 1mbps wan bandwidth speed.  same thing.  WAN period total not working.



  • @mr_sarge:

    Just made a discovery!

    I had ~3Gb of download on the LAN graph and 0 on the WAN one.

    I flushed my Traffic shaper config and refreshed the RRD Graph page.

    The WAN Graph now show 3Gb of download !!!

    I re-imported my Shaper config and the RRD Graph returned to 0 !

    EDIT:
    I just erased all the shaper config and build a new one manually.  I found that as soon as I put the WAN queue under 15mbps of bandwith, the graph start to output smaller period total.  (1mbps queue = 0Mb for the period).

    EDIT2:
    Rebuilded a shapper from scratch, with the wizard, with 1mbps wan bandwidth speed.  same thing.  WAN period total not working.

    Well we are getting somewhere now