RRD Graphs

jimp · Aug 5, 2010, 6:46 PM

Just look at:

ls /var/db/rrd/

If the timestamps are current, the files are being touched.

Jonb · Aug 5, 2010, 6:53 PM

-rw-r–r-- 1 root wheel 47608 Aug 5 19:51 GW_WAN-quality.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 ipsec-packets.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 ipsec-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 lan-packets.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 lan-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 opt1-packets.rrd
-rw-r--r-- 1 root wheel 65672 Aug 5 10:16 opt1-quality.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 opt1-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 10:16 opt2-packets.rrd
-rw-r--r-- 1 root wheel 65672 Aug 5 10:16 opt2-quality.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 10:16 opt2-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 ovpns1-packets.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 ovpns1-traffic.rrd
-rw-r--r-- 1 root wheel 49120 Aug 5 19:51 ovpns1-vpnusers.rrd
-rw-r--r-- 1 root wheel 97672 Aug 5 10:16 ppp-cellular.rrd
-rw-r--r-- 1 root wheel 727424 Aug 5 19:51 system-memory.rrd
-rw-r--r-- 1 root wheel 487424 Aug 5 19:51 system-processor.rrd
-rw-r--r-- 1 root wheel 487424 Aug 5 19:51 system-states.rrd
-rw-r--r-- 1 root wheel 4974 Aug 5 19:13 updaterrd.sh
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 wan-packets.rrd
-rw-r--r-- 1 root wheel 65672 Aug 5 10:16 wan-quality.rrd
-rw-r--r-- 1 root wheel 388984 Aug 5 10:16 wan-queuedrops.rrd
-rw-r--r-- 1 root wheel 388984 Aug 5 10:16 wan-queues.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 19:52 wan-traffic.rrd

Strange as the wan-quality is the one that works

jimp · Aug 5, 2010, 6:58 PM

It's also one being updated: 19:51 GW_WAN-quality.rrd

:-)

Jonb · Aug 5, 2010, 7:09 PM

So is this a graph drawing issue.

Jonb · Aug 5, 2010, 7:22 PM

Strange what is going on.

sizes are the same as well

-rw-r–r-- 1 root wheel 47608 Aug 5 20:20 GW_WAN-quality.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 ipsec-packets.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 ipsec-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 lan-packets.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 lan-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 opt1-packets.rrd
-rw-r--r-- 1 root wheel 65672 Aug 5 10:16 opt1-quality.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 opt1-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 10:16 opt2-packets.rrd
-rw-r--r-- 1 root wheel 65672 Aug 5 10:16 opt2-quality.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 10:16 opt2-traffic.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 ovpns1-packets.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 ovpns1-traffic.rrd
-rw-r--r-- 1 root wheel 49120 Aug 5 20:20 ovpns1-vpnusers.rrd
-rw-r--r-- 1 root wheel 97672 Aug 5 10:16 ppp-cellular.rrd
-rw-r--r-- 1 root wheel 727424 Aug 5 20:20 system-memory.rrd
-rw-r--r-- 1 root wheel 487424 Aug 5 20:20 system-processor.rrd
-rw-r--r-- 1 root wheel 487424 Aug 5 20:20 system-states.rrd
-rw-r--r-- 1 root wheel 5780 Aug 5 20:07 updaterrd.sh
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 wan-packets.rrd
-rw-r--r-- 1 root wheel 65672 Aug 5 10:16 wan-quality.rrd
-rw-r--r-- 1 root wheel 340432 Aug 5 20:16 wan-queuedrops.rrd
-rw-r--r-- 1 root wheel 340432 Aug 5 20:16 wan-queues.rrd
-rw-r--r-- 1 root wheel 194776 Aug 5 20:21 wan-traffic.rrd

dszp · Aug 6, 2010, 4:38 AM

RRD files are round-robin database files (hence RRD) which remain a consistent size as they store rotating (round-robin) data. So if they will maintain history for a year, they start big enough to hold a year's worth of data and never grow or shrink, they are just updated with new data at the proper place. Hence the same file sizes.

cmb · Aug 6, 2010, 5:14 AM

Jim fixed a permissions issue today that should fix the quality graphs.
https://rcs.pfsense.org/projects/pfsense/repos/mainline/commits/3d83f02e958a52e35cf098a3cd3f7031f53d69a0

though that only applies when the directory is created. May need something to fix permissions on existing directories. To manually fix, run:

chown nobody:wheel /var/db/rrd/*quality*.rrd

Jonb · Aug 6, 2010, 7:39 AM

Ok fair enough so the files size shouldn't change. So how would I delve into the problem more to see if it is a graphing issue or data issue.

jimp · Aug 6, 2010, 12:10 PM

@cmb:

Jim fixed a permissions issue today that should fix the quality graphs.
https://rcs.pfsense.org/projects/pfsense/repos/mainline/commits/3d83f02e958a52e35cf098a3cd3f7031f53d69a0

though that only applies when the directory is created. May need something to fix permissions on existing directories. To manually fix, run:
chown nobody:wheel /var/db/rrd/*quality*.rrd

In addition to that, you want to change the permissions on the directory itself:

chown nobody:wheel /var/db/rrd/

Or combine the two:

chown -R nobody:wheel /var/db/rrd/

marrandy · Aug 6, 2010, 12:53 PM

@jimp:

Or combine the two:
chown -R nobody:wheel /var/db/rrd/

2.0-BETA4
built on Fri Aug 6 01:44:17 EDT 2010
FreeBSD 8.1-RELEASE

Tried that and even rebooted - Quality still isn't working.

jimp · Aug 6, 2010, 12:56 PM

That will be a no-op on NanoBSD if you reboot after doing it. /var is a RAM disk. You'd need to be on the latest snapshot (I think it should have the fix) before that will work.

marrandy · Aug 6, 2010, 12:58 PM

@jimp:

That will be a no-op on NanoBSD if you reboot after doing it. /var is a RAM disk. You'd need to be on the latest snapshot (I think it should have the fix) before that will work.

That is the latest snapshot.

I only rebooted as its still blank.

jimp · Aug 6, 2010, 1:51 PM

I found another bug, but it's definitely fixed now. :-)

Either apply this by hand, or wait for the next new snapshot:
https://rcs.pfsense.org/projects/pfsense/repos/mainline/commits/21934843352aa1dee730f59b06d35f1619c0ab3e

marrandy · Aug 6, 2010, 2:39 PM

I'll wait for the next update.

I'm just testing and providing feedback.

Thanks !!!

marrandy · Aug 9, 2010, 2:46 AM

Sorry. Been away.

Just updated to

2.0-BETA4
built on Sun Aug 8 11:22:28 EDT 2010
FreeBSD 8.1-RELEASE

Graphs are looking good.

Jonb · Aug 9, 2010, 2:23 PM

Still no good for me.

Jonb · Aug 10, 2010, 1:06 PM

Anything else I can try. I have the snapshot from sunday etc.

ColdFusion · Aug 11, 2010, 3:47 AM

Today's seem fine…2.0-BETA4
built on Tue Aug 10 02:57:56 EDT 2010

Jonb · Aug 11, 2010, 9:59 AM

I did another full delete of the RRD graphs and left in for 15 mins. The graphs only captured 2 mins worth of data and then stopped.

Jonb · Aug 11, 2010, 9:12 PM

Am I best off rolling back to 2.0 beta 1 when it worked?