RRD Graphs

jimp

After you remove the RRD files, you need to go to the RRD settings page and press 'save' to make sure everything is regenerated properly. Before you do that, you may also want to edit/save each gateway under System > Routing.

The Status > Traffic Graph page doesn't touch the RRD files so that isn't really relevant in this case.

One of the devs is actively working on the graphs right now. I know at least the week graph has problems, so it might be a good idea to wait a few days and try it again.

bear24rw

Thanks for the reply. They all seem to be working fine know after i updated to new nightly

johnnybe

Well, I've just updated 2.0-BETA3… built on Wed Jul 21 01:06:25 EDT 2010

No RRD graphs. I've tried everything you said and got some errors.

In the Traffic Tab > Graphs, the selection menu shows:
Allgraphs
Outbound
/var/db/rrd/wan
/var/db/rrd/lan
/var/db/rrd/ipsec

When selecting /var/db/rrd/wan the error is:
Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402... and so on to several lines.

PHP Line 402: if(! preg_match("/($curoption)[-.]/i", $curdatabase)) {
continue 2;
}

Also, I noticed the previous status_rrd_graph.php had up to 363 lines and the new version has 484.

@jimp:

After you remove the RRD files, you need to go to the RRD settings page and press 'save' to make sure everything is regenerated properly. Before you do that, you may also want to edit/save each gateway under System > Routing.

The Status > Traffic Graph page doesn't touch the RRD files so that isn't really relevant in this case.

One of the devs is actively working on the graphs right now. I know at least the week graph has problems, so it might be a good idea to wait a few days and try it again.

sumonchai

RRD Error
Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402 Warning: preg_match(): Unknown modifier 'v' in /usr/local/www/status_rrd_graph.php on line 402

Logs

php: /status_rrd_graph_img.php: Failed to create graph with error code , the error is:
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Sorry we do not have data to graph for /var/db/rrd/wan-traffic.rrd
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Failed to create graph with error code , the error is:
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Sorry we do not have data to graph for /var/db/rrd/wan-traffic.rrd
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Failed to create graph with error code , the error is:
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Sorry we do not have data to graph for /var/db/rrd/wan-traffic.rrd
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Failed to create graph with error code , the error is:
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Sorry we do not have data to graph for /var/db/rrd/wan-traffic.rrd
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Failed to create graph with error code , the error is:
Jul 22 13:04:49 php: /status_rrd_graph_img.php: Sorry we do not have data to graph for /var/db/rrd/wan-traffic.rrd
Jul 22 13:04:48 php: /status_rrd_graph_img.php: Failed to create graph with error code , the error is:
Jul 22 13:04:48 php: /status_rrd_graph_img.php: Sorry we do not have data to graph for /var/db/rrd/wan-traffic.rrd

PeterK2003

My RRD graphs are non-existent also which isn't a big deal but is the data still being collected? I'd like to have the data for future reference.

And i am on the latest build from 6ish this morning.

johnnybe

@PeterK2003:

My RRD graphs are non-existent also which isn't a big deal but is the data still being collected? I'd like to have the data for future reference.

And i am on the latest build from 6ish this morning.

All graphs are working here since I've deleted the current status_rrd_graph.php and got back the old one (yep, I had a backup).
But it works up to four hours being collected only… no more than that. >:(
If you want it back, delete /usr/local/www/status_rrd_graph.php and save the script below with the same name.

/* $Id$ */
/*
	status_rrd_graph.php
	Part of pfSense
	Copyright (C) 2007 Seth Mos <seth.mos@xs4all.nl>All rights reserved.

	Redistribution and use in source and binary forms, with or without
	modification, are permitted provided that the following conditions are met:

	1\. Redistributions of source code must retain the above copyright notice,
	   this list of conditions and the following disclaimer.

	2\. Redistributions in binary form must reproduce the above copyright
	   notice, this list of conditions and the following disclaimer in the
	   documentation and/or other materials provided with the distribution.

	THIS SOFTWARE IS PROVIDED ``AS IS'' AND ANY EXPRESS OR IMPLIED WARRANTIES,
	INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY
	AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
	AUTHOR BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY,
	OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
	SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
	INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
	CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
	ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
	POSSIBILITY OF SUCH DAMAGE.
*/
/*	
	pfSense_BUILDER_BINARIES:	/usr/bin/find
	pfSense_MODULE:	system
*/

##|+PRIV
##|*IDENT=page-status-rrdgraphs
##|*NAME=Status: RRD Graphs page
##|*DESCR=Allow access to the 'Status: RRD Graphs' page.
##|*MATCH=status_rrd_graph.php*
##|-PRIV

require("guiconfig.inc");
require_once("filter.inc");
require("shaper.inc");
require_once("rrd.inc");

/* if the rrd graphs are not enabled redirect to settings page */
if(! isset($config['rrd']['enable'])) {
	header("Location: status_rrd_graph_settings.php");
}

$rrddbpath = "/var/db/rrd/";
/* XXX: (billm) do we have an exec() type function that does this type of thing? */
exec("cd $rrddbpath;/usr/bin/find -name *.rrd", $databases);

if ($_GET['cat']) {
	$curcat = $_GET['cat'];
} else {
	if(! empty($config['rrd']['category'])) {
		$curcat = $config['rrd']['category'];
	} else {
		$curcat = "system";
	}
}

if ($_GET['option']) {
	$curoption = $_GET['option'];
} else {
	switch($curcat) {
		case "system":
			$curoption = "processor";
			break;
		case "queues":
			$curoption = "queues";
			break;
		case "queuedrops":
			$curoption = "queuedrops";
			break;
		case "quality":
			foreach($databases as $database) {
				if(preg_match("/[-]quality\.rrd/i", $database)) {
					/* pick off the 1st database we find that matches the quality graph */
					$name = explode("-", $database);
					$curoption = "$name[0]";
					continue 2;
				}
			}
		case "wireless":
			foreach($databases as $database) {
				if(preg_match("/[-]wireless\.rrd/i", $database)) {
					/* pick off the 1st database we find that matches the wireless graph */
					$name = explode("-", $database);
					$curoption = "$name[0]";
					continue 2;
				}
			}
		case "cellular":
			foreach($databases as $database) {
				if(preg_match("/[-]cellular\.rrd/i", $database)) {
					/* pick off the 1st database we find that matches the celullar graph */
					$name = explode("-", $database);
					$curoption = "$name[0]";
					continue 2;
				}
			}
		default:
			$curoption = "wan";
			break;
	}
}

if ($_GET['style']) {
	$curstyle = $_GET['style'];
} else {
	if(! empty($config['rrd']['style'])) {
		$curstyle = $config['rrd']['style'];
	} else {
		$curstyle = "inverse";
	}
}

/* sort names reverse so WAN comes first */
rsort($databases);

/* these boilerplate databases are required for the other menu choices */
$dbheader = array("allgraphs-traffic.rrd",
		"allgraphs-quality.rrd",
		"allgraphs-wireless.rrd",
		"allgraphs-cellular.rrd",
		"allgraphs-packets.rrd",
		"system-allgraphs.rrd",
		"system-throughput.rrd",
		"outbound-quality.rrd",
		"outbound-packets.rrd",
		"outbound-traffic.rrd");

foreach($databases as $database) {
	if(stristr($database, "wireless")) {
		$wireless = true;
	}
	if(stristr($database, "queues")) {
		$queues = true;
	}
	if(stristr($database, "cellular")) {
		$cellular = true;
	}
}
/* append the existing array to the header */
$ui_databases = array_merge($dbheader, $databases);

$styles = array('inverse' => 'Inverse',
		'absolute' => 'Absolute');
$periods = array("4h", "16h", "48h", "32d", "6m", "1y", "4y");

$pgtitle = array("Status","RRD Graphs");
include("head.inc");

?>

| 

<form name="form1" action="status_rrd_graph.php" method="get">
			">
						        $tab_array = array();
				if($curcat == "system") { $tabactive = True; } else { $tabactive = False; }
			        $tab_array[] = array("System", $tabactive, "status_rrd_graph.php?cat=system");
				if($curcat == "traffic") { $tabactive = True; } else { $tabactive = False; }
			        $tab_array[] = array("Traffic", $tabactive, "status_rrd_graph.php?cat=traffic");
				if($curcat == "packets") { $tabactive = True; } else { $tabactive = False; }
			        $tab_array[] = array("Packets", $tabactive, "status_rrd_graph.php?cat=packets");
				if($curcat == "quality") { $tabactive = True; } else { $tabactive = False; }
			        $tab_array[] = array("Quality", $tabactive, "status_rrd_graph.php?cat=quality");
				if($queues) {
					if($curcat == "queues") { $tabactive = True; } else { $tabactive = False; }
					$tab_array[] = array("Queues", $tabactive, "status_rrd_graph.php?cat=queues");
					if($curcat == "queuedrops") { $tabactive = True; } else { $tabactive = False; }
					$tab_array[] = array("QueueDrops", $tabactive, "status_rrd_graph.php?cat=queuedrops");
				}
				if($wireless) {
					if($curcat == "wireless") { $tabactive = True; } else { $tabactive = False; }
				        $tab_array[] = array("Wireless", $tabactive, "status_rrd_graph.php?cat=wireless");
				}
				if($cellular) {
					if($curcat == "cellular") { $tabactive = True; } else { $tabactive = False; }
				        $tab_array[] = array("Cellular", $tabactive, "status_rrd_graph.php?cat=cellular");
				}
				if($curcat == "settings") { $tabactive = True; } else { $tabactive = False; }
			        $tab_array[] = array("Settings", $tabactive, "status_rrd_graph_settings.php");
			        display_top_tabs($tab_array);
			?>
                </form>

 |
| 

                                        \n";
							}
						}
					}
					?>

|  |								
| 

					 <select name="option" class="formselect" style="z-index: -10;" onchange="document.form1.submit()">foreach ($ui_databases as $db => $database) {						if(! preg_match("/($curcat)/i", $database)) {							continue;						}						$optionc = split("-", $database);						$search = array("-", ".rrd", $optionc);						$replace = array(" :: ", "", $friendly);						switch($curcat) {							case "system":								$optionc = str_replace($search, $replace, $optionc[1]);								echo " <option value="\&quot;$optionc\&quot;&quot;;<br">$prettyprint = ucwords(str_replace($search, $replace, $optionc));								break;							default:								/* Deduce a interface if possible and use the description */								$optionc = "$optionc[0]";								$friendly = convert_friendly_interface_to_friendly_descr(strtolower($optionc));								if(empty($friendly)) {									$friendly = $optionc;								}								$search = array("-", ".rrd", $optionc);								$replace = array(" :: ", "", $friendly);								echo "</option> <option value="\&quot;$optionc\&quot;&quot;;<br">$prettyprint = ucwords(str_replace($search, $replace, $friendly));						}						if($curoption == $optionc) {							echo " selected ";						}						echo ">" . htmlspecialchars($prettyprint) . "</option>\n";					}					?></select> 

					 <select name="style" class="formselect" style="z-index: -10;" onchange="document.form1.submit()">foreach ($styles as $style => $styled) {						echo " <option value="\&quot;$style\&quot;&quot;;<br">if ($style == $curstyle) echo " selected";						echo ">" . htmlspecialchars($styled) . "</option>\n";					}					?></select> 

					foreach($periods as $period => $interval) {
						/* check which databases are valid for our category */
						foreach($ui_databases as $curdatabase) {
							if(! preg_match("/($curcat)/i", $curdatabase)) {
								continue;
							}
							$optionc = split("-", $curdatabase);
							$search = array("-", ".rrd", $optionc);
							$replace = array(" :: ", "", $friendly);
							switch($curoption) {
								case "outbound":
									/* only show interfaces with a gateway */
									$optionc = "$optionc[0]";
									if(!interface_has_gateway($optionc)) {
										if(!preg_match("/($optionc)-(quality)/", $curdatabase)) {
											continue 2;
										}
									}
									if(! preg_match("/($optionc)[-.]/i", $curdatabase)) {
										continue 2;
									}
									break;
								case "allgraphs":
									/* make sure we do not show the placeholder databases in the all view */
									if((stristr($curdatabase, "outbound")) || (stristr($curdatabase, "allgraphs"))) {
										continue 2;
									}
									break;
								default:
									/* just use the name here */
									if(! preg_match("/($curoption)[-.]/i", $curdatabase)) {
										continue 2;
									}
							}
							if(in_array($curdatabase, $databases)) {
								echo " |
| \n";
								echo "								echo "id='{$interval}-{$curoption}-{$curdatabase}' ALT=\"$prettydb Graph\" ";
								echo "SRC=\"status_rrd_graph_img.php?interval=$interval&database={$curdatabase}&style={$curstyle}\" />\n";
								echo "

* * *

\n";								
								echo " |													

					 |							

		 |</seth.mos@xs4all.nl>

BlueMatt

Fixed by Revision 002bc4ab. Either wait for a new build or download the two files from redmine and replace those on your box with these commands:

cd /usr/local/www/; fetch http://redmine.pfsense.org/projects/pfsense/repository/revisions/002bc4ab3268e6e5cb3a01ce73a4c1624d09050a/raw/usr/local/www/status_rrd_graph_img.php
cd /usr/local/www/; fetch http://redmine.pfsense.org/projects/pfsense/repository/revisions/9dc3798253279a13ddaae6d6a04269f85c27de5b/raw/usr/local/www/status_rrd_graph.php

Note that the second command actually downloads from revision 9dc37982 which makes further modifications for week graphs to work.

adx442

@BlueMatt:

Fixed by Revision 002bc4ab. Either wait for a new build or download the two files from redmine and replace those on your box with these commands:
cd /usr/local/www/; fetch http://redmine.pfsense.org/projects/pfsense/repository/revisions/002bc4ab3268e6e5cb3a01ce73a4c1624d09050a/raw/usr/local/www/status_rrd_graph_img.php
cd /usr/local/www/; fetch http://redmine.pfsense.org/projects/pfsense/repository/revisions/9dc3798253279a13ddaae6d6a04269f85c27de5b/raw/usr/local/www/status_rrd_graph.php
Note that the second command actually downloads from revision 9dc37982 which makes further modifications for week graphs to work.

Worked for me on the July 22nd snapshot. Needed to go to the RRD settings page, and click Save, then everything populated out correctly. Thanks!

databeestje

I've been working on the graphs today

Fixed the week graph. It was tracking the wrong week. And it now starts on monday.
Added a custom graph page for a start and end date. Which is missing a date picker currently.
OpenVPN now has traffic and packets stats for all OpenVPN servers.
Added backend for tracking openvpn users, graph is missing, data is collected though.
Synced the tabs on settings page.

All the graphs now start on boundaries for day, week, month, quarter, year and 4 years.
You can also select "previous period" which means you get the last full period instead of the current one.

BlueMatt

Yes you have been, and you have fixed all my problems, though for some reason your updates did not make it into the Fri Jul 23 05:17:16 EDT 2010 build. Or at least I had to re-download the versions from redmine in order for my rrd graphs to work after upgrading. Oh well I guess they will appear sometime later.

cmb

@BlueMatt:

Yes you have been, and you have fixed all my problems, though for some reason your updates did not make it into the Fri Jul 23 05:17:16 EDT 2010 build. Or at least I had to re-download the versions from redmine in order for my rrd graphs to work after upgrading. Oh well I guess they will appear sometime later.

That snapshot run started shortly before those changes.

adx442

@databeestje:

OpenVPN now has traffic and packets stats for all OpenVPN servers.

Thanks so much for this. I've wanted that graph for a long time.

databeestje

The online users graph should be coming fairly soon, it only has 1 datasource.

johnnybe

@databeestje:

I've been working on the graphs today
…

Added a custom graph page for a start and end date. Which is missing a date picker currently.
...

You've been doing a hard work, databeestje. Thanks, indeed.

But what kind of date is that below? That's what I have from the custom graph page:

Start: 1279989697 End: 1280004097

Please, don't get me wrong, just wanna understand.

databeestje

that is the number of seconds since epoch, which is jan 1 1970.

We'll be fine until we get to a tuesday in 2038 though.

databeestje

Online openvpn users graph per server is now available as well.

rlai000

It seems its ok and I could see the graphs.

But in the log, I've got this:
php: /status_rrd_graph_img.php: rrdcolors.inc.php for theme pfsense_ng does not exist, using defaults!

-Raylund

_igor_

Quality graph still doesn't work. All other graphs are working.

Only one small part of a graph is displayed, some time ago.

I too have the message "php: /status_rrd_graph_img.php: rrdcolors.inc.php for theme metallic does not exist, using defaults!"

quality.gif_thumb

databeestje

The quality graph databases are updated from apinger, so if that's broken you will see that exact behaviour.

The graphing front end can only work with the data in the RRD file.

_igor_

hmmm, apinger works. Do you have any idea where to look? I'm a bit lost here. Since a new install of the beta3 never worked…