Issues with RRD Graphs in v1.2-BETA-1

[Borage]

Yesterday, I downloaded pfSense 1.2-BETA-1 and installed the system to a harddisk drive. I find out that only the "Quality" graph shows some information, the other tabs is empty. I'm quite sure that it worked from the live cd, but not after the installation.

[sullrich]

This means it has not accumulated enough data to present the graphs.  Give it a day or so.

[Borage]

You were right, now I have some charts displaying. What is still missing is the chart for the WAN interface. I have had a constant 2 Mbit/s stream of data from my LAN through the WAN interface the last 24 hours, but still no charts for the interface.

[databeestje]

This would mean the update script could be broken.

can you show me what databases you have in /var/db/rrd?
ls -lh /var/db/rrd

and the contents from the updaterrd.sh script please.

Are you using a traffic shaper? Bridged interfaces? Vlans?

[Borage]

@databeestje:

can you show me what databases you have in /var/db/rrd?
ls -lh /var/db/rrd

$ ls -lh /var/db/rrd
total 3660
-rw-r–r--  1 root  wheel  128K May 14 19:23 ipsec-packets.rrd
-rw-r--r--  1 root  wheel  128K May 14 19:23 ipsec-traffic.rrd
-rw-r--r--  1 root  wheel  128K May 14 19:23 lan-packets.rrd
-rw-r--r--  1 root  wheel  128K May 14 19:23 lan-traffic.rrd
-rw-r--r--  1 root  wheel  476K May 14 19:23 system-processor.rrd
-rw-r--r--  1 root  wheel  476K May 14 19:23 system-states.rrd
-rw-r--r--  1 root  wheel  2.5K May 14 03:50 updaterrd.sh
-rw-r--r--  1 root  wheel  128K May 14 19:23 wan-packets.rrd
-rw-r--r--  1 root  wheel    64K May 14 19:22 wan-quality.rrd
-rw-r--r--  1 root  wheel  128K May 14 19:23 wan-traffic.rrd

@databeestje:

and the contents from the updaterrd.sh script please.

$ cat /var/db/rrd/updaterrd.sh
#!/bin/sh

counter=1
while [ "$counter" -ne 0 ]
do

# polling traffic for interface wan xl0 
/usr/local/bin/rrdtool update /var/db/rrd/wan-traffic.rrd N:\
`/usr/bin/netstat -nbf link -I xl0 | /usr/bin/awk '{getline 2;print $7 ":" $10}'`

# polling packets for interface wan xl0 
/usr/local/bin/rrdtool update /var/db/rrd/wan-packets.rrd N:\
`/usr/bin/netstat -nbf link -I xl0 | /usr/bin/awk '{getline 2;print $5 ":" $8}'`
get_quality_stats_wan () {
	packetloss_wan=100
	roundtrip_wan=0
	local out_wan
	out_wan=` ping -c 5 -q 81.236.2.1 `
	if [ $? -eq 0 ]; then
		packetloss_wan=` echo $out_wan | cut -f18 -d' ' | cut -c -1 `
		roundtrip_wan=` echo $out_wan | cut -f24 -d' ' | cut -f2 -d'/' `
	fi
	/usr/local/bin/rrdtool update /var/db/rrd/wan-quality.rrd N:$packetloss_wan:$roundtrip_wan
}

get_quality_stats_wan &

# polling traffic for interface lan xl1 
/usr/local/bin/rrdtool update /var/db/rrd/lan-traffic.rrd N:\
`/usr/bin/netstat -nbf link -I xl1 | /usr/bin/awk '{getline 2;print $7 ":" $10}'`

# polling packets for interface lan xl1 
/usr/local/bin/rrdtool update /var/db/rrd/lan-packets.rrd N:\
`/usr/bin/netstat -nbf link -I xl1 | /usr/bin/awk '{getline 2;print $5 ":" $8}'`

# polling traffic for interface ipsec enc0 
/usr/local/bin/rrdtool update /var/db/rrd/ipsec-traffic.rrd N:\
`/usr/bin/netstat -nbf link -I enc0 | /usr/bin/awk '{getline 2;print $6 ":" $9}'`

# polling packets for interface ipsec enc0 
/usr/local/bin/rrdtool update /var/db/rrd/ipsec-packets.rrd N:\
`/usr/bin/netstat -nbf link -I enc0 | /usr/bin/awk '{getline 2;print $4 ":" $7}'`

pfrate="` /sbin/pfctl -si | egrep "inserts|removals" | awk '{ pfrate = $3 + pfrate } {print pfrate}'|tail -1 `"
pfstates="` /sbin/pfctl -ss | egrep -v "<\-.*?<\-|\->.*?\->" | wc -l|sed 's/ //g'`"
pfnat="` /sbin/pfctl -ss | egrep '<\-.*?<\-|\->.*?\->' | wc -l|sed 's/ //g' `"
srcip="` /sbin/pfctl -ss | egrep -v '<\-.*?<\-|\->.*?\->' | grep '\->' | awk '{print $3}' | awk -F: '{print $1}' | sort -u|wc -l|sed 's/ //g' `"
dstip="` /sbin/pfctl -ss | egrep -v '<\-.*?<\-|\->.*?\->' | grep '<\-' | awk '{print $3}' | awk -F: '{print $1}' | sort -u|wc -l|sed 's/ //g' `"
/usr/local/bin/rrdtool update /var/db/rrd/system-states.rrd N:$pfrate:$pfstates:$pfnat:$srcip:$dstip

`/usr/bin/top -d 2 -s 1 0 | /usr/bin/awk '{gsub(/%/, "")} BEGIN { printf "/usr/local/bin/rrdtool update /var/db/rrd/system-processor.rrd " } { if ( $2 == "processes:" ) { processes = $1; } else if ( $1 == "CPU" ) { user = $3; nice = $5; sys = $7; interrupt = $9; } } END { printf "N:"user":"nice":"sys":"interrupt":"processes }'`

sleep 60
done

@databeestje:

Are you using a traffic shaper? Bridged interfaces? Vlans?

No, only default install + two NAT rules.

[databeestje]

is the update script running?

ps auxw |grep -i rrd

[databeestje]

Does it look like the files are updated every minute?

The update script looks good and should perform normally.

[Borage]

After 48 hours it suddenly works.  ???

Here you can see a 300 Mbit/s peak one hour before the chart started to display something on the WAN interface.