Missing RRD data
-
I have two pfsense boxes in two different locations. I don't have any issues with RRD data in one of the boxes but the other one only shows data from 3/10/2019 onwards. I'm not entirely sure what happened to data before that date. I did reinstall pfsense (and restored a full backup) last 2/25/2019. If the restore failed to restore RRD, I would at least see data from 2/25 to 3/9 but those are also missing.
Any idea where to start looking at as to why historical date before 3/10 is nowhere to be found?
-
This is really weird, in my system logs, I see this:
Feb 25 17:32:22 radiusd 15009 Exiting normally
Feb 25 17:32:23 shutdown power-down by root:
Feb 25 17:32:24 kernel done.
Mar 9 07:23:17 syslogd kernel boot file is /boot/kernel/kernel
Mar 9 07:23:17 kernel Copyright (c) 1992-2018 The FreeBSD Project.
Mar 9 07:23:17 kernel Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
Mar 9 07:23:17 kernel The Regents of the University of California. All rights reserved.
Mar 9 07:23:17 kernel FreeBSD is a registered trademark of The FreeBSD Foundation.
Mar 9 07:23:17 kernel FreeBSD 11.2-RELEASE-p6 #3 518496b29ae(RELENG_2_4_4): Wed Dec 12 07:41:44 EST 2018
Mar 9 07:23:17 kernel root@buildbot2.nyi.netgate.com:/build/ce-crossbuild-244/obj/amd64/ZfGpH5cd/build/ce-crossbuild-244/pfSense/tmp/FreeBSD-src/sys/pfSense amd64Look how it jumped from 2/25 to 3/9? It's as if it was turned off the whole time but this is impossible because this firewall/router box is used 24/7. I would've known if it was off for that amount of time. Could it be the logging was somehow disabled?
-
System clock correct? ntp updated?
Do you run ramdisks?
Steve
-
Yes, system clock is correct and ntp is updated.
And yes, I do use ramdisks for /tmp and /var. So maybe a power loss corrupted data in the ramdisk and RRD data got lost? Will ramdisk data be written to hard disk during graceful shutdown?
-
RAMDisk being written some where else - except the config.xml ?
Dono .... https://forum.netgate.com/topic/104180/pfsense-ramdisk-usage and more threads exists - the very same question is asked a lot.
I guess not. -
@Gertjan said in Missing RRD data:
RAMDisk being written some where else - except the config.xml ?
Dono .... https://forum.netgate.com/topic/104180/pfsense-ramdisk-usage and more threads exists - the very same question is asked a lot.
I guess not.Right, I was the one who asked that, lol.
So according to @jimp RRD and DHCP leases are written to permanent storage but if that's the case why do we still have the option of specifying the "Periodic RAM Disk Data Backups" setting? I'm confused.
-
https://docs.netgate.com/pfsense/en/latest/book/config/advanced-misc.html#ram-disk-settings
Make sure your RAM disks are big enough for the data they should contain, the defaults are far to small.
-
@Grimson said in Missing RRD data:
https://docs.netgate.com/pfsense/en/latest/book/config/advanced-misc.html#ram-disk-settings
Make sure your RAM disks are big enough for the data they should contain, the defaults are far to small.
I have them both set to 128MB. So it says in that link that RRD and DHCP leases are saved during graceful shutdown. I guess I lost data because of an improper shutdown somehow (though I have a UPS that handles this) and because I don't have periodic backup set. I'll set periodic backup now just to be sure.
-
@kevindd992002 said in Missing RRD data:
I have them both set to 128MB.
And what packages are you running? With heavy packages like pfBlockerNG, suricata, snort or squid this will likely not be enough.
-
@Grimson said in Missing RRD data:
@kevindd992002 said in Missing RRD data:
I have them both set to 128MB.
And what packages are you running? With heavy packages like pfBlockerNG, suricata, snort or squid this will likely not be enough.
Very simple ones, actually: freeradius3, iperf, nut, RRD_Summary
-
Mostly likely it lost power and hence whatever was in the RAM disks at that time. Yes the data is written to permanent storage when it is shutdown gracefully.
Steve