Navigation

    Netgate Discussion Forum
    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search

    Missing RRD data

    General pfSense Questions
    4
    11
    126
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • K
      kevindd992002 last edited by kevindd992002

      I have two pfsense boxes in two different locations. I don't have any issues with RRD data in one of the boxes but the other one only shows data from 3/10/2019 onwards. I'm not entirely sure what happened to data before that date. I did reinstall pfsense (and restored a full backup) last 2/25/2019. If the restore failed to restore RRD, I would at least see data from 2/25 to 3/9 but those are also missing.

      Any idea where to start looking at as to why historical date before 3/10 is nowhere to be found?

      1 Reply Last reply Reply Quote 0
      • K
        kevindd992002 last edited by

        This is really weird, in my system logs, I see this:

        Feb 25 17:32:22 radiusd 15009 Exiting normally
        Feb 25 17:32:23 shutdown power-down by root:
        Feb 25 17:32:24 kernel done.
        Mar 9 07:23:17 syslogd kernel boot file is /boot/kernel/kernel
        Mar 9 07:23:17 kernel Copyright (c) 1992-2018 The FreeBSD Project.
        Mar 9 07:23:17 kernel Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        Mar 9 07:23:17 kernel The Regents of the University of California. All rights reserved.
        Mar 9 07:23:17 kernel FreeBSD is a registered trademark of The FreeBSD Foundation.
        Mar 9 07:23:17 kernel FreeBSD 11.2-RELEASE-p6 #3 518496b29ae(RELENG_2_4_4): Wed Dec 12 07:41:44 EST 2018
        Mar 9 07:23:17 kernel root@buildbot2.nyi.netgate.com:/build/ce-crossbuild-244/obj/amd64/ZfGpH5cd/build/ce-crossbuild-244/pfSense/tmp/FreeBSD-src/sys/pfSense amd64

        Look how it jumped from 2/25 to 3/9? It's as if it was turned off the whole time but this is impossible because this firewall/router box is used 24/7. I would've known if it was off for that amount of time. Could it be the logging was somehow disabled?

        1 Reply Last reply Reply Quote 0
        • stephenw10
          stephenw10 Netgate Administrator last edited by

          System clock correct? ntp updated?

          Do you run ramdisks?

          Steve

          K 1 Reply Last reply Reply Quote 0
          • K
            kevindd992002 @stephenw10 last edited by

            @stephenw10

            Yes, system clock is correct and ntp is updated.

            And yes, I do use ramdisks for /tmp and /var. So maybe a power loss corrupted data in the ramdisk and RRD data got lost? Will ramdisk data be written to hard disk during graceful shutdown?

            1 Reply Last reply Reply Quote 0
            • Gertjan
              Gertjan last edited by

              RAMDisk being written some where else - except the config.xml ?
              Dono .... https://forum.netgate.com/topic/104180/pfsense-ramdisk-usage and more threads exists - the very same question is asked a lot.
              I guess not.

              K 1 Reply Last reply Reply Quote 0
              • K
                kevindd992002 @Gertjan last edited by

                @Gertjan said in Missing RRD data:

                RAMDisk being written some where else - except the config.xml ?
                Dono .... https://forum.netgate.com/topic/104180/pfsense-ramdisk-usage and more threads exists - the very same question is asked a lot.
                I guess not.

                Right, I was the one who asked that, lol.

                So according to @jimp RRD and DHCP leases are written to permanent storage but if that's the case why do we still have the option of specifying the "Periodic RAM Disk Data Backups" setting? I'm confused.

                1 Reply Last reply Reply Quote 0
                • Grimson
                  Grimson Banned last edited by

                  https://docs.netgate.com/pfsense/en/latest/book/config/advanced-misc.html#ram-disk-settings

                  Make sure your RAM disks are big enough for the data they should contain, the defaults are far to small.

                  K 1 Reply Last reply Reply Quote 0
                  • K
                    kevindd992002 @Grimson last edited by

                    @Grimson said in Missing RRD data:

                    https://docs.netgate.com/pfsense/en/latest/book/config/advanced-misc.html#ram-disk-settings

                    Make sure your RAM disks are big enough for the data they should contain, the defaults are far to small.

                    I have them both set to 128MB. So it says in that link that RRD and DHCP leases are saved during graceful shutdown. I guess I lost data because of an improper shutdown somehow (though I have a UPS that handles this) and because I don't have periodic backup set. I'll set periodic backup now just to be sure.

                    Grimson 1 Reply Last reply Reply Quote 0
                    • Grimson
                      Grimson Banned @kevindd992002 last edited by

                      @kevindd992002 said in Missing RRD data:

                      I have them both set to 128MB.

                      And what packages are you running? With heavy packages like pfBlockerNG, suricata, snort or squid this will likely not be enough.

                      K 1 Reply Last reply Reply Quote 0
                      • K
                        kevindd992002 @Grimson last edited by

                        @Grimson said in Missing RRD data:

                        @kevindd992002 said in Missing RRD data:

                        I have them both set to 128MB.

                        And what packages are you running? With heavy packages like pfBlockerNG, suricata, snort or squid this will likely not be enough.

                        Very simple ones, actually: freeradius3, iperf, nut, RRD_Summary

                        1 Reply Last reply Reply Quote 0
                        • stephenw10
                          stephenw10 Netgate Administrator last edited by

                          Mostly likely it lost power and hence whatever was in the RAM disks at that time. Yes the data is written to permanent storage when it is shutdown gracefully.

                          Steve

                          1 Reply Last reply Reply Quote 0

                          Products

                          • Platform Overview
                          • TNSR
                          • pfSense
                          • Appliances

                          Services

                          • Training
                          • Professional Services

                          Support

                          • Subscription Plans
                          • Contact Support
                          • Product Lifecycle
                          • Documentation

                          News

                          • Media Coverage
                          • Press
                          • Events

                          Resources

                          • Blog
                          • FAQ
                          • Find a Partner
                          • Resource Library
                          • Security Information

                          Company

                          • About Us
                          • Careers
                          • Partners
                          • Contact Us
                          • Legal
                          Our Mission

                          We provide leading-edge network security at a fair price - regardless of organizational size or network sophistication. We believe that an open-source security model offers disruptive pricing along with the agility required to quickly address emerging threats.

                          Subscribe to our Newsletter

                          Product information, software announcements, and special offers. See our newsletter archive to sign up for future newsletters and to read past announcements.

                          © 2020 Rubicon Communications, LLC | Privacy Policy