Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    System self destructed overnight - need some guidance

    General pfSense Questions
    5
    18
    1.8k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      doktornotor Banned
      last edited by

      No, it does not conflict with anything, the only thing it does is saving base64-encoded plaintext notes into config.xml. Would take about a century of typing to fill 250GB drive with notes. SSH into the box, wipe some ntopng logs and other cruft

      rm -rf /var/db/ntopng/
      

      After that, remove the package from the developer shell menu.

      playback uninstallpkg pfSense-pkg-ntopng
      
      1 Reply Last reply Reply Quote 0
      • A
        AR15USR
        last edited by

        @doktornotor:

        No, it does not conflict with anything, the only thing it does is saving base64-encoded plaintext notes into config.xml. Would take about a century of typing to fill 250GB drive with notes. SSH into the box, wipe some ntopng logs and other cruft

        rm -rf /var/db/ntopng/
        

        After that, remove the package from the developer shell menu.

        playback uninstallpkg pfSense-pkg-ntopng
        

        Roger.

        I wipe the ntop logs when I get a chance tonight..

        Question: In your opinion could the setting of "Log packets matched from the default block rules in the ruleset" cause the disk to fill up from only a few % to 100%+ overnight (overnight being 7hours)? Is it possible that ntop caused that to happen overnight? What else could cause that? Just curious as to what could have caused this..

        Thanks


        2.6.0-RELEASE

        1 Reply Last reply Reply Quote 0
        • johnpozJ
          johnpoz LAYER 8 Global Moderator
          last edited by

          Who says the disk filled up over night??  Maybe it has been growing in usage from day one, lets call it 1% a day..  Yesterday it was at 99%, you go to bed and now today its 100% full..

          An intelligent man is sometimes forced to be drunk to spend time with his fools
          If you get confused: Listen to the Music Play
          Please don't Chat/PM me for help, unless mod related
          SG-4860 24.11 | Lab VMs 2.7.2, 24.11

          1 Reply Last reply Reply Quote 0
          • D
            doktornotor Banned
            last edited by

            Also, not not ever, ever enable the historical data "feature". (There's a giant warning about this.) And yeah, with johnpoz here, this does not happen overnight. The storage space can be monitored via SNMP and you can alert yourself accordingly on set thresholds.

            1 Reply Last reply Reply Quote 0
            • A
              AR15USR
              last edited by

              Understood about it happening slowly, but pretty sure I would have noticed. I watch the Dashboard System Information panel religiously and the Disk Usage was no where near even 30% yesterday. I have the web console up on my screen (with the system info panel displayed) pretty much the entire time I'm around. Before today I had yet to see any of the MBUF/CPU/Memory/Disk Usage ever get above 25%.

              I suppose I could have missed it though.

              I did notice when I turned on the "Log packets matched from the default block rules in the ruleset" in the firewall rules settings that a crap ton of blocks started flying by. More than I have ever seen before. Seems unusual but I paid no mind at the time..

              I did not have the historical data turned on in ntop btw.

              Oh, also forgot to mention I left nmap running a scan on my lan when I left for the night. It was running from a machine on the lan, wouldn't think this could cause anything like this.

              At any rate, I save my configuration routinely so worst case I just reinstall and reload the configuration file..

              @doktornotor, what application is that a screenshot of?


              2.6.0-RELEASE

              1 Reply Last reply Reply Quote 0
              • johnpozJ
                johnpoz LAYER 8 Global Moderator
                last edited by

                "@doktornotor, what application is that a screenshot of?"

                LibreNMS would be my guess ;)  Dok had mention setting that up recently ;)

                There are plenty of tools that can do it though.  If your a windows shop look at prtg.. Its free for 100 sensors..  LibreNMS is just a fork of observium..  But there are shittons of monitoring tools that can provide you that sort of information via snmp.

                An intelligent man is sometimes forced to be drunk to spend time with his fools
                If you get confused: Listen to the Music Play
                Please don't Chat/PM me for help, unless mod related
                SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                1 Reply Last reply Reply Quote 0
                • D
                  doktornotor Banned
                  last edited by

                  @johnpoz:

                  "@doktornotor, what application is that a screenshot of?"

                  LibreNMS would be my guess ;)  Dok had mention setting that up recently ;)

                  Yeah, that's LibreNMS. There're ready to use self-updating VMs available for download (Ubuntu 16 LTS or CentOS 7)

                  http://docs.librenms.org/Installation/Ubuntu-image/
                  http://docs.librenms.org/Installation/CentOS-image/

                  1 Reply Last reply Reply Quote 0
                  • KOMK
                    KOM
                    last edited by

                    Yeah, that's LibreNMS.

                    Sorry to hijack the thread, but how do you find working with LibreNMS?  I just implemented Zabbix here and while it is nice, it was a tremendous pain in the ass to set up, and doing anything custom was more effort than it was worth.

                    1 Reply Last reply Reply Quote 0
                    • DerelictD
                      Derelict LAYER 8 Netgate
                      last edited by

                      @AR15USR:

                      Question: In your opinion could the setting of "Log packets matched from the default block rules in the ruleset" cause the disk to fill up

                      No. The firewall log is circular. It never grows beyond its set limit.

                      Chattanooga, Tennessee, USA
                      A comprehensive network diagram is worth 10,000 words and 15 conference calls.
                      DO NOT set a source address/port in a port forward or firewall rule unless you KNOW you need it!
                      Do Not Chat For Help! NO_WAN_EGRESS(TM)

                      1 Reply Last reply Reply Quote 0
                      • A
                        AR15USR
                        last edited by

                        @doktornotor:

                        @johnpoz:

                        "@doktornotor, what application is that a screenshot of?"

                        LibreNMS would be my guess ;)  Dok had mention setting that up recently ;)

                        Yeah, that's LibreNMS. There're ready to use self-updating VMs available for download (Ubuntu 16 LTS or CentOS 7)

                        http://docs.librenms.org/Installation/Ubuntu-image/
                        http://docs.librenms.org/Installation/CentOS-image/

                        Thanks, maybe this will work for me better instead of trying to get ELK to work..


                        2.6.0-RELEASE

                        1 Reply Last reply Reply Quote 0
                        • johnpozJ
                          johnpoz LAYER 8 Global Moderator
                          last edited by

                          ELK is more for syslog, vs monitoring of interface traffic, disk sizes, services, etc.

                          An intelligent man is sometimes forced to be drunk to spend time with his fools
                          If you get confused: Listen to the Music Play
                          Please don't Chat/PM me for help, unless mod related
                          SG-4860 24.11 | Lab VMs 2.7.2, 24.11

                          1 Reply Last reply Reply Quote 0
                          • A
                            AR15USR
                            last edited by

                            @johnpoz:

                            ELK is more for syslog, vs monitoring of interface traffic, disk sizes, services, etc.

                            I was referring to the fact it has a prebuilt VM as I can't get ELK to work for the life of me ???


                            2.6.0-RELEASE

                            1 Reply Last reply Reply Quote 0
                            • D
                              doktornotor Banned
                              last edited by

                              @KOM:

                              Yeah, that's LibreNMS.

                              Sorry to hijack the thread, but how do you find working with LibreNMS?  I just implemented Zabbix here and while it is nice, it was a tremendous pain in the ass to set up, and doing anything custom was more effort than it was worth.

                              Oh… well, that's about 10,000% easier for anything capable of SNMP, plus no damned agents, proxies etc. required. Adding the devices and getting loads of basic monitoring data, graphs and a list/dashboard with overview of stuff shouldn't take more than a couple of hours. After that, you can play with tuning things, like disabling irrelevant SNMP plugins for various types of devices, customized alerting, monitoring of services (plus possibly some "one-click" remediation procedures if required, did not have time for that yet). Does fairly good job with pretty much default configuration when it comes to categorizing devices and producing relevant graphs for those.

                              Quick shrinked screenshot of random stuff added to a testing LibreNMS instance:

                              An overview of a switch:

                              Anyway, we are totally OT here, LOL.  ;D

                              1 Reply Last reply Reply Quote 0
                              • KOMK
                                KOM
                                last edited by

                                Anyway, we are totally OT here, LOL.

                                They can sue us.  Thanks for the info.  Muchly appreciated.

                                1 Reply Last reply Reply Quote 0
                                • A
                                  AR15USR
                                  last edited by

                                  Go ahead and thread jack, I don't mind. I'm going to install and learn this app so the knowledge is helpful…


                                  2.6.0-RELEASE

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post
                                  Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.