Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Free up space, disk storage >80%

    Scheduled Pinned Locked Moved General pfSense Questions
    48 Posts 5 Posters 9.8k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RobbieTTR
      RobbieTT @stephenw10
      last edited by

      @stephenw10

      I think ntopng has a GUI button to remove all the database entries, leaving you the uninstall and any remaining rm and rmdir after that.

      I'm surprised how much space pfblockerNG took; mine is a mere fraction of that.

      Still lots unaccounted for. The biggest user of space on mine is having version snapshots for different dev loads. The rest is trivial:

       2023-10-11 at 15.17.36.png

      Good hunting.

      ☕️

      R GertjanG 2 Replies Last reply Reply Quote 0
      • R
        RobinH @RobbieTT
        last edited by

        @RobbieTT Yeah, I will uninstall the PfBlocker... not using it at all.

        And will clear the ntopng files...

        1 Reply Last reply Reply Quote 0
        • GertjanG
          Gertjan @RobbieTT
          last edited by

          @RobbieTT said in Free Disk space >80%:

          I'm surprised how much space pfblockerNG took

          I presume this happens out there in the wild :
          People install pfBlockerng, and start to try out all these : Firewall > pfBlockerNG > Feeds because "why not ?".
          Soon, they'll discover that there is something as a resource limit, and not only disk space, but also that Xeon 8 core processor that goes hot read. An ARM won't make it at all ....

          All these 'feed' files initially downloaded, and their parsed and assembled counter parts will stay in the sub folders of this folder path /var/db/pfblockerng for until the end of days .... (or pfSense re install) or manual cleaning, as I don't think the /var/db/pfblockerng/. is emptied upon package removal. [ I have to try that one ... ]
          Still, pfBlockerng is a small example. Processes (programs) that auto generate content are a real admin's nightmare - you have to watch them as you would do with babies. Even on big-iron-servers with loads of disk space (multiple T's) I do graph constantly free inodes and free disk blocks (disk space). Here is the same thing for my pfSense.

          File rotating for log files is the most straightforward example : as soon as my apache2 servers (or mail server) get swamped by requests, log files start to grow rapidly - like very fast. By simply launching multiple requests the server will steadily fill up its disk space, and then the classic game starts : what comes first : log rotation or server crash.

          No "help me" PM's please. Use the forum, the community will thank you.
          Edit : and where are the logs ??

          1 Reply Last reply Reply Quote 0
          • R
            RobinH @stephenw10
            last edited by

            @stephenw10

            Tried this today, but it seems like there is no files there?

            (RobinH@192.168.3.1) Password for RobinH@fw-01.zafe.se:
            [2.6.0-RELEASE][RobinH@fw-01.zafe.se]/home/RobinH: cd /var/db/ntopng/rrd
            [2.6.0-RELEASE][RobinH@fw-01.zafe.se]/var/db/ntopng/rrd: ls
            graphics
            [2.6.0-RELEASE][RobinH@fw-01.zafe.se]/var/db/ntopng/rrd:

            1 Reply Last reply Reply Quote 0
            • stephenw10S
              stephenw10 Netgate Administrator
              last edited by

              Did you manage to free any significant amount of space?

              R 1 Reply Last reply Reply Quote 0
              • R
                RobinH @stephenw10
                last edited by

                @stephenw10 No, I cant find the entries when i look in Var/db/ntopng

                1 Reply Last reply Reply Quote 0
                • stephenw10S
                  stephenw10 Netgate Administrator
                  last edited by

                  What does du -h -d1 / show now?

                  RobbieTTR R 2 Replies Last reply Reply Quote 0
                  • RobbieTTR
                    RobbieTT @stephenw10
                    last edited by

                    Is it only me that is triggered by the topic title?

                    No, just me and symbols then. 🤷

                    ☕️

                    R 1 Reply Last reply Reply Quote 0
                    • R
                      RobinH @RobbieTT
                      last edited by

                      @RobbieTT Yeah... maybe it should be more like Free up space, disk storage >80%

                      1 Reply Last reply Reply Quote 0
                      • stephenw10S
                        stephenw10 Netgate Administrator
                        last edited by

                        I'd say either Used Disk Space >80% or Free Disk Space <20%. I can change it?

                        R 1 Reply Last reply Reply Quote 0
                        • R
                          RobinH @stephenw10
                          last edited by

                          @stephenw10 Please do 😊

                          1 Reply Last reply Reply Quote 0
                          • R
                            RobinH @stephenw10
                            last edited by

                            @stephenw10 Well, I have'nt found the entrie files, so there is nothing deleted.

                            4.0K /.snap
                            3.0K /dev
                            1.4G /usr
                            117M /cf
                            1.3M /bin
                            4.0K /proc
                            96K /root
                            7.9M /etc
                            4.0K /net
                            426M /boot
                            12M /lib
                            4.0K /media
                            11M /rescue
                            4.0K /mnt
                            132M /tmp
                            4.9M /sbin
                            698M /var
                            192K /libexec
                            12K /conf.default
                            244K /home
                            4.0K /.cache
                            2.9G /

                            1 Reply Last reply Reply Quote 0
                            • stephenw10S
                              stephenw10 Netgate Administrator
                              last edited by

                              What do you see from geom part list?

                              R 1 Reply Last reply Reply Quote 0
                              • R
                                RobinH @stephenw10
                                last edited by

                                @stephenw10 How do I get that?

                                GertjanG 1 Reply Last reply Reply Quote 0
                                • GertjanG
                                  Gertjan @RobinH
                                  last edited by

                                  @RobinH

                                  By typing that command.

                                  [23.05.1-RELEASE][root@pfSense.bhf.net]/root: geom part list
                                  Geom name: nvd0
                                  modified: false
                                  state: OK
                                  fwheads: 255
                                  fwsectors: 63
                                  last: 234441607
                                  first: 40
                                  entries: 128
                                  scheme: GPT
                                  Providers:
                                  1. Name: nvd0p1
                                     Mediasize: 209715200 (200M)
                                     Sectorsize: 512
                                     Stripesize: 0
                                     Stripeoffset: 20480
                                     Mode: r1w1e2
                                     efimedia: HD(1,GPT,ebd48d0e-974a-11ed-be66-90ec7729392c,0x28,0x64000)
                                     rawuuid: ebd48d0e-974a-11ed-be66-90ec7729392c
                                     rawtype: c12a7328-f81f-11d2-ba4b-00a0c93ec93b
                                     label: efiboot0
                                     length: 209715200
                                     offset: 20480
                                     type: efi
                                     index: 1
                                     end: 409639
                                     start: 40
                                  2. Name: nvd0p2
                                     Mediasize: 524288 (512K)
                                     Sectorsize: 512
                                     Stripesize: 0
                                     Stripeoffset: 209735680
                                     Mode: r0w0e0
                                     efimedia: HD(2,GPT,ebdf0e41-974a-11ed-be66-90ec7729392c,0x64028,0x400)
                                     rawuuid: ebdf0e41-974a-11ed-be66-90ec7729392c
                                     rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
                                     label: gptboot0
                                     length: 524288
                                     offset: 209735680
                                     type: freebsd-boot
                                     index: 2
                                     end: 410663
                                     start: 409640
                                  3. Name: nvd0p3
                                     Mediasize: 1073741824 (1.0G)
                                     Sectorsize: 512
                                     Stripesize: 0
                                     Stripeoffset: 210763776
                                     Mode: r1w1e0
                                     efimedia: HD(3,GPT,ebe48038-974a-11ed-be66-90ec7729392c,0x64800,0x200000)
                                     rawuuid: ebe48038-974a-11ed-be66-90ec7729392c
                                     rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
                                     label: swap0
                                     length: 1073741824
                                     offset: 210763776
                                     type: freebsd-swap
                                     index: 3
                                     end: 2508799
                                     start: 411648
                                  4. Name: nvd0p4
                                     Mediasize: 118749134848 (111G)
                                     Sectorsize: 512
                                     Stripesize: 0
                                     Stripeoffset: 1284505600
                                     Mode: r1w1e1
                                     efimedia: HD(4,GPT,ebe8094b-974a-11ed-be66-90ec7729392c,0x264800,0xdd30000)
                                     rawuuid: ebe8094b-974a-11ed-be66-90ec7729392c
                                     rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
                                     label: zfs0
                                     length: 118749134848
                                     offset: 1284505600
                                     type: freebsd-zfs
                                     index: 4
                                     end: 234440703
                                     start: 2508800
                                  Consumers:
                                  1. Name: nvd0
                                     Mediasize: 120034123776 (112G)
                                     Sectorsize: 512
                                     Mode: r3w3e6
                                  

                                  No "help me" PM's please. Use the forum, the community will thank you.
                                  Edit : and where are the logs ??

                                  R 1 Reply Last reply Reply Quote 1
                                  • R
                                    RobinH @Gertjan
                                    last edited by

                                    @Gertjan said in Free up space, disk storage >80%:

                                    geom part list

                                    Hey!

                                    This is what I get:

                                    Geom name: da0
                                    modified: false
                                    state: OK
                                    fwheads: 255
                                    fwsectors: 63
                                    last: 125829119
                                    first: 63
                                    entries: 4
                                    scheme: MBR
                                    Providers:

                                    1. Name: da0s1
                                      Mediasize: 21474803200 (20G)
                                      Sectorsize: 512
                                      Stripesize: 0
                                      Stripeoffset: 32768
                                      Mode: r2w2e5
                                      efimedia: HD(1,MBR,0x90909090,0x40,0x27fffbf)
                                      attrib: active
                                      rawtype: 165
                                      length: 21474803200
                                      offset: 32768
                                      type: freebsd
                                      index: 1
                                      end: 41943038
                                      start: 64
                                      Consumers:
                                    2. Name: da0
                                      Mediasize: 64424509440 (60G)
                                      Sectorsize: 512
                                      Mode: r2w2e7

                                    Geom name: da0s1
                                    modified: false
                                    state: OK
                                    fwheads: 255
                                    fwsectors: 63
                                    last: 41942974
                                    first: 0
                                    entries: 8
                                    scheme: BSD
                                    Providers:

                                    1. Name: da0s1a
                                      Mediasize: 20401094656 (19G)
                                      Sectorsize: 512
                                      Stripesize: 0
                                      Stripeoffset: 32768
                                      Mode: r1w1e2
                                      rawtype: 7
                                      length: 20401094656
                                      offset: 0
                                      type: freebsd-ufs
                                      index: 1
                                      end: 39845887
                                      start: 0
                                    2. Name: da0s1b
                                      Mediasize: 1073708032 (1.0G)
                                      Sectorsize: 512
                                      Stripesize: 0
                                      Stripeoffset: 3221258240
                                      Mode: r1w1e1
                                      rawtype: 1
                                      length: 1073708032
                                      offset: 20401094656
                                      type: freebsd-swap
                                      index: 2
                                      end: 41942973
                                      start: 39845888
                                      Consumers:
                                    3. Name: da0s1
                                      Mediasize: 21474803200 (20G)
                                      Sectorsize: 512
                                      Stripesize: 0
                                      Stripeoffset: 32768
                                      Mode: r2w2e5
                                    1 Reply Last reply Reply Quote 0
                                    • stephenw10S
                                      stephenw10 Netgate Administrator
                                      last edited by

                                      Hmm, nothing unexpected there. There's got to be something in da0s1a that du isn't seeing for some reason. 🤔

                                      R 1 Reply Last reply Reply Quote 0
                                      • R
                                        RobinH @stephenw10
                                        last edited by

                                        @stephenw10 Well... now I have managed to erase all of the entries and PfBlockerNG. So its pretty clean when I run "find /var/db/ -type d -ls | sort -n -r"

                                        2166917        8 drwxr-xr-x    2 root                             wheel                                 512 Jan 31  2022 /var/db/ports
                                        2166916        8 drwx------    2 root                             wheel                                 512 Jan 31  2022 /var/db/hyperv
                                        2166915        8 drwx------    2 root                             wheel                                 512 Jan 31  2022 /var/db/freebsd-update
                                        2166914        8 drwx------    2 operator                         operator                              512 Jan 31  2022 /var/db/entropy
                                        2007323        8 drwxr-xr-x    2 root                             wheel                                 512 Mar 17  2022 /var/db/vnstat
                                        1927668        8 drwxr-xr-x    2 root                             wheel                                 512 Jun  2 22:08 /var/db/aliastables
                                        1926291        8 drwxr-xr-x    2 root                             wheel                                 512 Jul 22  2020 /var/db/fontconfig
                                        1926179       64 drwxr-xr-x    2 nobody                           wheel                               32256 Oct 30 14:20 /var/db/rrd
                                        1926162        8 drwxr-xr-x    2 root                             wheel                                 512 Jan 31  2022 /var/db/zfsd/cases
                                        1926161        8 drwxr-xr-x    2 123                              123                                   512 Jan 31  2022 /var/db/ntp
                                        1926160        8 drwxr-xr-x    2 root                             wheel                                 512 Jan 31  2022 /var/db/portsnap
                                        1926159        8 drwxr-xr-x    3 root                             wheel                                 512 Jan 31  2022 /var/db/zfsd
                                        1926158        8 drwxr-xr-x    2 root                             wheel                                 512 Nov  3 03:05 /var/db/pkg
                                        1926157        8 drwx------    2 root                             wheel                                 512 Jan 31  2022 /var/db/ipf
                                        1926154       16 drwxr-xr-x   15 root                             wheel                                8192 Nov  3 14:42 /var/db/
                                        

                                        But what is taking all the storage....

                                        R 1 Reply Last reply Reply Quote 0
                                        • R
                                          RobinH @RobinH
                                          last edited by

                                          @RobinH When I run "gpart show -p da0" this is what I get:

                                          =>       63  125829057    da0  MBR  (60G)
                                                   63          1         - free -  (512B)
                                                   64   41942975  da0s1  freebsd  [active]  (20G)
                                             41943039   83886081         - free -  (40G)
                                          
                                          1 Reply Last reply Reply Quote 0
                                          • stephenw10S
                                            stephenw10 Netgate Administrator
                                            last edited by

                                            Yes that's expected until you use growfs to fill the new space.

                                            RobbieTTR 1 Reply Last reply Reply Quote 0
                                            • First post
                                              Last post
                                            Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.