Netgate Discussion Forum
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Search
    • Register
    • Login

    Diskspace

    Scheduled Pinned Locked Moved 2.0-RC Snapshot Feedback and Problems - RETIRED
    13 Posts 6 Posters 21.9k Views
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A
      abasel
      last edited by

      I appear to be running out of disk space. I think some uninstalled package files might still be there or some partial updates. Where/how do I find these to delete them.

      What command line can I give to list the top files sizes.

      This issue is causing my squid to stop working. How to I delete my cache?

      1 Reply Last reply Reply Quote 0
      • N
        Nachtfalke
        last edited by

        The amount of discspace squid can use can be edited in the squid web gui (Cache Mgmt). but there is normally a low and high watermark which causes squid to empty the cache.
        but if you do NOT use a log rotate, this could perhaps be the problem of running out of space.

        http://doc.pfsense.org/index.php/Squid_Package_Tuning

        1 Reply Last reply Reply Quote 0
        • A
          abasel
          last edited by

          Thanks for that but where do I find the log so I can empty it

          1 Reply Last reply Reply Quote 0
          • N
            Nachtfalke
            last edited by

            /var/squid/log/access.log

            1 Reply Last reply Reply Quote 0
            • A
              abasel
              last edited by

              The file was only 9mb but I emptied it anyway…. didn't help

              php: /pkg_edit.php: Reloading Squid for configuration sync
              Feb 27 18:16:47 php: /pkg_edit.php: The command '/usr/local/sbin/squid -k reconfigure' returned exit code '1', the output was 'squid: ERROR: No running copy'
              Feb 27 18:16:48 check_reload_status: reloading filter
              Feb 27 18:16:48 check_reload_status: syncing firewall
              Feb 27 18:16:50 squid[14084]: Squid Parent: child process 43658 started
              Feb 27 18:16:50 kernel: pid 43658 (squid), uid 62 inumber 3109630 on /: filesystem full
              Feb 27 18:16:50 squid[43658]: Write failure – check your disk space and cache.log
              Feb 27 18:16:50 squid[14084]: Squid Parent: child process 43658 exited due to signal 6
              Feb 27 18:16:50 kernel: pid 43658 (squid), uid 62: exited on signal 6
              Feb 27 18:16:50 squid[14084]: Exiting due to repeated, frequent failures

              All that I can think of is that while trying to update the system, the downloads didn't complete so I may have these files taking space somewhere… just don't know where to go from here.

              1 Reply Last reply Reply Quote 0
              • T
                Tikimotel
                last edited by

                The cache can be deleted using "rm -rf /var/squid/cache/".
                Then create new cache folders by running "squid -z"

                (or lowering the "Hard disk cache size" and resynch, but it will take forever to complete)

                Tip: try tuning high and low watermark to be closer together.
                default difference is 5% (90% – 95%) but with a multiple gigabyte cache on the hard drive this 5% represents a lot of extra ram/diskspace.

                Also a lot of Hard disk cache also takes up more RAM, thumb rule: ~100MB RAM per gigabyte. (if I remember correctly)
                It also depends on how large the largest cached object may be.
                If you set this option to "large" the squid program may use more room than every option added together, because it may keep more than 1 object with the "large" size in cache or memory adding to the total allowed MB's or GB's.

                1 Reply Last reply Reply Quote 0
                • A
                  abasel
                  last edited by

                  I'm still getting the following …..  obviously I have a space problem. I did what was recommended above. I need some pointers as to which directories I can empty or how I go about fixing this. If I was in a windows box I would be fine but alas I don't know my way around Linux well enough.

                  Last 50 system log entries
                  Feb 28 18:40:45 kernel: pid 46309 (squid), uid 62 inumber 3109630 on /: filesystem full
                  Feb 28 18:40:45 squid[46309]: Write failure – check your disk space and cache.log
                  Feb 28 18:40:45 squid[30994]: Squid Parent: child process 46309 exited due to signal 6
                  Feb 28 18:40:45 kernel: pid 46309 (squid), uid 62: exited on signal 6
                  Feb 28 18:40:45 squid[30994]: Exiting due to repeated, frequent failures
                  Feb 28 18:40:53 kernel: pid 36523 (dhcpd), uid 1002 inumber 3109140 on /: filesystem full
                  Feb 28 18:41:28 dnsmasq[32316]: read /etc/hosts - 10 addresses
                  Feb 28 18:41:28 dnsmasq[32316]: read /etc/hosts - 10 addresses
                  Feb 28 18:41:30 Squid_Alarm[10094]: Squid has exited. Reconfiguring filter.
                  Feb 28 18:41:30 Squid_Alarm[10492]: Attempting restart…
                  Feb 28 18:41:30 squid[12202]: Squid Parent: child process 12787 started
                  Feb 28 18:41:33 Squid_Alarm[15633]: Reconfiguring filter…
                  Feb 28 18:41:34 Squid_Alarm[20699]: Squid has resumed. Reconfiguring filter.
                  Feb 28 18:41:53 squid[12787]: Write failure – check your disk space and cache.log
                  Feb 28 18:41:53 kernel: pid 12787 (squid), uid 62 inumber 3118099 on /: filesystem full
                  Feb 28 18:41:53 kernel: pid 12787 (squid), uid 62: exited on signal 6
                  Feb 28 18:42:06 php: /pkg_edit.php: Creating Squid cache dir /var/squid/cache
                  Feb 28 18:42:06 php: /pkg_edit.php: Creating squid cache subdirs in /var/squid/cache
                  Feb 28 18:42:09 squid[12202]: Squid Parent: child process 12787 exited due to signal 6
                  Feb 28 18:42:11 php: /pkg_edit.php: The command '/usr/local/sbin/squid -k kill' returned exit code '1', the output was 'squid: ERROR: Could not send signal 9 to process 12787: (3) No such process'
                  Feb 28 18:42:12 squid[12202]: Squid Parent: child process 30992 started
                  Feb 28 18:42:14 squid[30992]: Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
                  Feb 28 18:42:14 squid[12202]: Squid Parent: child process 30992 exited due to signal 6
                  Feb 28 18:42:14 kernel: pid 30992 (squid), uid 62: exited on signal 6
                  Feb 28 18:42:17 squid[12202]: Squid Parent: child process 51341 started
                  Feb 28 18:42:17 php: /pkg_edit.php: Reloading Squid for configuration sync
                  Feb 28 18:42:17 php: /pkg_edit.php: The command '/usr/local/sbin/squid -k reconfigure' returned exit code '1', the output was 'squid: ERROR: No running copy'
                  Feb 28 18:42:18 check_reload_status: reloading filter
                  Feb 28 18:42:18 check_reload_status: syncing firewall
                  Feb 28 18:42:18 check_reload_status: reloading filter
                  Feb 28 18:42:20 php: /pkg_edit.php: Reloading Squid for configuration sync
                  Feb 28 18:42:20 check_reload_status: reloading filter
                  Feb 28 18:43:36 check_reload_status: syncing firewall
                  Feb 28 18:43:36 check_reload_status: syncing firewall
                  Feb 28 18:43:38 php[44028]: /pkg_edit.php: Reloading Squid for configuration sync
                  Feb 28 18:43:38 check_reload_status: reloading filter
                  Feb 28 18:43:39 check_reload_status: syncing firewall
                  Feb 28 18:44:43 check_reload_status: syncing firewall
                  Feb 28 18:45:55 last message repeated 3 times
                  Feb 28 18:45:56 php: /pkg_edit.php: Reloading Squid for configuration sync
                  Feb 28 18:45:56 check_reload_status: reloading filter
                  Feb 28 18:45:57 check_reload_status: syncing firewall
                  Feb 28 18:46:04 dhclient[43247]: DHCPREQUEST on bge0 to 192.168.1.1 port 67
                  Feb 28 18:46:04 dhclient[43247]: DHCPACK from 192.168.1.1
                  Feb 28 18:46:04 dhclient: RENEW
                  Feb 28 18:46:04 dhclient: Creating resolv.conf
                  Feb 28 18:46:04 check_reload_status: Rewriting resolv.conf
                  Feb 28 18:46:05 dhclient[43247]: bound to 192.168.1.2 – renewal in 900 seconds.
                  Feb 28 18:46:09 dnsmasq[32316]: reading /etc/resolv.conf
                  Feb 28 18:46:09 dnsmasq[32316]: using nameserver 192.168.1.1#53

                  Feb 28 18:40:29 dhcpd: Wrote 0 deleted host decls to leases file.
                  Feb 28 18:40:29 dhcpd: Wrote 0 new dynamic host decls to leases file.
                  Feb 28 18:40:29 dhcpd: Wrote 8 leases to leases file.
                  Feb 28 18:40:29 dhcpd: commit_leases: unable to commit: No space left on device
                  Feb 28 18:40:29 dhcpd: DHCPREQUEST for 192.168.199.150 (192.168.199.1) from 00:1d:0d:01:46:c0 via xl0: database update failed
                  Feb 28 18:40:37 dhcpd: Wrote 0 deleted host decls to leases file.
                  Feb 28 18:40:37 dhcpd: Wrote 0 new dynamic host decls to leases file.
                  Feb 28 18:40:37 dhcpd: Wrote 8 leases to leases file.
                  Feb 28 18:40:37 dhcpd: commit_leases: unable to commit: No space left on device
                  Feb 28 18:40:37 dhcpd: DHCPREQUEST for 192.168.199.150 (192.168.199.1) from 00:1d:0d:01:46:c0 via xl0: database update failed
                  Feb 28 18:40:53 dhcpd: Wrote 0 deleted host decls to leases file.
                  Feb 28 18:40:53 dhcpd: Wrote 0 new dynamic host decls to leases file.
                  Feb 28 18:40:53 dhcpd: Wrote 8 leases to leases file.
                  Feb 28 18:40:53 dhcpd: commit_leases: unable to commit: No space left on device
                  Feb 28 18:40:53 dhcpd: DHCPREQUEST for 192.168.199.150 (192.168.199.1) from 00:1d:0d:01:46:c0 via xl0: database update failed
                  Feb 28 18:41:27 dhcpd: DHCPDISCOVER from 00:1d:0d:01:46:c0 via xl0
                  Feb 28 18:41:27 dhcpd: unexpected ICMP Echo Reply from 192.168.1.1
                  Feb 28 18:41:28 dhcpd: DHCPOFFER on 192.168.199.150 to 00:1d:0d:01:46:c0 via xl0

                  1 Reply Last reply Reply Quote 0
                  • A
                    abasel
                    last edited by

                    Not sure if this helps

                    [2.0-BETA4][root@server.baselmania.dyndns.org]/root(12): df -H
                    Filesystem    Size    Used  Avail Capacity  Mounted on
                    /dev/ad0s1a    37G    637M    33G    2%    /
                    devfs          1.0k    1.0k      0B  100%    /dev
                    /dev/md0      3.8M    53k    3.4M    2%    /var/run
                    devfs          1.0k    1.0k      0B  100%    /var/dhcpd/dev

                    Overall I appear to have enough space.

                    When I installed I simply followed the defaults…..... I really need someone to explain to me what's going on?  ???

                    Thanks :-)

                    1 Reply Last reply Reply Quote 0
                    • W
                      wallabybob
                      last edited by

                      @abasel:

                      Overall I appear to have enough space.

                      The log suggests you don't have enough space. I run which  a basic pfSense on a 1GB hard drive of which 260MB is reserved for swap. But I don't run any applications that seriously use the disk.

                      @abasel:

                      I really need someone to explain to me what's going on?  ???

                      My guess: some application or applications open one or more temporary files which are allocated space which is released when the application exits.

                      How long from startup does it take for the appearance of a report the / file system is full? (If this is long enough it might be possible to get some clues pointing to the culprit.

                      How is the system with the df output different from the system reporting the full root file system? (squid was disabled?)

                      1 Reply Last reply Reply Quote 0
                      • jimpJ
                        jimp Rebel Alliance Developer Netgate
                        last edited by

                        There is more than one way to run out of space on a drive.

                        Check the output of:

                        df -i
                        

                        It could be out of inodes if you have a large number of very small files.

                        Or you could also have hardware problems.

                        Remember: Upvote with the 👍 button for any user/post you find to be helpful, informative, or deserving of recognition!

                        Need help fast? Netgate Global Support!

                        Do not Chat/PM for help!

                        1 Reply Last reply Reply Quote 0
                        • A
                          abasel
                          last edited by

                          df -i

                          [2.0-BETA4][root@server.baselmania.dyndns.org]/root(2): df -i
                          Filesystem  1K-blocks  Used    Avail Capacity iused  ifree %iused  Mounted on
                          /dev/ad0s1a  35819164 634392 32319240    2%  27124 4612618    1%  /
                          devfs              1      1        0  100%      0      0  100%  /dev
                          /dev/md0        3694    52    3348    2%      27    739    4%  /var/run
                          devfs              1      1        0  100%      0      0  100%  /var/dhcpd/dev

                          1 Reply Last reply Reply Quote 0
                          • C
                            cmb
                            last edited by

                            You aren't running out of disk space then unless Squid is doing it and deletes whatever it's creating when it dies. Disk failures can present themselves as disk full messages as odd as that seems even when the disk isn't full. If you can manage to log in while it's still reporting the disk is full and getting that same info it may be helpful in determining whether you're really running out of disk space, or your disk is dying.

                            1 Reply Last reply Reply Quote 0
                            • A
                              abasel
                              last edited by

                              Was you reply came in I was postinvg the following: After leaving it for a day I returned to trouble shoot and noticed that the logs where now fine… enabled squid and safesquid and its working.... I'm inclined to go with your faulty disk diagnosis....The next question then is how does one transfer this to a new disk??  But I suppose that's for a different forum.

                              1 Reply Last reply Reply Quote 0
                              • First post
                                Last post
                              Copyright 2025 Rubicon Communications LLC (Netgate). All rights reserved.