5. Diskspace

Diskspace

  • A

    I appear to be running out of disk space. I think some uninstalled package files might still be there or some partial updates. Where/how do I find these to delete them.

    What command line can I give to list the top files sizes.

    This issue is causing my squid to stop working. How to I delete my cache?

    0
  • N

    The amount of discspace squid can use can be edited in the squid web gui (Cache Mgmt). but there is normally a low and high watermark which causes squid to empty the cache.
    but if you do NOT use a log rotate, this could perhaps be the problem of running out of space.

    http://doc.pfsense.org/index.php/Squid_Package_Tuning

    0
  • A

    Thanks for that but where do I find the log so I can empty it

    0
  • N

    /var/squid/log/access.log

    0
  • A

    The file was only 9mb but I emptied it anyway…. didn't help

    php: /pkg_edit.php: Reloading Squid for configuration sync
    Feb 27 18:16:47 php: /pkg_edit.php: The command '/usr/local/sbin/squid -k reconfigure' returned exit code '1', the output was 'squid: ERROR: No running copy'
    Feb 27 18:16:48 check_reload_status: reloading filter
    Feb 27 18:16:48 check_reload_status: syncing firewall
    Feb 27 18:16:50 squid[14084]: Squid Parent: child process 43658 started
    Feb 27 18:16:50 kernel: pid 43658 (squid), uid 62 inumber 3109630 on /: filesystem full
    Feb 27 18:16:50 squid[43658]: Write failure – check your disk space and cache.log
    Feb 27 18:16:50 squid[14084]: Squid Parent: child process 43658 exited due to signal 6
    Feb 27 18:16:50 kernel: pid 43658 (squid), uid 62: exited on signal 6
    Feb 27 18:16:50 squid[14084]: Exiting due to repeated, frequent failures

    All that I can think of is that while trying to update the system, the downloads didn't complete so I may have these files taking space somewhere… just don't know where to go from here.

    0
  • T

    The cache can be deleted using "rm -rf /var/squid/cache/".
    Then create new cache folders by running "squid -z"

    (or lowering the "Hard disk cache size" and resynch, but it will take forever to complete)

    Tip: try tuning high and low watermark to be closer together.
    default difference is 5% (90% – 95%) but with a multiple gigabyte cache on the hard drive this 5% represents a lot of extra ram/diskspace.

    Also a lot of Hard disk cache also takes up more RAM, thumb rule: ~100MB RAM per gigabyte. (if I remember correctly)
    It also depends on how large the largest cached object may be.
    If you set this option to "large" the squid program may use more room than every option added together, because it may keep more than 1 object with the "large" size in cache or memory adding to the total allowed MB's or GB's.

    0
  • A

    I'm still getting the following …..  obviously I have a space problem. I did what was recommended above. I need some pointers as to which directories I can empty or how I go about fixing this. If I was in a windows box I would be fine but alas I don't know my way around Linux well enough.

    Last 50 system log entries
    Feb 28 18:40:45 kernel: pid 46309 (squid), uid 62 inumber 3109630 on /: filesystem full
    Feb 28 18:40:45 squid[46309]: Write failure – check your disk space and cache.log
    Feb 28 18:40:45 squid[30994]: Squid Parent: child process 46309 exited due to signal 6
    Feb 28 18:40:45 kernel: pid 46309 (squid), uid 62: exited on signal 6
    Feb 28 18:40:45 squid[30994]: Exiting due to repeated, frequent failures
    Feb 28 18:40:53 kernel: pid 36523 (dhcpd), uid 1002 inumber 3109140 on /: filesystem full
    Feb 28 18:41:28 dnsmasq[32316]: read /etc/hosts - 10 addresses
    Feb 28 18:41:28 dnsmasq[32316]: read /etc/hosts - 10 addresses
    Feb 28 18:41:30 Squid_Alarm[10094]: Squid has exited. Reconfiguring filter.
    Feb 28 18:41:30 Squid_Alarm[10492]: Attempting restart…
    Feb 28 18:41:30 squid[12202]: Squid Parent: child process 12787 started
    Feb 28 18:41:33 Squid_Alarm[15633]: Reconfiguring filter…
    Feb 28 18:41:34 Squid_Alarm[20699]: Squid has resumed. Reconfiguring filter.
    Feb 28 18:41:53 squid[12787]: Write failure – check your disk space and cache.log
    Feb 28 18:41:53 kernel: pid 12787 (squid), uid 62 inumber 3118099 on /: filesystem full
    Feb 28 18:41:53 kernel: pid 12787 (squid), uid 62: exited on signal 6
    Feb 28 18:42:06 php: /pkg_edit.php: Creating Squid cache dir /var/squid/cache
    Feb 28 18:42:06 php: /pkg_edit.php: Creating squid cache subdirs in /var/squid/cache
    Feb 28 18:42:09 squid[12202]: Squid Parent: child process 12787 exited due to signal 6
    Feb 28 18:42:11 php: /pkg_edit.php: The command '/usr/local/sbin/squid -k kill' returned exit code '1', the output was 'squid: ERROR: Could not send signal 9 to process 12787: (3) No such process'
    Feb 28 18:42:12 squid[12202]: Squid Parent: child process 30992 started
    Feb 28 18:42:14 squid[30992]: Failed to verify one of the swap directories, Check cache.log for details. Run 'squid -z' to create swap directories if needed, or if running Squid for the first time.
    Feb 28 18:42:14 squid[12202]: Squid Parent: child process 30992 exited due to signal 6
    Feb 28 18:42:14 kernel: pid 30992 (squid), uid 62: exited on signal 6
    Feb 28 18:42:17 squid[12202]: Squid Parent: child process 51341 started
    Feb 28 18:42:17 php: /pkg_edit.php: Reloading Squid for configuration sync
    Feb 28 18:42:17 php: /pkg_edit.php: The command '/usr/local/sbin/squid -k reconfigure' returned exit code '1', the output was 'squid: ERROR: No running copy'
    Feb 28 18:42:18 check_reload_status: reloading filter
    Feb 28 18:42:18 check_reload_status: syncing firewall
    Feb 28 18:42:18 check_reload_status: reloading filter
    Feb 28 18:42:20 php: /pkg_edit.php: Reloading Squid for configuration sync
    Feb 28 18:42:20 check_reload_status: reloading filter
    Feb 28 18:43:36 check_reload_status: syncing firewall
    Feb 28 18:43:36 check_reload_status: syncing firewall
    Feb 28 18:43:38 php[44028]: /pkg_edit.php: Reloading Squid for configuration sync
    Feb 28 18:43:38 check_reload_status: reloading filter
    Feb 28 18:43:39 check_reload_status: syncing firewall
    Feb 28 18:44:43 check_reload_status: syncing firewall
    Feb 28 18:45:55 last message repeated 3 times
    Feb 28 18:45:56 php: /pkg_edit.php: Reloading Squid for configuration sync
    Feb 28 18:45:56 check_reload_status: reloading filter
    Feb 28 18:45:57 check_reload_status: syncing firewall
    Feb 28 18:46:04 dhclient[43247]: DHCPREQUEST on bge0 to 192.168.1.1 port 67
    Feb 28 18:46:04 dhclient[43247]: DHCPACK from 192.168.1.1
    Feb 28 18:46:04 dhclient: RENEW
    Feb 28 18:46:04 dhclient: Creating resolv.conf
    Feb 28 18:46:04 check_reload_status: Rewriting resolv.conf
    Feb 28 18:46:05 dhclient[43247]: bound to 192.168.1.2 – renewal in 900 seconds.
    Feb 28 18:46:09 dnsmasq[32316]: reading /etc/resolv.conf
    Feb 28 18:46:09 dnsmasq[32316]: using nameserver 192.168.1.1#53

    Feb 28 18:40:29 dhcpd: Wrote 0 deleted host decls to leases file.
    Feb 28 18:40:29 dhcpd: Wrote 0 new dynamic host decls to leases file.
    Feb 28 18:40:29 dhcpd: Wrote 8 leases to leases file.
    Feb 28 18:40:29 dhcpd: commit_leases: unable to commit: No space left on device
    Feb 28 18:40:29 dhcpd: DHCPREQUEST for 192.168.199.150 (192.168.199.1) from 00:1d:0d:01:46:c0 via xl0: database update failed
    Feb 28 18:40:37 dhcpd: Wrote 0 deleted host decls to leases file.
    Feb 28 18:40:37 dhcpd: Wrote 0 new dynamic host decls to leases file.
    Feb 28 18:40:37 dhcpd: Wrote 8 leases to leases file.
    Feb 28 18:40:37 dhcpd: commit_leases: unable to commit: No space left on device
    Feb 28 18:40:37 dhcpd: DHCPREQUEST for 192.168.199.150 (192.168.199.1) from 00:1d:0d:01:46:c0 via xl0: database update failed
    Feb 28 18:40:53 dhcpd: Wrote 0 deleted host decls to leases file.
    Feb 28 18:40:53 dhcpd: Wrote 0 new dynamic host decls to leases file.
    Feb 28 18:40:53 dhcpd: Wrote 8 leases to leases file.
    Feb 28 18:40:53 dhcpd: commit_leases: unable to commit: No space left on device
    Feb 28 18:40:53 dhcpd: DHCPREQUEST for 192.168.199.150 (192.168.199.1) from 00:1d:0d:01:46:c0 via xl0: database update failed
    Feb 28 18:41:27 dhcpd: DHCPDISCOVER from 00:1d:0d:01:46:c0 via xl0
    Feb 28 18:41:27 dhcpd: unexpected ICMP Echo Reply from 192.168.1.1
    Feb 28 18:41:28 dhcpd: DHCPOFFER on 192.168.199.150 to 00:1d:0d:01:46:c0 via xl0

    0
  • A

    Not sure if this helps

    [2.0-BETA4][root@server.baselmania.dyndns.org]/root(12): df -H
    Filesystem    Size    Used  Avail Capacity  Mounted on
    /dev/ad0s1a    37G    637M    33G    2%    /
    devfs          1.0k    1.0k      0B  100%    /dev
    /dev/md0      3.8M    53k    3.4M    2%    /var/run
    devfs          1.0k    1.0k      0B  100%    /var/dhcpd/dev

    Overall I appear to have enough space.

    When I installed I simply followed the defaults…..... I really need someone to explain to me what's going on?  ???

    Thanks :-)

    0
  • W

    @abasel:

    Overall I appear to have enough space.

    The log suggests you don't have enough space. I run which  a basic pfSense on a 1GB hard drive of which 260MB is reserved for swap. But I don't run any applications that seriously use the disk.

    @abasel:

    I really need someone to explain to me what's going on?  ???

    My guess: some application or applications open one or more temporary files which are allocated space which is released when the application exits.

    How long from startup does it take for the appearance of a report the / file system is full? (If this is long enough it might be possible to get some clues pointing to the culprit.

    How is the system with the df output different from the system reporting the full root file system? (squid was disabled?)

    0
  • Rebel Alliance Developer Netgate

    There is more than one way to run out of space on a drive.

    Check the output of:

    df -i

    It could be out of inodes if you have a large number of very small files.

    Or you could also have hardware problems.

    0
  • A

    df -i

    [2.0-BETA4][root@server.baselmania.dyndns.org]/root(2): df -i
    Filesystem  1K-blocks  Used    Avail Capacity iused  ifree %iused  Mounted on
    /dev/ad0s1a  35819164 634392 32319240    2%  27124 4612618    1%  /
    devfs              1      1        0  100%      0      0  100%  /dev
    /dev/md0        3694    52    3348    2%      27    739    4%  /var/run
    devfs              1      1        0  100%      0      0  100%  /var/dhcpd/dev

    0
  • C

    You aren't running out of disk space then unless Squid is doing it and deletes whatever it's creating when it dies. Disk failures can present themselves as disk full messages as odd as that seems even when the disk isn't full. If you can manage to log in while it's still reporting the disk is full and getting that same info it may be helpful in determining whether you're really running out of disk space, or your disk is dying.

    0
  • A

    Was you reply came in I was postinvg the following: After leaving it for a day I returned to trouble shoot and noticed that the logs where now fine… enabled squid and safesquid and its working.... I'm inclined to go with your faulty disk diagnosis....The next question then is how does one transfer this to a new disk??  But I suppose that's for a different forum.

    0
Log in to reply
 

Products

Services

Support

News

Resources

Company

Our Mission

We provide leading-edge network security at a fair price - regardless of organizational size or network sophistication. We believe that an open-source security model offers disruptive pricing along with the agility required to quickly address emerging threats.

Subscribe to our Newsletter

Product information, software announcements, and special offers. See our newsletter archive for past announcements.

© Copyright 2019 Rubicon Communications, LLC | Privacy Policy