500 Threads and out of memory
-
After a short time (max. 24h) the memory (1GB) and the swap space (1GB) are all eaten up.
I don't know why. The 2nd pfsense with most similar peers and config didn't have this problem.I'm running version 2.1.5 on 64bit.
ps aux | wc
281 3539 27017ps aux | sort -k 4
root 10 0.0 0.0 0 16 ?? DL Wed03AM 0:00.00 [audit]
root 6 0.0 0.0 0 16 ?? DL Wed03AM 0:00.00 [crypto returns]
root 5 0.0 0.0 0 16 ?? DL Wed03AM 0:00.00 [crypto]
root 2 0.0 0.0 0 16 ?? DL Wed03AM 0:00.00 [g_event]
root 17 0.0 0.0 0 16 ?? DL Wed03AM 0:00.00 [pagezero]
root 9 0.0 0.0 0 16 ?? DL Wed03AM 0:00.00 [xpt_thrd]
root 7 0.0 0.0 0 16 ?? DL Wed03AM 0:00.01 [sctp_iterator]
root 18 0.0 0.0 0 16 ?? DL Wed03AM 0:00.42 [idlepoll]
root 19 0.0 0.0 0 16 ?? DL Wed03AM 0:01.30 [bufdaemon]
root 21 0.0 0.0 0 16 ?? DL Wed03AM 0:01.44 [vnlru]
root 22 0.0 0.0 0 16 ?? DL Wed03AM 0:01.45 [softdepflush]
root 16 0.0 0.0 0 16 ?? DL Wed03AM 0:04.59 [vmdaemon]
root 8 0.0 0.0 0 16 ?? DL Wed03AM 0:05.62 [pfpurge]
root 65 0.0 0.0 0 16 ?? DL Wed03AM 0:05.90 [md0]
root 20 0.0 0.0 0 16 ?? DL Wed03AM 0:17.61 [syncer]
root 14 0.0 0.0 0 16 ?? DL Wed03AM 0:44.96 [yarrow]
root 15 0.0 0.0 0 16 ?? DL Wed03AM 1:14.20 [pagedaemon]
root 4 0.0 0.0 0 16 ?? DL Wed03AM 3:45.41 [g_down]
root 3 0.0 0.0 0 16 ?? DL Wed03AM 6:39.68 [g_up]
root 13 0.0 0.0 0 32 ?? DL Wed03AM 0:00.00 [ng_queue]
root 35 0.0 0.0 0 32 ?? DL Wed03AM 0:03.23 [zfskern]
root 11 77.0 0.0 0 32 ?? RL Wed03AM 1633:51.10 [idle]
root 0 27.9 0.0 0 176 ?? DLs Wed03AM 78:12.68 [kernel]
root 12 0.0 0.0 0 256 ?? WL Wed03AM 36:51.67 [intr]
root 84457 0.0 0.0 620 440 ?? RN 4:19PM 0:00.00 [awk]
root 84036 0.0 0.0 656 500 ?? RNL 4:19PM 0:00.00 /sbin/pfctl -vvsI -i ovpnc16
root 1 0.0 0.0 3200 120 ?? SLs Wed03AM 0:00.90 /sbin/init –
root 270 0.0 0.0 5248 300 ?? Is Wed03AM 0:00.18 /sbin/devd
root 99893 0.0 0.0 5784 0 ?? IW - 0:00.00 minicron: helper /etc/rc.update_alias_url_data (minicron)
root 91160 0.0 0.0 5784 0 ?? IWs - 0:00.00 /usr/local/bin/minicron 240 /var/run/ping_hosts.pid /usr/local/bin/ping_hosts.sh
root 97626 0.0 0.0 5784 0 ?? IWs - 0:00.00 /usr/local/bin/minicron 3600 /var/run/expire_accounts.pid /etc/rc.expireaccounts
root 99313 0.0 0.0 5784 0 ?? IWs - 0:00.00 /usr/local/bin/minicron 86400 /var/run/update_alias_url_data.pid /etc/rc.update_alias_url_data
root 99076 0.0 0.0 5784 276 ?? I Wed03AM 0:00.02 minicron: helper /etc/rc.expireaccounts (minicron)
root 92808 0.0 0.0 5784 276 ?? I Wed03AM 0:00.18 minicron: helper /usr/local/bin/ping_hosts.sh (minicron)
root 259 0.0 0.0 6908 0 ?? IWN - 0:00.00 check_reload_status: Monitoring daemon of check_reload_status
root 84618 0.0 0.0 147776 0 ?? IWs - 0:00.00 /usr/local/bin/php
root 87257 0.0 0.0 147776 0 ?? IWs - 0:00.00 /usr/local/bin/php
root 5891 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 23020 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 24327 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 38873 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 58454 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 58690 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 67100 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn GW_WAN
root 49073 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ALZEY_RADAZ_VPNV4
root 84571 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ALZEY_RADAZ_VPNV4
root 96542 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ALZEY_RADAZ_VPNV4
root 10144 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_DRK_AZ_VPNV4
root 65305 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_DRK_AZ_VPNV4
root 906 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_EBERBACH_VPNV4
root 72500 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_EBERBACH_VPNV4
root 60368 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ERBACH_VPNV4
root 64633 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ERBACH_VPNV4
root 67422 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ERBACH_VPNV4
root 75152 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_ERBACH_VPNV4
root 12191 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_GGZHOME_VPNV4
root 47750 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_HEIDELBERG_VPNV4
root 45799 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_KFO_BH_VPNV4
root 46450 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_KFO_BH_VPNV4
root 77326 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_KFO_BH_VPNV4
root 92992 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_KFO_BH_VPNV4
root 47404 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_OEWI_VPNV4
root 55316 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_OEWI_VPNV4
root 3076 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_RAD_FFM_UL_VPNV4
root 65067 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_RAD_FFM_UL_VPNV4
root 2142 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_RA_ACK_VPNV4
root 25840 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_RA_ACK_VPNV4
root 47235 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_RA_ACK_VPNV4
root 15653 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCHUBI_RADAZ_VPNV4
root 22586 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCHUBI_RADAZ_VPNV4
root 39157 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCHUBI_RADAZ_VPNV4
root 55486 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCHUBI_RADAZ_VPNV4
root 76797 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCHUBI_RADAZ_VPNV4
root 1283 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 26740 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 69029 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 73529 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 74397 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 77976 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 84517 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 28916 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TR_WLAN1_VPNV4
root 82163 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TR_WLAN1_VPNV4
root 41112 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SINSHEIM_VPNV4
root 86196 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_SINSHEIM_VPNV4
root 7636 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 24256 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 36112 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 49045 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 56216 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 73616 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 74326 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 74388 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 77441 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 88752 0.0 0.0 160064 0 ?? IWN - 0:00.00 /usr/local/bin/php -f /etc/rc.openvpn OV_UROLOGIE_HH_VPNV4
root 1983 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 2996 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 3284 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 6692 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 10526 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 14587 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 16595 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 17965 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 18950 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 22432 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 25275 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 26071 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 40276 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 41391 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 42711 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 43329 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 44717 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 45684 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 46051 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 52118 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 52845 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 57404 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 58692 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 60544 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 60867 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 61109 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 61527 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 62556 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 63109 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 65168 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 66015 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 66897 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 67772 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 68445 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 69002 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 70610 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 71300 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 71843 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 74552 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 76501 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 78980 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 84528 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 87037 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 87446 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 87789 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 87842 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 88171 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 92753 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 94178 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 98191 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 99854 0.0 0.1 2716 876 ?? IN 4:18PM 0:00.00 sleep 60
root 74738 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 0.2
root 77221 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 0.2
root 79893 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 0.2
root 84143 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 0.2
root 14814 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 60
root 30255 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 60
root 77829 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 60
root 87730 0.0 0.1 2716 876 ?? SN 4:19PM 0:00.00 sleep 60
root 61086 0.0 0.1 2720 848 ?? SN 4:19PM 0:00.00 wc -l
root 64361 0.0 0.1 2720 848 ?? SN 4:19PM 0:00.00 wc -l
root 73778 0.0 0.1 2720 848 ?? SN 4:19PM 0:00.00 wc -l
root 80326 0.0 0.1 2720 848 ?? SN 4:19PM 0:00.00 wc -l
root 73336 0.0 0.1 4300 916 ?? SN 4:19PM 0:00.00 nc -U /var/etc/openvpn/server14.sock
root 80046 0.0 0.1 4300 916 ?? SN 4:19PM 0:00.00 nc -U /var/etc/openvpn/server14.sock
root 60550 0.0 0.1 4300 916 ?? SN 4:19PM 0:00.00 nc -U /var/etc/openvpn/server2.sock
root 64120 0.0 0.1 4300 916 ?? SN 4:19PM 0:00.00 nc -U /var/etc/openvpn/server2.sock
root 61958 0.0 0.1 5780 716 v0- I Wed03AM 0:01.75 logger -t pf -p local0.info
root 80904 0.0 0.1 5784 720 ?? SNs Wed03AM 4:11.46 /usr/local/sbin/apinger -c /var/etc/apinger.conf
root 34965 0.0 0.1 6868 720 v0 Is+ Wed03AM 0:00.00 /usr/libexec/getty Pc ttyv0
root 9747 0.0 0.1 6872 988 ?? Is Wed03AM 0:00.07 dhclient: em1 [priv] (dhclient)
_dhcp 17008 0.0 0.1 6872 1096 ?? Ss Wed03AM 0:00.88 dhclient: em1 (dhclient)
root 257 0.0 0.1 6908 800 ?? INs Wed03AM 27:39.88 /usr/local/sbin/check_reload_status
root 61110 0.0 0.1 6932 1388 ?? SN 4:19PM 0:00.00 awk {print $1}
root 64442 0.0 0.1 6932 1388 ?? SN 4:19PM 0:00.00 awk {print $1}
root 73962 0.0 0.1 6932 1388 ?? SN 4:19PM 0:00.00 awk {print $1}
root 80556 0.0 0.1 6932 1388 ?? SN 4:19PM 0:00.00 awk {print $1}
root 64188 0.0 0.1 6932 1404 ?? SN 4:19PM 0:00.00 awk -F, /^CLIENT_LIST/ {print $2}
root 80219 0.0 0.1 6932 1404 ?? SN 4:19PM 0:00.00 awk -F, /^CLIENT_LIST/ {print $2}
root 60743 0.0 0.1 6932 1408 ?? SN 4:19PM 0:00.00 awk -F, /^CLIENT_LIST/ {print $2}
root 73649 0.0 0.1 6932 1408 ?? SN 4:19PM 0:00.00 awk -F, /^CLIENT_LIST/ {print $2}
root 55124 0.0 0.1 6932 1424 ?? RNL 4:19PM 0:00.00 awk {print $1}
root 83398 0.0 0.1 6932 1484 ?? RNL 4:19PM 0:00.00 [awk]
root 99592 0.0 0.1 6960 1116 ?? Ss Wed03AM 0:08.90 /usr/sbin/syslogd -s -c -c -l /var/dhcpd/var/run/log -f /var/etc/syslog.conf
root 18392 0.0 0.1 7036 864 ?? Is Wed03AM 0:00.02 /usr/local/sbin/sshlockout_pf 15
root 22806 0.0 0.1 7036 1100 ?? Is Wed03AM 0:00.48 /usr/local/sbin/sshlockout_pf 15
root 84310 0.0 0.1 7928 524 ?? Ss Wed03AM 0:00.39 /usr/sbin/cron -s
root 56129 0.0 0.1 8296 716 ?? IN Wed11AM 1:38.26 /bin/sh /var/db/rrd/updaterrd.sh
root 38177 0.0 0.1 8296 720 ?? IN 5:01PM 1:23.38 /bin/sh /var/db/rrd/updaterrd.sh
root 93792 0.0 0.1 8296 720 ?? IN Wed03AM 2:10.65 /bin/sh /var/db/rrd/updaterrd.sh
root 87496 0.0 0.1 8296 720 ?? IN Wed03AM 2:11.05 /bin/sh /var/db/rrd/updaterrd.sh
root 72105 0.0 0.1 8296 720 ?? IN Wed03AM 2:11.10 /bin/sh /var/db/rrd/updaterrd.sh
root 84398 0.0 0.1 8296 720 ?? IN Wed03AM 2:11.12 /bin/sh /var/db/rrd/updaterrd.sh
root 89092 0.0 0.1 8296 720 ?? IN Wed11AM 1:37.38 /bin/sh /var/db/rrd/updaterrd.sh
root 59061 0.0 0.1 8296 728 ?? IN 1:04AM 0:53.26 /bin/sh /var/db/rrd/updaterrd.sh
root 31780 0.0 0.1 8296 728 ?? IN 4:31PM 1:26.36 /bin/sh /var/db/rrd/updaterrd.sh
root 76733 0.0 0.1 8296 728 ?? IN 4:31PM 1:27.38 /bin/sh /var/db/rrd/updaterrd.sh
root 85788 0.0 0.1 8296 728 ?? IN 5:01PM 1:23.58 /bin/sh /var/db/rrd/updaterrd.sh
root 56961 0.0 0.1 8296 728 ?? IN 9:01PM 1:06.54 /bin/sh /var/db/rrd/updaterrd.sh
root 39354 0.0 0.1 8296 728 ?? IN 9:01PM 1:07.23 /bin/sh /var/db/rrd/updaterrd.sh
root 78509 0.0 0.1 8296 728 ?? IN Wed03AM 2:10.38 /bin/sh /var/db/rrd/updaterrd.sh
root 16126 0.0 0.1 8296 728 ?? IN Wed03AM 2:10.75 /bin/sh /var/db/rrd/updaterrd.sh
root 70960 0.0 0.1 8296 728 ?? IN Wed03AM 2:11.31 /bin/sh /var/db/rrd/updaterrd.sh
root 53416 0.0 0.1 8296 728 ?? IN Wed03AM 2:17.92 /bin/sh /var/db/rrd/updaterrd.sh
root 35545 0.0 0.1 8296 728 ?? IN Wed03AM 2:18.95 /bin/sh /var/db/rrd/updaterrd.sh
root 70386 0.0 0.1 8296 728 ?? IN Wed03AM 2:20.37 /bin/sh /var/db/rrd/updaterrd.sh
root 15728 0.0 0.1 8296 728 ?? IN Wed04AM 2:14.36 /bin/sh /var/db/rrd/updaterrd.sh
root 58339 0.0 0.1 8296 728 ?? IN Wed04AM 2:14.62 /bin/sh /var/db/rrd/updaterrd.sh
root 63134 0.0 0.1 8296 728 ?? IN Wed06AM 1:59.53 /bin/sh /var/db/rrd/updaterrd.sh
root 61122 0.0 0.1 8296 728 ?? IN Wed06AM 2:00.36 /bin/sh /var/db/rrd/updaterrd.sh
root 45160 0.0 0.1 8296 728 ?? IN Wed11AM 1:43.16 /bin/sh /var/db/rrd/updaterrd.sh
root 84969 0.0 0.1 8296 728 ?? RNL 4:19PM 0:00.00 /usr/bin/nice -n20 /usr/local/bin/rrdtool update /var/db/rrd/opt3-packets.rrd N:369171:363983:392:22:0:0:0:132 (sh)
root 59907 0.0 0.1 8296 728 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 73269 0.0 0.1 8296 728 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 79286 0.0 0.1 8296 728 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 71540 0.0 0.1 8296 728 ?? SN 5:01PM 1:23.31 /bin/sh /var/db/rrd/updaterrd.sh
root 57583 0.0 0.1 8296 728 ?? SN Wed04AM 2:15.71 /bin/sh /var/db/rrd/updaterrd.sh
root 91939 0.0 0.1 8296 728 ?? SN Wed06AM 1:58.49 /bin/sh /var/db/rrd/updaterrd.sh
root 28953 0.0 0.1 8296 728 ?? SN Wed06AM 2:03.73 /bin/sh /var/db/rrd/updaterrd.sh
root 77646 0.0 0.1 8296 732 ?? IN 1:01AM 0:53.15 /bin/sh /var/db/rrd/updaterrd.sh
root 653 0.0 0.1 8296 732 ?? IN 1:02AM 0:53.05 /bin/sh /var/db/rrd/updaterrd.sh
root 85019 0.0 0.1 8296 732 ?? IN 1:05AM 0:53.06 /bin/sh /var/db/rrd/updaterrd.sh
root 81601 0.0 0.1 8296 732 ?? IN 1:05AM 0:56.89 /bin/sh /var/db/rrd/updaterrd.sh
root 486 0.0 0.1 8296 732 ?? IN 4:31PM 1:23.93 /bin/sh /var/db/rrd/updaterrd.sh
root 48902 0.0 0.1 8296 732 ?? IN 4:32PM 1:24.26 /bin/sh /var/db/rrd/updaterrd.sh
root 6767 0.0 0.1 8296 732 ?? IN 5:01PM 1:23.65 /bin/sh /var/db/rrd/updaterrd.sh
root 39278 0.0 0.1 8296 732 ?? IN 5:55AM 0:36.79 /bin/sh /var/db/rrd/updaterrd.sh
root 84346 0.0 0.1 8296 732 ?? IN Wed03AM 2:10.02 /bin/sh /var/db/rrd/updaterrd.sh
root 88798 0.0 0.1 8296 732 ?? IN Wed03AM 2:10.09 /bin/sh /var/db/rrd/updaterrd.sh
root 72424 0.0 0.1 8296 732 ?? IN Wed03AM 2:10.82 /bin/sh /var/db/rrd/updaterrd.sh
root 85687 0.0 0.1 8296 732 ?? IN Wed03AM 2:11.22 /bin/sh /var/db/rrd/updaterrd.sh
root 42244 0.0 0.1 8296 732 ?? IN Wed03AM 2:14.34 /bin/sh /var/db/rrd/updaterrd.sh
root 1801 0.0 0.1 8296 732 ?? IN Wed03AM 2:18.83 /bin/sh /var/db/rrd/updaterrd.sh
root 6975 0.0 0.1 8296 732 ?? IN Wed03AM 2:24.99 /bin/sh /var/db/rrd/updaterrd.sh
root 42938 0.0 0.1 8296 732 ?? IN Wed04AM 2:13.53 /bin/sh /var/db/rrd/updaterrd.sh
root 37664 0.0 0.1 8296 732 ?? IN Wed04AM 2:13.85 /bin/sh /var/db/rrd/updaterrd.sh
root 84428 0.0 0.1 8296 732 ?? IN Wed04AM 2:14.28 /bin/sh /var/db/rrd/updaterrd.sh
root 85910 0.0 0.1 8296 732 ?? IN Wed04AM 2:14.46 /bin/sh /var/db/rrd/updaterrd.sh
root 33797 0.0 0.1 8296 732 ?? IN Wed06AM 2:00.76 /bin/sh /var/db/rrd/updaterrd.sh
root 32604 0.0 0.1 8296 732 ?? IN Wed06AM 2:01.38 /bin/sh /var/db/rrd/updaterrd.sh
root 47516 0.0 0.1 8296 732 ?? IN Wed06AM 2:03.39 /bin/sh /var/db/rrd/updaterrd.sh
root 58493 0.0 0.1 8296 732 ?? IN Wed06AM 2:04.58 /bin/sh /var/db/rrd/updaterrd.sh
root 38326 0.0 0.1 8296 732 ?? IN Wed11AM 1:35.96 /bin/sh /var/db/rrd/updaterrd.sh
root 69537 0.0 0.1 8296 732 ?? IN Wed11AM 1:36.16 /bin/sh /var/db/rrd/updaterrd.sh
root 67074 0.0 0.1 8296 732 ?? IN Wed11AM 1:36.25 /bin/sh /var/db/rrd/updaterrd.sh
root 22579 0.0 0.1 8296 732 ?? IN Wed11AM 1:37.19 /bin/sh /var/db/rrd/updaterrd.sh
root 63773 0.0 0.1 8296 732 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 56652 0.0 0.1 8296 732 ?? SN 4:31PM 1:26.08 /bin/sh /var/db/rrd/updaterrd.sh
root 83231 0.0 0.1 8296 732 ?? SN Wed03AM 2:10.23 /bin/sh /var/db/rrd/updaterrd.sh
root 4593 0.0 0.1 8296 732 ?? SN Wed03AM 2:18.43 /bin/sh /var/db/rrd/updaterrd.sh
root 32901 0.0 0.1 8296 732 ?? SN Wed03AM 2:18.72 /bin/sh /var/db/rrd/updaterrd.sh
root 28349 0.0 0.1 8296 732 ?? SN Wed06AM 2:00.04 /bin/sh /var/db/rrd/updaterrd.sh
root 70368 0.0 0.1 8296 732 ?? SN Wed06AM 2:02.50 /bin/sh /var/db/rrd/updaterrd.sh
root 64824 0.0 0.1 8296 732 ?? SN Wed06AM 2:04.34 /bin/sh /var/db/rrd/updaterrd.sh
root 96379 0.0 0.1 8296 732 ?? SN Wed06AM 2:04.60 /bin/sh /var/db/rrd/updaterrd.sh
root 53697 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 58713 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 63505 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 73142 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 79223 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 82787 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 83849 0.0 0.1 8296 768 ?? SN 4:19PM 0:00.00 /bin/sh /var/db/rrd/updaterrd.sh
root 64182 0.0 0.1 8984 1128 ?? Is Wed03AM 0:00.24 /usr/sbin/inetd -wW -R 0 -a 127.0.0.1 /var/etc/inetd.conf
uucp 86131 0.0 0.1 12288 608 ?? SN 5:55AM 0:01.94 /usr/pbi/nut-amd64/sbin/upsmon APC@localhost
root 84778 0.0 0.1 12288 1364 ?? INs 5:55AM 0:00.00 /usr/pbi/nut-amd64/sbin/upsmon APC@localhost
root 18065 0.0 0.1 15264 1448 ?? Ss Wed03AM 0:02.29 /usr/sbin/sshd
root 85302 0.0 0.1 56980 1092 0 S+ 4:19PM 0:00.00 sort -k 4
root 84717 0.0 0.2 7992 1684 0 R+ 4:19PM 0:00.00 ps aux
root 1408 0.0 0.2 8268 2380 0 S 4:17PM 0:00.02 /bin/tcsh
root 99372 0.0 0.2 8296 1564 0 I 4:17PM 0:00.01 /bin/sh /etc/rc.initial
root 98493 0.0 0.2 8296 1596 0 Is 4:17PM 0:00.01 -sh (sh)
root 61767 0.0 0.2 11744 1668 v0- S Wed03AM 0:07.91 /usr/sbin/tcpdump -s 256 -v -S -l -n -e -ttt -i pflog0
root 82400 0.0 0.2 12300 1620 ?? SNs 5:55AM 0:03.28 /usr/pbi/nut-amd64/sbin/upsd -u root
root 35344 0.0 0.2 13496 1884 ?? SNs 1:05AM 0:37.84 /usr/local/sbin/openvpn –config /var/etc/openvpn/client8.conf
root 91725 0.0 0.2 13496 2432 ?? SNs 1:04AM 0:12.13 /usr/local/sbin/openvpn --config /var/etc/openvpn/server1.conf
root 96097 0.0 0.2 13496 2524 ?? SNs 1:04AM 0:51.58 /usr/local/sbin/openvpn --config /var/etc/openvpn/server4.conf
root 21530 0.0 0.2 13496 2548 ?? SNs 1:04AM 0:36.39 /usr/local/sbin/openvpn --config /var/etc/openvpn/server15.conf
root 96604 0.0 0.2 14392 1640 ?? SN Wed03AM 0:04.53 /usr/local/bin/rrdtool -
root 3420 0.0 0.2 14536 1796 ?? SNs 1:05AM 0:29.85 /usr/local/sbin/openvpn --config /var/etc/openvpn/server20.conf
root 73999 0.0 0.2 14536 1828 ?? SNs 1:04AM 0:26.76 /usr/local/sbin/openvpn --config /var/etc/openvpn/server17.conf
root 3282 0.0 0.2 14536 2504 ?? SNs 1:04AM 0:32.81 /usr/local/sbin/openvpn --config /var/etc/openvpn/server12.conf
root 69846 0.0 0.2 14536 2520 ?? SNs 1:04AM 0:20.08 /usr/local/sbin/openvpn --config /var/etc/openvpn/server13.conf
root 12580 0.0 0.2 14536 2524 ?? SNs 1:04AM 0:44.97 /usr/local/sbin/openvpn --config /var/etc/openvpn/server2.conf
root 10076 0.0 0.2 14536 2532 ?? SNs 1:04AM 0:28.51 /usr/local/sbin/openvpn --config /var/etc/openvpn/server14.conf
root 55773 0.0 0.2 14536 2532 ?? SNs 1:04AM 5:38.61 /usr/local/sbin/openvpn --config /var/etc/openvpn/server5.conf
root 88023 0.0 0.2 14536 2540 ?? SNs 1:04AM 2:23.71 /usr/local/sbin/openvpn --config /var/etc/openvpn/server10.conf
root 33917 0.0 0.2 14536 2548 ?? SNs 1:05AM 0:31.68 /usr/local/sbin/openvpn --config /var/etc/openvpn/server19.conf
root 80022 0.0 0.2 14704 2028 ?? SNs 5:55AM 0:07.78 /usr/local/libexec/nut/snmp-ups -a APC
nobody 8546 0.0 0.2 16040 1736 ?? I Wed03AM 0:10.48 [dnsmasq]
root 4673 0.0 0.2 20096 2104 ?? INs Wed03AM 0:06.67 /usr/local/sbin/filterdns -p /var/run/filterdns-ipsec.pid -i 60 -c /var/etc/ipsec/filterdns-ipsec.hosts -d 1
root 81373 0.0 0.3 14536 2572 ?? SNs 1:03AM 0:57.61 /usr/local/sbin/openvpn –config /var/etc/openvpn/client16.conf
root 88077 0.0 0.3 14536 2588 ?? SNs 1:04AM 1:02.07 /usr/local/sbin/openvpn --config /var/etc/openvpn/server18.conf
root 25574 0.0 0.3 14536 2588 ?? SNs 1:05AM 0:37.35 /usr/local/sbin/openvpn --config /var/etc/openvpn/client3.conf
root 83603 0.0 0.3 14536 2608 ?? SNs 1:03AM 0:39.12 /usr/local/sbin/openvpn --config /var/etc/openvpn/client11.conf
root 57580 0.0 0.3 14536 2636 ?? SNs 1:05AM 1:34.00 /usr/local/sbin/openvpn --config /var/etc/openvpn/client6.conf
root 25444 0.0 0.3 14536 2656 ?? SNs 1:05AM 0:38.73 /usr/local/sbin/openvpn --config /var/etc/openvpn/client7.conf
root 16934 0.0 0.3 14536 3252 ?? Ss 5:55AM 0:29.30 /usr/local/sbin/openvpn --config /var/etc/openvpn/client9.conf
root 97196 0.0 0.3 16776 3028 ?? SNs Wed03AM 0:40.51 /usr/local/sbin/racoon -f /var/etc/ipsec/racoon.conf
root 41107 0.0 0.3 26164 3552 ?? Ss 4:17PM 0:00.08 sshd: root@pts/0 (sshd)
root 83463 0.0 0.4 26280 4220 ?? S Wed03AM 2:36.14 /usr/local/sbin/lighttpd -f /var/etc/lighty-webConfigurator.conf
root 600 0.0 0.7 12160 7120 ?? SNs 5:55AM 0:07.67 /usr/local/sbin/ntpd -g -c /var/etc/ntpd.conf -p /var/run/ntpd.pid
root 90320 0.0 1.7 155968 17548 ?? I Wed03AM 0:02.46 /usr/local/bin/php
root 80898 0.0 3.7 160064 38288 ?? IN 4:03PM 0:00.17 /usr/local/bin/php -f /etc/rc.openvpn OV_SCRWI_TRAIL_VPNV4
root 67940 0.0 3.7 170432 37800 ?? I 12:32PM 0:16.74 /usr/local/bin/php -
I have seen this sort of thing before - in my case there was a lock file somewhere (can't remember exactly - I guess would have been in /tmp somewhere!) that was serialising access to some things. Something had gone wrong with a process (in my case on Alix with memory shortage - the process had been killed by the OS) and the lock file never got cleared. Over time other regular things and interface events… piled up for processing like in your "ps" output.
I guess you are rebooting to clear it. If you have logs back far enough, there should be some nasty thing logged that starts the whole chain off. -
/tmp//* and //*.lock are all new after reboot.
-
There are to much updaterrd.sh.
Perhaps there should kill_traffic_collector() in front of enable_rrd_graphing() in rrd,inc.
-
I think the problem is that /etc/rc.openvpn didn't end.
I have them multiple times and didn't see why they didn't terminate.