Dpinger lots of cpu
-
Can you go wider please? So we can see the entire command line? Thanks.
-
ps -axuww | grep -i dpinger root 13462 37.1 0.1 15012 2292 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV4 -B 10.0.0.11 -p /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.pid -u /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 10.0.0.1 root 11814 36.9 0.1 19108 2376 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i TELEWIFREE_DHCP -B 172.16.3.10 -p /var/run/dpinger_TELEWIFREE_DHCP_172.16.3.10_195.130.131.11.pid -u /var/run/dpinger_TELEWIFREE_DHCP_172.16.3.10_195.130.131.11.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 5000 -t 60000 -A 1000 -D 120 -L 5 195.130.131.11 root 12470 36.8 0.1 19108 2388 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i TELENET_DHCP6 -B fe80::20d:b9ff:fe35:83d9%re1 -p /var/run/dpinger_TELENET_DHCP6_fe80::20d:b9ff:x:x%re1_fe80::217:10ff:x:x%re1.pid -u /var/run/dpinger_TELENET_DHCP6_fe80::20d:b9ff:x:x%re1_fe80::217:10ff:x:x%re1.sock -C /etc/rc.gateway_alarm -d 0 -s 500 -l 2000 -t 60000 -A 1000 -D 500 -L 20 fe80::217:10ff:x:x%re1 root 14691 36.5 0.1 15012 2320 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i HANOI_VPNV6 -B fc00:1::11 -p /var/run/dpinger_HANOI_VPNV6_fc00:1::11_fc00:1::1.pid -u /var/run/dpinger_HANOI_VPNV6_fc00:1::11_fc00:1::1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 200 -L 10 fc00:1::1 root 14345 36.3 0.1 15012 2320 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV6 -B fc00::11 -p /var/run/dpinger_ELMINA_VPNV6_fc00::11_fc00::1.pid -u /var/run/dpinger_ELMINA_VPNV6_fc00::11_fc00::1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 fc00::1 root 12951 36.2 0.1 15012 2312 - Ss 5:27PM 0:00.00 /usr/local/bin/dpinger -S -r 0 -i HENET_TUNNELV6 -B 2001:470:x:x::2 -p /var/run/dpinger_HENET_TUNNELV6_2001:470:x:x::2_2001:470:x:x::1.pid -u /var/run/dpinger_HENET_TUNNELV6_2001:470:x:x::2_2001:470:x:x::1.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 2000 -t 60000 -A 10000 -D 500 -L 20 2001:470:x:x::1 root 11006 36.1 0.1 15012 2292 - Ss 5:27PM 0:00.00 /usr/local/bin/dpinger -S -r 0 -i TELENET_STATIC -B 81.82.215.127 -p /var/run/dpinger_TELENET_STATIC_81.82.215.127_81.82.192.x.pid -u /var/run/dpinger_TELENET_STATIC_81.82.215.127_81.82.192.x.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 2000 -t 60000 -A 10000 -D 80 -L 10 81.82.192.x root 12317 36.0 0.1 19108 2388 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i EDPNET_DHCP6 -B fe80::20d:b9ff:x:x%pppoe0 -p /var/run/dpinger_EDPNET_DHCP6_fe80::20d:b9ff:x:x%pppoe0_fe80::207:7dff:fe56:5900%pppoe0.pid -u /var/run/dpinger_EDPNET_DHCP6_fe80::20d:b9ff:x:x%pppoe0_fe80::207:7dff:x:x%pppoe0.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 5000 -t 60000 -A 10000 -D 120 -L 5 fe80::207:7dff:x:x%pppoe0 root 13984 36.0 0.1 15012 2292 - Ss 5:27PM 0:00.01 /usr/local/bin/dpinger -S -r 0 -i HANOI_VPNV4 -B 10.1.0.11 -p /var/run/dpinger_HANOI_VPNV4_10.1.0.11_10.1.0.1.pid -u /var/run/dpinger_HANOI_VPNV4_10.1.0.11_10.1.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 200 -L 10 10.1.0.1 root 11436 35.7 0.1 19108 2376 - Ss 5:27PM 0:00.02 /usr/local/bin/dpinger -S -r 0 -i PROXIMUS_DHCP -B 172.16.2.10 -p /var/run/dpinger_PROXIMUS_DHCP_172.16.2.10_8.8.4.4.pid -u /var/run/dpinger_PROXIMUS_DHCP_172.16.2.10_8.8.4.4.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 5000 -t 60000 -A 1000 -D 160 -L 5 8.8.4.4 root 35483 0.0 0.1 23204 2448 - Is 1:42PM 0:00.57 /usr/local/bin/dpinger -S -r 0 -i TELENET_STATIC -B 81.82.215.127 -p /var/run/dpinger_TELENET_STATIC_81.82.215.127_81.82.192.x.pid -u /var/run/dpinger_TELENET_STATIC_81.82.215.127_81.82.192.x.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 2000 -t 60000 -A 10000 -D 80 -L 10 81.82.192.x root 36628 0.0 0.1 19108 2376 - Is 1:42PM 0:02.41 /usr/local/bin/dpinger -S -r 0 -i PROXIMUS_DHCP -B 172.16.2.10 -p /var/run/dpinger_PROXIMUS_DHCP_172.16.2.10_8.8.4.4.pid -u /var/run/dpinger_PROXIMUS_DHCP_172.16.2.10_8.8.4.4.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 5000 -t 60000 -A 1000 -D 160 -L 5 8.8.4.4 root 38790 0.0 0.1 19108 2376 - Is 1:42PM 0:00.80 /usr/local/bin/dpinger -S -r 0 -i EDPNET_PPPOE -B 213.219.170.102 -p /var/run/dpinger_EDPNET_PPPOE_213.219.170.x_213.219.132.x.pid -u /var/run/dpinger_EDPNET_PPPOE_213.219.170.x_213.219.132.x.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 5000 -t 60000 -A 10000 -D 120 -L 5 213.219.132.x root 41166 0.0 0.1 19108 2388 - Is 1:42PM 0:00.76 /usr/local/bin/dpinger -S -r 0 -i EDPNET_DHCP6 -B fe80::20d:b9ff:x:x%pppoe0 -p /var/run/dpinger_EDPNET_DHCP6_fe80::20d:b9ff:x:x%pppoe0_fe80::207:7dff:x:x%pppoe0.pid -u /var/run/dpinger_EDPNET_DHCP6_fe80::20d:b9ff:x:x%pppoe0_fe80::207:7dff:x:x%pppoe0.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 5000 -t 60000 -A 10000 -D 120 -L 5 fe80::207:7dff:x:x%pppoe0 root 43268 0.0 0.1 23204 2468 - Is 1:42PM 0:00.72 /usr/local/bin/dpinger -S -r 0 -i HENET_TUNNELV6 -B 2001:470:x:x::2 -p /var/run/dpinger_HENET_TUNNELV6_2001:470:x:x::2_2001:470:x:x::1.pid -u /var/run/dpinger_HENET_TUNNELV6_2001:470:x:x::2_2001:470:x:x::1.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 2000 -t 60000 -A 10000 -D 500 -L 20 2001:470:x:x::1 root 44184 0.0 0.1 19108 2376 - Is 1:42PM 0:03.07 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV4 -B 10.0.0.11 -p /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.pid -u /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 10.0.0.1 root 44828 0.0 0.1 19108 2376 - Is 1:42PM 0:02.82 /usr/local/bin/dpinger -S -r 0 -i HANOI_VPNV4 -B 10.1.0.11 -p /var/run/dpinger_HANOI_VPNV4_10.1.0.11_10.1.0.1.pid -u /var/run/dpinger_HANOI_VPNV4_10.1.0.11_10.1.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 200 -L 10 10.1.0.1 root 45911 0.0 0.1 19108 2404 - Is 1:42PM 0:03.27 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV6 -B fc00::11 -p /var/run/dpinger_ELMINA_VPNV6_fc00::11_fc00::1.pid -u /var/run/dpinger_ELMINA_VPNV6_fc00::11_fc00::1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 fc00::1 root 46779 0.0 0.1 19108 2404 - Is 1:42PM 0:03.28 /usr/local/bin/dpinger -S -r 0 -i HANOI_VPNV6 -B fc00:1::11 -p /var/run/dpinger_HANOI_VPNV6_fc00:1::11_fc00:1::1.pid -u /var/run/dpinger_HANOI_VPNV6_fc00:1::11_fc00:1::1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 200 -L 10 fc00:1::1 root 50156 0.0 0.1 15012 2292 - Is 1:42PM 0:00.54 /usr/local/bin/dpinger -S -r 0 -i TELENET_STATIC -B 81.82.215.127 -p /var/run/dpinger_TELENET_STATIC_81.82.215.x_81.82.192.x.pid -u /var/run/dpinger_TELENET_STATIC_81.82.215.x_81.82.192.x.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 2000 -t 60000 -A 10000 -D 80 -L 10 81.82.192.x root 51034 0.0 0.1 19108 2376 - Is 1:42PM 0:02.43 /usr/local/bin/dpinger -S -r 0 -i TELEWIFREE_DHCP -B 172.16.3.10 -p /var/run/dpinger_TELEWIFREE_DHCP_172.16.3.10_195.130.131.11.pid -u /var/run/dpinger_TELEWIFREE_DHCP_172.16.3.10_195.130.131.11.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 5000 -t 60000 -A 1000 -D 120 -L 5 195.130.131.11 root 52201 0.0 0.1 19108 2388 - Is 1:42PM 0:00.83 /usr/local/bin/dpinger -S -r 0 -i EDPNET_DHCP6 -B fe80::20d:b9ff:x:x%pppoe0 -p /var/run/dpinger_EDPNET_DHCP6_fe80::20d:b9ff:x:x%pppoe0_fe80::207:7dff:x:x%pppoe0.pid -u /var/run/dpinger_EDPNET_DHCP6_fe80::20d:b9ff:x:x%pppoe0_fe80::207:7dff:x:x%pppoe0.sock -C /etc/rc.gateway_alarm -d 0 -s 5000 -l 5000 -t 60000 -A 10000 -D 120 -L 5 fe80::207:7dff:x:x%pppoe0 root 52949 0.0 0.1 19108 2376 - Is 1:42PM 0:02.91 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV4 -B 10.0.0.11 -p /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.pid -u /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 10.0.0.1 root 53979 0.0 0.1 19108 2404 - Is 1:42PM 0:03.42 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV6 -B fc00::11 -p /var/run/dpinger_ELMINA_VPNV6_fc00::11_fc00::1.pid -u /var/run/dpinger_ELMINA_VPNV6_fc00::11_fc00::1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 fc00::1 root 54660 0.0 0.1 19108 2404 - Is 1:42PM 0:03.39 /usr/local/bin/dpinger -S -r 0 -i HANOI_VPNV6 -B fc00:1::11 -p /var/run/dpinger_HANOI_VPNV6_fc00:1::11_fc00:1::1.pid -u /var/run/dpinger_HANOI_VPNV6_fc00:1::11_fc00:1::1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 200 -L 10 fc00:1::1 root 84054 0.0 0.1 19108 2376 - Is 2:03PM 0:02.93 /usr/local/bin/dpinger -S -r 0 -i ELMINA_VPNV4 -B 10.0.0.11 -p /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.pid -u /var/run/dpinger_ELMINA_VPNV4_10.0.0.11_10.0.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 150 -L 10 10.0.0.1 root 87558 0.0 0.1 19108 2376 - Is 2:03PM 0:02.62 /usr/local/bin/dpinger -S -r 0 -i HANOI_VPNV4 -B 10.1.0.11 -p /var/run/dpinger_HANOI_VPNV4_10.1.0.11_10.1.0.1.pid -u /var/run/dpinger_HANOI_VPNV4_10.1.0.11_10.1.0.1.sock -C /etc/rc.gateway_alarm -d 0 -s 1000 -l 2000 -t 60000 -A 2000 -D 200 -L 10 10.1.0.1 root 34866 0.0 0.1 18740 2248 u0 S+ 5:28PM 0:00.00 grep -i dpinger -
The individual command lines for dpinger look fine, but there clearly is a problem in that you have duplicate copies of dpinger running for most of the gateways.
I recall there was a problem with early beta snapshots that resulted in duplicate dpinger instances. Are you running a very old snapshot?
-
I reinstalled today to do these tests with an image i've downloaded yetserday and since this morning i've updated twice.
-
I've reached out to the gent that handles the dpinger start/stop code and asked him to have a look.
-
Let me know if you there's anything I can do to help, .. or if I can provide some output.
-
Could you send me a backup of your config? PM here or email cmb at pfsense dot org. The copy from status.php (which removes password hashes, certificates, etc.) would suffice.
-
done
-
amd64 10.3-RELEASE FreeBSD 10.3-RELEASE #7 51f8df0(RELENG_2_3): Mon Apr 4 08:10:48 CDT 2016 root@ce23-amd64-builder:/builder/pfsense/tmp/obj/builder/pfsense/tmp/FreeBSD-src/sys/pfSense Crash report details: PHP Errors: [04-Apr-2016 20:55:58 Europe/Brussels] PHP Stack trace: [04-Apr-2016 20:55:58 Europe/Brussels] PHP 1\. {main}() /etc/rc.filter_configure_sync:0 [04-Apr-2016 20:55:58 Europe/Brussels] PHP 2\. filter_configure_sync() /etc/rc.filter_configure_sync:37 [04-Apr-2016 20:55:58 Europe/Brussels] PHP 3\. filter_generate_gateways() /etc/inc/filter.inc:288 [04-Apr-2016 20:55:58 Europe/Brussels] PHP 4\. return_gateway_groups_array() /etc/inc/filter.inc:881 [04-Apr-2016 20:55:58 Europe/Brussels] PHP 5\. return_gateways_status() /etc/inc/gwlb.inc:891 [04-Apr-2016 20:55:58 Europe/Brussels] PHP 6\. get_dpinger_status() /etc/inc/gwlb.inc:421 [04-Apr-2016 20:55:58 Europe/Brussels] PHP 7\. stream_socket_client() /etc/inc/gwlb.inc:346 -
Strange I changed my dns servers in general settings, had to do it twice because for some reason like gateways it won't take it after the first time, .. but now dpinger has settled, .. with max of 10% which seems very acceptable to me ? Not sure how this relates, .. the widget of openvpn is doing something strange not updating, .. says all the vpns are down while there not.
I'll reboot tomorrow and see if it stays that way.
edit:
i also removed few firewall rules, .. if it stays this way then i'll email you the updated configuration, .. so you can compare.
-
only unbound and route tend to go high, .. unbound sometimes 69% and route 20% ? seems high but anyways.
-
99.6% idle and 100% load. Yeah, "load" is a loaded term in Unix. It includes IO wait among other things as part of the calculations.
-
Not sure what it is you mean.
The 99% idle load you're referring to is probably because it's going up and down and hasn't been updated. There's an update delay on the processes. Just my 2c.
-
Depending on your flavor of Unix, load includes some percentage IO wait time. Even if a process is not using any CPU, a process can dramatically contribute to the "load" of the system if it's blocking on an IO event. I'm not sure what all blocking IO events contribute to load. Would be strange to include network IO.
But like you mentioned, it's probably something simpler, like update timing.
-
I'm not sure why dns matters when it comes to dpinger, but its got something to do with it.
Do not use the DNS Forwarder as a DNS server for the firewallWhen I check the checkbox, the cpu remains at 0-15%, however when I uncheck the checkbox it shoots to 150% and stays there.
-
here's something weird, .. so i started to look into this dns thing, and what i found out was it was because the dns server didnd't work that dpinger settled down, .. i recently changed the first dns server to 172.16.1.10 which apparently didn't respond to everything except the firewall, probably some gateway issue, however but since it didn't respond, cpu usage went down!?
