Crashes starting to occur regularly
-
I've recently started getting crashes that show when I log in:
Crash report begins. Anonymous machine information: arm64 14.0-CURRENT FreeBSD 14.0-CURRENT aarch64 1400094 #0 plus-RELENG_23_09-n256163-2763857e770: Wed Nov 1 21:17:52 UTC 2023 root@freebsd:/var/jenkins/workspace/pfSense-Plus-snapshots-23_09-main/obj/aarch64/OKyCuLux/var/jenkins/workspace/pfSense-Plus-snapshots-23_09-m Crash report details: PHP Errors: [30-Nov-2023 01:46:23 US/Eastern] PHP Fatal error: Maximum execution time of 900 seconds exceeded in /usr/local/share/pear/Net/Socket.php on line 189 [01-Dec-2023 06:21:16 US/Eastern] PHP Fatal error: Maximum execution time of 900 seconds exceeded in /usr/local/share/pear/Net/Socket.php on line 189 [02-Dec-2023 10:50:26 US/Eastern] PHP Fatal error: Maximum execution time of 900 seconds exceeded in /usr/local/share/pear/Net/Socket.php on line 189 [04-Dec-2023 06:59:11 US/Eastern] PHP Fatal error: Maximum execution time of 900 seconds exceeded in /usr/local/share/pear/Net/Socket.php on line 189 No FreeBSD crash data found.I've also been having HAProxy instability for a few weeks; not sure if these are related.
I'm on 23.09. Any ideas? Debating rolling back to 23.05.1 to see if it's more stable. I've been on 23.09 for about a month.
-
Any errors in the system log other then those PHP errors?
-
@stephenw10 Hm. Looks like my DHCP keeps crashing?
Dec 3 13:09:04 php-cgi 62610 servicewatchdog_cron.php: Service Watchdog detected service kea-dhcp4 stopped. Restarting kea-dhcp4 (Kea DHCP Server) Dec 3 13:09:03 php-cgi 62610 servicewatchdog_cron.php: Suppressing repeat e-mail notification message. Dec 3 13:09:03 php-cgi 62610 servicewatchdog_cron.php: Service Watchdog detected service dhcpd stopped. Restarting dhcpd (DHCP Service)Dec 4 13:18:22 kea-dhcp4 48790 ERROR [kea-dhcp4.dhcp4.0x2900b7212000] DHCP4_INIT_FAIL failed to initialize Kea server: configuration error using file '/usr/local/etc/kea/kea-dhcp4.conf': cannot lock socket lockfile, /tmp/kea4-ctrl-socket.lock, : Resource temporarily unavailable Dec 4 13:18:22 kea-dhcp4 48790 ERROR [kea-dhcp4.dhcp4.0x2900b7212000] DHCP4_CONFIG_LOAD_FAIL configuration error using file: /usr/local/etc/kea/kea-dhcp4.conf, reason: cannot lock socket lockfile, /tmp/kea4-ctrl-socket.lock, : Resource temporarily unavailable Dec 4 13:18:22 kea-dhcp4 48790 ERROR [kea-dhcp4.dhcp4.0x2900b7212000] DHCP4_PARSER_COMMIT_FAIL parser failed to commit changes: cannot lock socket lockfile, /tmp/kea4-ctrl-socket.lock, : Resource temporarily unavailable Dec 4 13:18:22 kea-dhcp4 48790 INFO [kea-dhcp4.dhcpsrv.0x2900b7212000] DHCPSRV_CFGMGR_SOCKET_TYPE_DEFAULT "dhcp-socket-type" not specified , using default socket type raw -
Hmm, do you see the file:
/tmp/kea4-ctrl-socket.lock?It could be a stale version of that file is present preventing it start.
-
@stephenw10 I do. Is it okay to delete?
-
Yes remove that file and retest.
-
@stephenw10 Oh my god. Well, this has made me realize that I had dhcpd in my service watchdog even though the DHCP service has switched to kea. I've removed that and logs are looking much more calm. Thank you!
