PHP just started crashing on a lot of firewalls
-
I have seen this on 5 firewalls now, all pfsense 2.4.4-p3, some on hardware and 1 virtual. We notice because SSLVPN stops working and it also breaks logging into the web interface. The errors are all the same.
The error it generates is 40MB. I will just post a small snippet of it. Some are once and done, others are frequently. It also affects the terminal as it doesn't show the interfaces or the IP addresses. Restarting PHP from ssh or terminal fixes the issue. However some have been reoccurring.
Hardware differs. I know for a fact 2 are Jetway HBJC323U591-3150B, 1 is a Supermicro SuperServer E200-9B and 1 is a VM. 1 may be a protectli FW4A – 4 but that is unconfirmed. Since Netgate released the SG-3100, we have been using that exclusively and no longer need to use non-netgate hardware. One thing in common is that all of these firewall heave > 100 days of uptime, some in the 200-300 range. I'm afraid to reboot them for fear they wont come back up. It almost looks like a hard drive failure. The Jetway and Supermicros are quite dated at this point. Again, once the SG-3100 was a thing we haven't needed to look anywhere else. Although, I am a bit pissed it doesn't have a wall-mount.
[17-Dec-2019 06:30:29 UTC] PHP Warning: Failed loading Zend extension 'opcache.so' (tried: /usr/local/lib/php/20131226/opcache.so (Cannot open "/usr/local/lib/php/20131226/opcache.so"), /usr/local/lib/php/20131226/opcache.so.so (Cannot open "/usr/local/lib/php/20131226/opcache.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'session.so' (tried: /usr/local/lib/php/20131226/session.so (Cannot open "/usr/local/lib/php/20131226/session.so"), /usr/local/lib/php/20131226/session.so.so (Cannot open "/usr/local/lib/php/20131226/session.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'bcmath.so' (tried: /usr/local/lib/php/20131226/bcmath.so (Cannot open "/usr/local/lib/php/20131226/bcmath.so"), /usr/local/lib/php/20131226/bcmath.so.so (Cannot open "/usr/local/lib/php/20131226/bcmath.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'bz2.so' (tried: /usr/local/lib/php/20131226/bz2.so (Cannot open "/usr/local/lib/php/20131226/bz2.so"), /usr/local/lib/php/20131226/bz2.so.so (Cannot open "/usr/local/lib/php/20131226/bz2.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'ctype.so' (tried: /usr/local/lib/php/20131226/ctype.so (Cannot open "/usr/local/lib/php/20131226/ctype.so"), /usr/local/lib/php/20131226/ctype.so.so (Cannot open "/usr/local/lib/php/20131226/ctype.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'curl.so' (tried: /usr/local/lib/php/20131226/curl.so (Cannot open "/usr/local/lib/php/20131226/curl.so"), /usr/local/lib/php/20131226/curl.so.so (Cannot open "/usr/local/lib/php/20131226/curl.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'dom.so' (tried: /usr/local/lib/php/20131226/dom.so (Cannot open "/usr/local/lib/php/20131226/dom.so"), /usr/local/lib/php/20131226/dom.so.so (Cannot open "/usr/local/lib/php/20131226/dom.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'filter.so' (tried: /usr/local/lib/php/20131226/filter.so (Cannot open "/usr/local/lib/php/20131226/filter.so"), /usr/local/lib/php/20131226/filter.so.so (Cannot open "/usr/local/lib/php/20131226/filter.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'gettext.so' (tried: /usr/local/lib/php/20131226/gettext.so (Cannot open "/usr/local/lib/php/20131226/gettext.so"), /usr/local/lib/php/20131226/gettext.so.so (Cannot open "/usr/local/lib/php/20131226/gettext.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'hash.so' (tried: /usr/local/lib/php/20131226/hash.so (Cannot open "/usr/local/lib/php/20131226/hash.so"), /usr/local/lib/php/20131226/hash.so.so (Cannot open "/usr/local/lib/php/20131226/hash.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'json.so' (tried: /usr/local/lib/php/20131226/json.so (Cannot open "/usr/local/lib/php/20131226/json.so"), /usr/local/lib/php/20131226/json.so.so (Cannot open "/usr/local/lib/php/20131226/json.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'ldap.so' (tried: /usr/local/lib/php/20131226/ldap.so (Cannot open "/usr/local/lib/php/20131226/ldap.so"), /usr/local/lib/php/20131226/ldap.so.so (Cannot open "/usr/local/lib/php/20131226/ldap.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'mbstring.so' (tried: /usr/local/lib/php/20131226/mbstring.so (Cannot open "/usr/local/lib/php/20131226/mbstring.so"), /usr/local/lib/php/20131226/mbstring.so.so (Cannot open "/usr/local/lib/php/20131226/mbstring.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'mcrypt.so' (tried: /usr/local/lib/php/20131226/mcrypt.so (Cannot open "/usr/local/lib/php/20131226/mcrypt.so"), /usr/local/lib/php/20131226/mcrypt.so.so (Cannot open "/usr/local/lib/php/20131226/mcrypt.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'openssl.so' (tried: /usr/local/lib/php/20131226/openssl.so (Cannot open "/usr/local/lib/php/20131226/openssl.so"), /usr/local/lib/php/20131226/openssl.so.so (Cannot open "/usr/local/lib/php/20131226/openssl.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'pcntl.so' (tried: /usr/local/lib/php/20131226/pcntl.so (Cannot open "/usr/local/lib/php/20131226/pcntl.so"), /usr/local/lib/php/20131226/pcntl.so.so (Cannot open "/usr/local/lib/php/20131226/pcntl.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'pdo.so' (tried: /usr/local/lib/php/20131226/pdo.so (Cannot open "/usr/local/lib/php/20131226/pdo.so"), /usr/local/lib/php/20131226/pdo.so.so (Cannot open "/usr/local/lib/php/20131226/pdo.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'pfSense.so' (tried: /usr/local/lib/php/20131226/pfSense.so (Cannot open "/usr/local/lib/php/20131226/pfSense.so"), /usr/local/lib/php/20131226/pfSense.so.so (Cannot open "/usr/local/lib/php/20131226/pfSense.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'posix.so' (tried: /usr/local/lib/php/20131226/posix.so (Cannot open "/usr/local/lib/php/20131226/posix.so"), /usr/local/lib/php/20131226/posix.so.so (Cannot open "/usr/local/lib/php/20131226/posix.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'radius.so' (tried: /usr/local/lib/php/20131226/radius.so (Cannot open "/usr/local/lib/php/20131226/radius.so"), /usr/local/lib/php/20131226/radius.so.so (Cannot open "/usr/local/lib/php/20131226/radius.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'readline.so' (tried: /usr/local/lib/php/20131226/readline.so (Cannot open "/usr/local/lib/php/20131226/readline.so"), /usr/local/lib/php/20131226/readline.so.so (Cannot open "/usr/local/lib/php/20131226/readline.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'rrd.so' (tried: /usr/local/lib/php/20131226/rrd.so (Cannot open "/usr/local/lib/php/20131226/rrd.so"), /usr/local/lib/php/20131226/rrd.so.so (Cannot open "/usr/local/lib/php/20131226/rrd.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'shmop.so' (tried: /usr/local/lib/php/20131226/shmop.so (Cannot open "/usr/local/lib/php/20131226/shmop.so"), /usr/local/lib/php/20131226/shmop.so.so (Cannot open "/usr/local/lib/php/20131226/shmop.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'simplexml.so' (tried: /usr/local/lib/php/20131226/simplexml.so (Cannot open "/usr/local/lib/php/20131226/simplexml.so"), /usr/local/lib/php/20131226/simplexml.so.so (Cannot open "/usr/local/lib/php/20131226/simplexml.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'sockets.so' (tried: /usr/local/lib/php/20131226/sockets.so (Cannot open "/usr/local/lib/php/20131226/sockets.so"), /usr/local/lib/php/20131226/sockets.so.so (Cannot open "/usr/local/lib/php/20131226/sockets.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] PHP Warning: PHP Startup: Unable to load dynamic library 'sqlite3.so' (tried: /usr/local/lib/php/20131226/sqlite3.so (Cannot open "/usr/local/lib/php/20131226/sqlite3.so"), /usr/local/lib/php/20131226/sqlite3.so.so (Cannot open "/usr/local/lib/php/20131226/sqlite3.so.so")) in Unknown on line 0 [17-Dec-2019 06:30:29 UTC] -
@PhlMike 2.4.4-p3 doesn't use that version of PHP, it almost looks like your upgrade was incomplete, or you partially rolled back. 2.4.4-p3 should be:
/usr/local/lib/php/20170718This appears to be your issue:
https://forum.netgate.com/topic/135868/php-errors-after-upgrade-to-2-4-4 -
Should I try
pkg-static upgradethen? -
That and I would probably follow it up with this just to be sure:
pkg update -f
pkg upgrade -f -
I had a document I wrote a while back when upgrades fail (Yes, it is dated).
---SSH into the device as root, then run: pkg-static update -f pkg-static upgrade -fy pkg clean -ya pfSense-upgrade -4 ---If "pfSense_upgrade -4" fails then run: pkg upgrade -y pkg update -f pkg-static install -f pfSense-base ---And then you can re-run: pfSense_upgrade -4 -
Are you running pfmonitor, by chance?
https://forum.netgate.com/topic/149004/error-fatal-error-uncaught-error-call-to-undefined-function-gettext-in-usr-local-www-index-php-34-stack-trace-0-main-thrown-in-usr-local-www-index-php-on-line-34/27
-
Good question, I do have pfmonitor but only 100 licenses out of 700ish pfsense firewalls. I would have to see if those are on pfmonitor.
EDIT:
Before I run off to pick up my kids, I did check and one of them is on pfmonitor and that one is a protectli. I ran an upgrade earlier on that one and it hadn't crashed since, but I ran what it said on the post you provided anyway.
