PfSense 2.2 503 - Service Not Available
-
I just had this happen after installing Bandwidthd on a new test 2.2.2 config that I spun up today. No power outage or anything else strange going on. I selected the LAN interface and clicked Save. Then I went to Access Bandwidthd and got:
Please start bandwidthd to populate this directory.
I went back to the Bandwidthd config page and again clicked Save, and that's when I got the 503. All WebGUI attempts now give 503 until I restart PHP-FPM. I have never, ever seen this before until now with bandwidthd.
With PHP-FPM restarted, everything appeared to be normal again. Then when I went to my dashboard, all the widgets were good except for the NTP widget which showed 503, and my LAN traffic gaph which shows
Cannot get data about interface vmx1
ntopng seems to have died as well.
-
That's likely a different root cause than the filesystem corruption others are seeing.
-
And the problem persists through a reboot. Now both squid and squidGuard, which were working fine, are crashing as fast as they can start. WebGUI gives the exact same display as my screencap, with 503 for the NTP widget and the LAN graph not able to talk to vmx1. Bizarre.
-
With the squid* censored, I's pretty much possible you are getting an unclean reboot – which is perfectly enough to screw the filesystem.
On that note, I wonder if anyone tested with fsck from some previous FBSD versions. The one in 10.1 is simply mad.
-
I didn't see any warnings about a dirty filesystem. The system never crashed or anything that might cause an obvious filesystem error. fsck comes up with about a dozen unreferenced inodes though.
-
I left it running overnight and came back to a dead GUI and an endless stream of:
swap_pager_getswapspace(n): failed.
I lost my VMware heartbeat around 1am and it didn't return for 45 minutes.
Hard reset allowed me to boot. The LAN graph is still borked but the NTP widget now seems to be working again.
-
Hi,
I just encontered the same problem today. I'm running pfSense in a VirtualBox on an old computer probably with HDD troubles.
PHP-FPM could not start.I had to reinstall and restore a backup of config.xml.
I hope not to experience this trouble to often.
-
Version 2.2.2 direct install (no vm).
Power cut yesterday and problems here too 503 & 500 errors, ssh wasn't working or dhcp.
-
For those who want to avoid having their filesystem corrupted, here's a quick shell one-liner to add sync to fstab and remount / with sync:
cp /etc/fstab /etc/fstab.orig; /usr/bin/sed -i '' 's/^\(\/.*[[:space:]]*\/[[:space:]]*ufs[[:space:]]*\)rw\([[:space:]]*[[:digit:]][[:space:]]*[[:digit:]]\)$/\1rw,sync\2/' /etc/fstab; mount -o sync /(Be sure to copy the entire line)
This will happen automatically during the 2.2.3 upgrade, and new installs of 2.2.3 will have sync enabled.
-
I also started a wiki doc about it, with the commands there as well. https://doc.pfsense.org/index.php/Filesystem_Corruption_%28503_errors,_cannot_get_uid%29
-
The fix for this is quite simple
Go to the command prompt…
vi /etc/group
add a line at the end using the same syntax as the line above it. Just use wheel as the group name and use a GID number that is not already used in the file.
Save it and restart the PHP service. The error will go away and you will be golden. -
Another fix will be : get the repaired pfSense version 2.2.4 …
-
Another fix will be : get the repaired pfSense version 2.2.4 …
Sounds definitely better than messing with screwed /etc/group manually.
-
I am getting a 500 internal server error with the latest version - 2.2.4 RELEASE.
Restarting PHP-FPM solved the issue, but does anyone know the root cause of the 500 error? I am seeing a lot of older threads coming up with that error and a couple posts above this one Gertjan says that this released fixed the 503 error.
Hopefully you have more information.
-
I am getting a 500 internal server error with the latest version - 2.2.4 RELEASE.
Restarting PHP-FPM solved the issue, but does anyone know the root cause of the 500 error? I am seeing a lot of older threads coming up with that error and a couple posts above this one Gertjan says that this released fixed the 503 error.
Hopefully you have more information.
2.2.4 fixes possible file system corruption - if the corruption was such that the system would boot but PHP would have a problem or… then there might have been 503 issues that now are not a problem.
But there are still times when "something happened" - I think this phrase is now a Microsoft trade mark? :) - and PHP can need a kick. e.g. some interaction with bandwidthd has been a cause that has not been turned into a reproducible and then fixable problem yet.
-
I am getting a 500 internal server error with the latest version - 2.2.4 RELEASE.
Restarting PHP-FPM solved the issue, but does anyone know the root cause of the 500 error? I am seeing a lot of older threads coming up with that error and a couple posts above this one Gertjan says that this released fixed the 503 error.
Hopefully you have more information.
2.2.4 fixes possible file system corruption - if the corruption was such that the system would boot but PHP would have a problem or… then there might have been 503 issues that now are not a problem.
But there are still times when "something happened" - I think this phrase is now a Microsoft trade mark? :) - and PHP can need a kick. e.g. some interaction with bandwidthd has been a cause that has not been turned into a reproducible and then fixable problem yet.
Thanks for the response Phil!
-
I am getting a 500 internal server error with the latest version - 2.2.4 RELEASE.
Restarting PHP-FPM solved the issue, but does anyone know the root cause of the 500 error? I am seeing a lot of older threads coming up with that error and a couple posts above this one Gertjan says that this released fixed the 503 error.
Hopefully you have more information.
Same thin here, I run pfsense on a virtual machine (qnap) .
This is a clean and new install of 2.2.4 and suddenly 503 !!
Luckaly the rest php-fpm works temporarely
Is this something that was supposed to be fixed in this release?
(I too have bandwidthd package installed, is it really this package? will it be fixed if I remove it?)
-
I have started getting 503 errors on a 64-bit pfSense 2.2.4 host that was upgraded from 2.2.3.
I'm not using bandwidthd.
The UPS on this host tripped overnight and I don't think NUT managed to shut the host down properly before the UPS powered off.
I am going to rebuild it from a fresh CD later today. -
Working fine now after rebuild from CD.
-
I spoke too soon. The WebGUI operates normally for up to a day after a reboot of the host. If I want to use the GUI after that I usually have to first SSH to the box and select option 16 to restart PHP-FPM.
