WebGui Not Accessible - "Bootup complete" every 60-90 Minutes
-
@Sparky17 said in WebGui Not Accessible - "Bootup complete" every 60-90 Minutes:
Jul 27 09:08:35 pfSense kernel: Trying to mount root from ufs:/dev/ufsid/5c11689b7c8fb123 [rw,noatime]...
Jul 27 09:08:35 pfSense syslogd: sendto: Network is unreachable
Jul 27 09:08:35 pfSense kernel: WARNING: / was not properly dismounted
Jul 27 09:08:35 pfSense syslogd: sendto: Network is unreachable
Jul 27 09:08:35 pfSense kernel: WARNING: /: mount pending error: blocks 88 files 1Yep, the file system went belly up.
As said, if you have an UPS, hook up that data cable, and set up NUT.
Right now, you're good for the fsck video (Youtube => Netgate) -
It will show that whenever the router is rebooted without being shutdown cleanly. It usually means only that the filesystem is not marked clean and will recover from that itself.
It obviously is doing so since it is still booting. That may not always be the case however.If the file system becomes sufficiently damaged it may not be able to recover itself and will require interaction at the console. If that happens you will lose connection to it if you're remote only.
Steve
-
Thanks for the feedback.
Should I force an automatic check? I am worried that i might loose remote access.
Forcing an Automatic Check
If the system is booting successfully but a filesystem issue is suspected, connect to the console or SSH and use the reboot menu option (5), followed by F to reboot and force a filesystem check.https://docs.netgate.com/pfsense/en/latest/hardware/troubleshooting-disk-check-errors-fsck.html
-
@Sparky17 said in WebGui Not Accessible - "Bootup complete" every 60-90 Minutes:
Forcing an Automatic Check
should typically be done on site, because the system would run in one-user mode, which means ; just the console access. No WebGUI, no SSH.
You could probably launch it from 'else where' but I wouldn't take that risk.look at the video, have some one logging in for you @site, and ask him to "video" the screen, and tell that person what to type in and when ;)
-
It's unlikely that will help prevent it rebooting given that is is still booting.
If you were local to it I would suggest you re-install it clean to be sure.
What can prevent damage to the file system is enabling RAM disks:
https://docs.netgate.com/pfsense/en/latest/book/config/advanced-misc.html#ram-disk-settingsHowever you would need to increase the size over the default (at least double) with that list of packages you have running. It will reboot if you enable them and if for any reason it fails to boot again.....
If it's still rebooting as often as your logs show I think it is inevitable it will fail to boot at some point if you do nothing unfortunately. I would prepare to lose access there if you have no alternative way to reach it. Enabling RAM disks, assuming it reboots that first time, will reduce the chances of losing that connection.
Steve
-
Hi Steve,
Thanks. Just to be clear you do not recommend forcing an automatic check (SSH, option 5, F).
However, you do recommend enabling ram disks? I can disable some packages to help.
This will just be "limp mode" to try to keep it up and running for the next two weeks. Once I get home I will re-install from scratch.
-
I don't believe forcing a filesystem check will help since it is still fully booting and not reporting errors, missing files etc.
Enabling RAM disks will substantially help prevent irrecoverable damage to the filesystem due to reboots.
It's hard to know what to set the disk sizes to given the package you have running. What does your ram usage look like currently?
I always use at least double the default, so 80 and 120MB. That is sufficient for mist things, including pfBlocker with only easylist loaded.I would disable darkstat for now.
What lists do you have pfBlocker loading?
What services is the watchdog checking?
Steve
-
Thanks Steve.
I am now able to access the WebGUI and can confirm my packages.
ACME
Avahi
ipsec-profile-wizard
nut (Setting up now!)
openvpn-client-export
pfBlockerNG
pimd (Currently disabled, but still installed)Right now it says 40% of 990MiB are in use for memory.
-
Ah, OK then you can afford to use those double default numbers for ram disks if you decide to enable them.
It's hard to recommend that with absolute certainty when you don't have direct access but if it's still rebooting after running the forced fsck I think I would do that.
If you can do anything to be prepared to lose connectivity you should do that either way.Steve
-
@Sparky17 said in WebGui Not Accessible - "Bootup complete" every 60-90 Minutes:
I do have the ability to restart the power remotely to force a reboot.
Hello!
What are you using to control the power?
I cant tell from the thread if you resolved your frequent reboot issue, but I have had power control devices (iboot, digital-loggers, etc...) "misbehave" and cause this sort of problem. I normally have these between the UPS and device, so power monitoring (NUT) doesnt help prevent a power cut and possible disk corruption.
John
-
I have a APC UPS and then a APC 7900 PDU connected between them.
I do have NUT setup and appears to be working right now. However, next time I am home I am going to manually cut the power and test just to double check.
So far so good, as it has now been over 3 hours without a reboot since I forced an automatic system check on reboot. However, I did make some other changes (disabled PIMD, etc.) that may affect the frequency of the reboot. I am fully backed up and hoping for the best, but prepared for the worst. I will reinstall from scratch and restore from backup once I am back on site.
I also plan on enabling RAM disks now as well.
