Random reboots

wgstarks

No luck with the console messages. Had a reboot this morning. Nothing shown on the console other than the bootup.

Guess I'll give the clean install a try next?

wgstarks

Is it possible that a latency alarm could trigger this behavior?

Looking through all my logs I see a latency alarm occurred about the same time as the reboot.

Sep 14 02:59:58	dpinger		send_interval 500ms loss_interval 2000ms time_period 60000ms report_interval 0ms data_len 0 alert_interval 1000ms latency_alarm 500ms loss_alarm 30% dest_addr 8.8.8.8 bind_addr 24.211.135.107 identifier "WAN_DHCP "

Sep 14 02:59:51	syslogd		kernel boot file is /boot/kernel/kernel

Time stamp shows the reboot happened first though, so maybe the latency is being caused by the boot process???

Edit: Nevermind. Looks like I read the log entry wrong. Now that I’ve had a little sleep I see that it’s just showing the current settings.

stephenw10

Yes that is logged when apinger is started with whatever settings are configured.

Nothing in the logs, no error reports and nothing on the console looks like either a hardware issue or a power problem.

I assume nothing else is rebooting at that time though.

Steve

wgstarks

No. Nothing else rebooting. I doubt it’s an external power problem. The unit is powered via a rack mounted APC ups, so power should be relatively clean.

stephenw10

Over heating then maybe, the PSU brick or the CPU.

Steve

wgstarks

I believe this is the cpu temp. It seems to always run a little warm to me (between 64 and 70C). Not sure what a normal temp would be on the 3100.

No idea about power supply temps.

wgstarks

@stephenw10 said in Random reboots:

If you have not re-installed it clean I would certainly try that first:
https://www.netgate.com/docs/pfsense/solutions/sg-3100/reinstall-pfsense.html

Finally got a chance to do the re-install. Install failed at first. The USB port is extremely hard to insert a flash drive into and I didn't have it fully inserted. After a good hard push and another reboot I think it went ok. We'll see what happens.

stephenw10

That temperature looks normal for the 3100. Nothing I haven't seen here.

Steve

wgstarks

@stephenw10 said in Random reboots:

That temperature looks normal for the 3100. Nothing I haven't seen here.

Steve

Thanks. I might change my set points for temp alerts so that it’s not in the yellow as much.

dbinoj

I'm also having the same issue in a 3100. Random restarts. I'm suspecting temperature. It constantly runs at 70+. I've seen 77-78 at a point. Couldn't get to log historical data of temperature though.

wgstarks

@dbinoj said in Random reboots:

Couldn't get to log historical data of temperature though.

Yeah, I'd lover to know how to do this as well. The clean install seems to have fixed my issue though [fingers crossed].

Derelict

Is it sitting on top of something hot? The base plate of the 3100 is a passive heat sink so if it doesn't have decent airflow it would likely warm up.

dbinoj

@derelict Yeah, it was on top of a mac mini and ambient temp is ~32c. Now after moving from the mac mini's top, temperature is at 67c.

At what temperature the 3100 resets itself?

stephenw10

I have not personally ever seen it reset due to overheating even when load testing.
I know that during manufacturer testing they were run in up to 65°C ambient so I would expect quite a bit hotter than what you're seeing.

Steve

msf2000

If overheating is indeed the root cause, I'm very concerned that the sg-3100 does not have an adequate heatsink. Are owners expected to place the device on a ice block? There's barely 1/8 of an inch clearance with the rubber feet. How are owners supposed to get airflow from underneath?

wgstarks

@msf2000
I think it’s unlikely that my reboots were due to overheating since a clean install seems to have corrected the problem. Still keeping my fingers crossed, but it’s been 2 weeks with no reboots.

stephenw10

This post is deleted!

stephenw10

@msf2000

They are not and there is no problem as far as I know. As I said they were tested to far higher temperatures.

Steve

dbinoj

@stephenw10 hopefully they are not. I've never had a reboot after I moved mine from top of a Mac mini to a rack tray. So I thought it must be the temperature. If not, that reboot will be a mystery for me because there is no logs.

wgstarks

I thought this issue had resolved itself but looks like I was wrong. Just had another unexpected reboot. Nothing in the logs and nothing captured via serial console messages.

Oct 14 08:10:12	php		/usr/local/pkg/apcupsd_mail.php: Message sent to walterstarks@icloud.com OK
Oct 14 08:11:25	apcupsd	33988	Communications with UPS restored.
Oct 14 08:11:27	php		/usr/local/pkg/apcupsd_mail.php: Message sent to walterstarks@icloud.com OK
Oct 14 13:10:02	snort	33227	invalid appid in appStatRecord (4385)
Oct 14 14:25:00	snort	33227	invalid appid in appStatRecord (4385)
Oct 14 16:30:01	php-fpm	22709	/diag_backup.php: Successful login for user 'backup' from: 10.0.1.20 (Local Database)
Oct 14 18:24:06	syslogd		kernel boot file is /boot/kernel/kernel
Oct 14 18:24:06	kernel		Copyright (c) 1992-2018 The FreeBSD Project.
Oct 14 18:24:06	kernel		Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
Oct 14 18:24:06	kernel		The Regents of the University of California. All rights reserved.
Oct 14 18:24:06	kernel		FreeBSD is a registered trademark of The FreeBSD Foundation.

No idea where to go from here.