Netgate SG-3100 LEDs

jchonig

@wgstarks I decided not to be too clear on that to make sure people knew enough of what they were doing to figure that out.

wgstarks

@jchonig I raised an issue on GitHub but I’m posting here as well. Looks like this script may be causing problems with large numbers of pipes being left open which results in a constant stream of errors

kern.ipc.maxpipekva exceeded; see tuning (7)

More details here and especially here.

jchonig

@wgstarks I think this will work to keep the script from starting if the previous run did not complete. This isn't a fix, but it will keep the system from failing

Change the cronjob to start with /usr/bin/lockf -s 1 /var/run/gw_leds.lock.

/usr/bin/lockf  -s 1 /var/run/gw_leds.lock /root/gw_leds -a WAN_OTTC_DHCP -b WAN_EA_DHCP

Or stop running the script.

The issue seems to be that the sysctl command is hanging and cron is starting the script again in 60 seconds.

wgstarks

@jchonig said in Netgate SG-3100 LEDs:

@wgstarks I think this will work to keep the script from starting if the previous run did not complete. This isn't a fix, but it will keep the system from failing

Change the cronjob to start with /usr/bin/lockf /var/run/gw_leds.lock.
/usr/bin/lockf /var/run/gw_leds.lock /root/gw_leds -a WAN_OTTC_DHCP -b WAN_EA_DHCP
Or stop running the script.

The issue seems to be that the sysctl command is hanging and cron is starting the script again in 60 seconds.

Just to be sure I understand, this will kill one run before it starts the next?

jchonig

@wgstarks No, this will prevent another from starting. And see the edit I'm going to make in a minute to add a timeout.

renegade

Great script! Thanks a lot for that!
I would have now monitored my VDSL and LTE line. Would be happy, if the last LED could pulsate as before :-)
It also would be great if their is a mechanism enabled which prevents the described „deadlock“ as i would like to decrease the interval/cronjob to maybe 15 or 30 seconds.

renegade

Update from my side: After almost 12h runninh the cron job the system became unresponsive.

jchonig

@renegade Are you using lockf in your cron script? That's supposed to prevent it from consuming resources.

I'm pretty sure the root problem is a kernel bug causing the sysctl and gpioctl commands to hang. I need to find the time to do some debugging.

renegade

@jchonig Not yet - I will give it a try I suppose :)

wgstarks

@jchonig said in Netgate SG-3100 LEDs:

@renegade Are you using lockf in your cron script? That's supposed to prevent it from consuming resources.

I'm pretty sure the root problem is a kernel bug causing the sysctl and gpioctl commands to hang. I need to find the time to do some debugging.

This worked for me for about 18 hours but now the system is completely locked up with the same error so lockf doesn’t appear to do the trick.

Edit: Here is the command I was using (just for reference)-

/usr/bin/lockf /var/run/gw_leds.lock /root/gw_leds -b WAN_DHCP -A 0,0,16 -C 0,0,16