pfSense Plus and SG-3100

sehiser · Feb 20, 2021, 2:14 PM

Is there an email alert we could get to know when this is fixed? (I'll poke around and see if I can find a way to sign up for an alert in the meantime).

We have 2 SG-3100's and 1 was upgraded.

va3mw · Feb 20, 2021, 3:19 PM

I have the same problem and I am not able to down grade as the package manager seems to be broken on the SG3100.

I need to get this stabilized for my customer. As a workaround, I am stating to build up a 'home edition' one just to get him stable.

Would I be correct in assuming that if I could roll back, I would not be having these random/every few hour/ halts?

Like others, I have been monitoring the Serial port, but very little information is available to move forward to resolving this.

pkg update -f

Updating pfSense-core repository catalogue...
pkg: https://files01.netgate.com/pkg/pfSense_plus-v21_02_armv7-core/meta.txz: Not Found
repository pfSense-core has no meta file, using default settings
pkg: https://files01.netgate.com/pkg/pfSense_plus-v21_02_armv7-core/packagesite.txz: Not Found
Unable to update repository pfSense-core
Updating pfSense repository catalogue...
pkg: https://files00.netgate.com/pkg/pfSense_plus-v21_02_armv7-pfSense_plus-v21_02/meta.txz: Not Found
repository pfSense has no meta file, using default settings
pkg: https://files00.netgate.com/pkg/pfSense_plus-v21_02_armv7-pfSense_plus-v21_02/packagesite.txz: Not Found
Unable to update repository pfSense
Error updating repositories!

So, this likely should be a new thread. But, I checked

cat /usr/local/share/pfSense/pkg/repos/pfSense-repo.conf
FreeBSD: { enabled: no }

pfSense-core: {
url: "pkg+https://firmware.netgate.com/pkg/pfSense_plus-v21_02_armv7-core",
mirror_type: "srv",
signature_type: "fingerprints",
fingerprints: "/usr/local/share/pfSense/keys/pkg",
enabled: yes
}

pfSense: {
url: "pkg+https://firmware.netgate.com/pkg/pfSense_plus-v21_02_armv7-pfSense_plus-v21_02",
mirror_type: "srv",
signature_type: "fingerprints",
fingerprints: "/usr/local/share/pfSense/keys/pkg",
enabled: yes
}

And

https://firmware.netgate.com/pkg/pfSense_plus-v21_02_armv7-pfSense_plus-v21_02

Does not exist at firmware.netgate.com

thanks in advance,

artooro · Feb 20, 2021, 3:52 PM

@va3mw you'll need to backup your config and re-install pfSense 2.4.5. See https://docs.netgate.com/pfsense/en/latest/solutions/sg-3100/reinstall-pfsense.html

Amarand · Feb 20, 2021, 6:29 PM

Ahh, I've been experiencing the "wonkiness" today, so I'm glad it's not just me.

If someone has already upgraded, and doesn't really want to downgrade, is there any other workaround, or is it basically just restarting the firewall to get it operational again?

stephenw10 · Feb 20, 2021, 6:55 PM

You can disable one CPU core and it will avoid ever hitting the lock. Obviously performance will be reduced but that may not be an issue for a lot of use cases. Run:

echo hw.ncpu=1 >> /boot/loader.conf.local

Then reboot.

Remove or comment out that line later after this is fixed.

Steve

Amarand · Feb 20, 2021, 6:59 PM

@stephenw10 said in pfSense Plus and SG-3100:

echo hw.ncpu=1 >> /boot/loader.conf.local

Done and done. Thank you Steve!

Will updates on the update be placed in this thread (that I'm watching)?

stephenw10 · Feb 20, 2021, 7:07 PM

Yes, this thread will be updated.

Mr_AJ · Feb 20, 2021, 7:08 PM

@amarand said in pfSense Plus and SG-3100:

@stephenw10 said in pfSense Plus and SG-3100:

echo hw.ncpu=1 >> /boot/loader.conf.local

Done and done. Thank you Steve!

Will updates on the update be placed in this thread (that I'm watching)?

Did this work for you? Im stuck rebooting randomly during the day also.

Amarand · Feb 20, 2021, 7:11 PM

@mr_aj

Just added this entry to the file a few minutes ago, so we'll see!

I only had a single failure requiring a reboot during the day today...so I was hoping to avoid experiencing that again.

Glad there's a quick and easy workaround.

OldManNiko · Feb 20, 2021, 8:49 PM

@mr_aj So far so good for me, 3 hrs in on a single cpu.

Mr_AJ · Feb 20, 2021, 11:22 PM

@oldmanniko said in pfSense Plus and SG-3100:

@mr_aj So far so good for me, 3 hrs in on a single cpu.

All is well with this quick fix. Thanks!

stephenw10 · Feb 21, 2021, 2:51 PM

Good to hear.

We think we have found the root cause of this and will be testing fixes imminently.
Technical details here for those who may be interested:
https://reviews.freebsd.org/D28821

Steve

va3mw · Feb 21, 2021, 3:20 AM

@artooro Thanks. That is what I did.

NokkieF · Feb 21, 2021, 2:52 PM

@stephenw10
Is there a possibility to 'upgrade´ from the 21.02 to the new one without having to downgrade first? I am experiencing the problem, as in not being able to retrieve any packages. Or is the only way to do a downgrade first and then upgrade later? Can I export my settings from my current 21.02 one and import them again when I upgrade?

Thanks for your guys work on this. Much appreciated

stephenw10 · Feb 21, 2021, 3:10 PM

Yes, I expect it to be 21.02_1 or similar when made available. You should be able to upgrade to it from either 2.4.5p1 or 21.02.
Yes, the config version will be the same but you can always import an older config into a newer pfSense version anyway. You will be able to here.

Steve

NokkieF · Feb 21, 2021, 4:28 PM

@stephenw10
Does that mean that the url mentioned earlier in this thread will be up and running?

stephenw10 · Feb 21, 2021, 5:14 PM

The pkg server? Yes, it will be. When it's available the update should show on the dashboard like any previous update.

Steve

bcruze · Feb 23, 2021, 1:56 PM

@stephenw10 said in pfSense Plus and SG-3100:

You can disable one CPU core and it will avoid ever hitting the lock. Obviously performance will be reduced but that may not be an issue for a lot of use cases. Run:
echo hw.ncpu=1 >> /boot/loader.conf.local
Then reboot.

Remove or comment out that line later after this is fixed.

Steve

i went to diagnostics > command prompt and ran the command. got the green success screen i guess you call it and then rebooted

after a reboot when i go to diagnostics > edit file > open loader.conf nothing has changed.
do you have to use the console or SSH for this to complete?

stephenw10 · Feb 23, 2021, 2:31 PM

It doesn't add it to loader.conf which might get overwritten.

/boot/loader.conf.local

sdd · Feb 24, 2021, 12:03 AM

@stephenw10

I really appreciate the effort to root cause this, and for the easy workaround -- thank you!

What is the typical turn-around for pushing out a hotfix like this, if nothing goes wrong during testing? I've been holding-off on downgrading to 2.4.5 thinking a fix may be landing soon.

I put in the ncpu work-around after the bug started disrupting work meetings and online schooling, but it does cause the WAN bandwidth to max out at ~650Mbps.