2.5 with many tunnels - Apply Changes fails

vergilis

So I guess on an related issue the ? go the wrong URL.

I was able to finally turn down the logging and I cannot find any errors in IPSec log.

Here are some entries in System log:

2021/02/18 13:38:18 [error] 51390#100109: *64336 upstream timed out (60: Operation timed out) while reading response header from upstream, client: 5.6.7.8, server: , request: "POST /vpn_ipsec_settings.php HTTP/2.0", upstream: "fastcgi://unix:/var/run/php-fpm.socket", host: "fwname.example.com:1234", referrer: "https://fwname.example.com:1234/vpn_ipsec_settings.php"

jimp

Can you watch the console as the firewall boots up and see how long it takes to configure IPsec at boot time?

vergilis

That is hard to do as it is an AWS instance, but I will try.

vergilis

It was stuck on this screen for about 4 minutes.

Please let me know if you need anything else.

jimp

That g_vfs_done line implies it's having problems communicating with its storage.

You may have some other problem in your hypervisor/guest config which is causing it to perform slower than it should, leading to your timerout.

vergilis

Only post 2.5 upgrade and only for IpSec tunnels?

jimp

Yes, it's common for hypervisors to need adjustments when moving from one FreeBSD version to another, depending on your settings.

It may not be related to IPsec at all, just that it's something that is time consuming and provokes the general slowness.

vergilis

Thank you.

What is your recommendation to correct this?

jimp

That depends on your hypervisor and guest settings, I don't have any general recommendations there other than to check what your hypervisor recommends for use with FreeBSD 12.2 (or at least 12.x).

vergilis

This is an AWS instance with your approved image and size. This is a c5n.large.

jimp

Then I suggest you redeploy it instead of upgrading in-place to see if the problem happens that way.

vergilis

When I load the XML file into a new instance, your software produces the same timeout issue and the XML never loads.

Any other ideas?

vergilis

Also, after a few attempts it loaded. It continues to hang in the same spot during boot up, and actually does not boot up at all. I don't think that its hardware or disk related.

Please let me know how you would like to proceed.

jimp

Is there any way you can try at least loading the IPsec portion of that configuration in a non-AWS system?

It's difficult to tell if it's related to IPsec or if there is a general problem with AWS.

The only other potentially-related report I've seen is a report of a kernel panic on AWS with someone that has even more IPsec tunnels than you, but as far as I'm aware they were not experiencing any slowness or boot delays.