Network Disruption Issues During Nightly Backups
-
Hi
I have recently encountered an issue with a client where, during nightly backups, the internal network experiences a severe slowdown. Port forwarding also becomes non-functional, except for the port forwarding rule directed to the pfSense itself (which is generally only accessible from my company's IP). This results in the internal network's PCs losing internet access, and communication with internal servers is disrupted.
The problem is temporarily resolved by performing a reboot, but it resurfaces with each subsequent backup. As a temporary measure, I am currently scheduling a daily reboot at 05:00 using a Cronjob.
A few days ago, I faced a similar issue when conducting a speed test. Disabling gateway monitoring prevented network crashes during speed tests.
I'm hoping someone might have ideas on where I should look for a solution. Unfortunately, I couldn't find any conclusive information in the logs.
Hardware: Netgate 6100
If necessary, I can provide additional data and logs.
Thank you in advance,
Manuel -
I would assume the backups are passing through the FW?
Is your reboot breaking the backup?
Does the problem clear once the backup completes? -
@AndyRH yes, the backup is passing the FW, it's a remote sync from the proxmox backup server at the customers location to a proxmox backup server at my place.
Yes, the reboot is breaking the backup.
I can't tell if the problem clears once the backup completes. It never completed so far, the network stopped working before it was done every time. -
@manuelSch said in Network Disruption Issues During Nightly Backups:
Disabling gateway monitoring prevented network crashes during speed tests.
If you saturate your pipe, its quite possible your monitoring pings could get delayed - once they reach your threshold, pfsense will think the gateway is down. And could cause a reset of states - if you have that set, etc.
You will want to most likely adjust your settings for monitoring or turn off the options that happen when pfsense thinks the gateway is down. You could set it to be considered always up, etc.
Other option would be to adjust your backup so it doesn't saturate your pipe, or using could use qos probably.
-
Can you QOS the backup traffic?
Can you force the backup through a port set to a lower speed?
