Slow Rsync Speeds over any VPN

[arfadugus]

Hello, I have a super micro 1537 Netgate box and have a 1 Gig link to the WAN and a server directly connected to another 1 gig port on the LAN. My current issue is that with any VPN I have tried setting up in pfsense (Wireguard, OpenVPN, and Sonic Wall on a standalone box connected to the LAN) When I try to rsync a file or send via SFTP the transfer speed gets stuck around 3MB.

I have enabled some cryptographic acceleration options:
IPsec-MB - Checked
Cryptographic Hardware - AES-NI CPU-based Acceleration
Thermal Sensors - Intel Core* CPU on-die thermal sensor

And the offloading settings under advanced > networking > network interfaces:
Hardware Checksum Offloading - Unchecked
Hardware TCP Segmentation Offloading - Checked
Hardware large Receive Offloading - Checked

Here are the specs in the dashboard:
System Super Micro 1537

BIOS Vendor: American Megatrends Inc.
Version: 2.0c
Release Date: Thu Jun 27 2019
Boot Environment Current: default
Next: default
Version 24.03-RELEASE (amd64)
built on Wed Apr 24 10:38:00 MST 2024
FreeBSD 15.0-CURRENT

The system is on the latest version.
Version information updated at Tue Sep 17 7:13:34 MST 2024

CPU Type Intel(R) Xeon(R) CPU D-1537 @ 1.70GHz
Current: 1700 MHz, Max: 1701 MHz
16 CPUs : 1 package(s) x 8 core(s) x 2 hardware threads
AES-NI CPU Crypto: Yes (active)
IPsec-MB Crypto: Yes (active)
QAT Crypto: No

Also, there are no traffic shaping rules in place.

Is there anything I can check or change to get faster speeds using rsync/SFTP?