Slow inter-VLAN Traffic

[hydrian]

Having some throughput issues here. When transferring data from my DMZ to my Server zone, my throughput goes through the floor. My main usage is SCP. I can normally get about ~100MB/sec when SCP push from the Client to the VM. When I do an SCP pull from the VM back to the Client, I'm getting ~15MB/sec. All SCP connections are initiated from the Server VLAN because the DMZ doesn't have an open port back to the Server VLAN.

I created another temporary VM in the same DMZ VLAN with the 'Problem server' to validate it was a router issue. I'm getting between 75-100MB/Sec the in subnet temporary VM and the Problem VM. At those speeds, the 'Problem VM' is CPU bound.

I checked the Router, it is not single/multi threaded bound. Typically, runs about 25% when doing long-running inter-VLAN SCP transfer. RAM is not anywhere being used. It is approximately running about %20 usage. The MBUF is fine too.

I do have PfBlockerNG installed and active on the DMZ interface, but even if I disable the DMZ PfBlocker rule, it makes no difference in speed.

Hardware

Router
Qotom Celeron J1900 (2 core 4 thread)
Intel 82583V 4 port network interface
8GB RAM
Off-brand mSATA 32GB SSD & Toshiba 1TB HDD (ZFS Mirror)
Pfsense 2.5.2 CE

Problem server - KVM VM (DMZ Zone)
1 core / 2 thread 2 on Ryzen 2700X
1 GB RAM
1 Virtio NIC backed with 2 Intel LACP LAG 1Gb.

Client (server zone)
Ryzen 2600X
16 GB RAM
Realtek RTL8111H NIC

Layer 2 Switch (Unifi USW-16-150)

[hydrian]

Nevermind. It was traffic shaper mucking me up.